[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435717191469-28623-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:08:37 dist-test-slave-7lbf krb5kdc[28641](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:08:37 dist-test-slave-7lbf krb5kdc[28641](info): set up 2 sockets
Aug 11 08:08:37 dist-test-slave-7lbf krb5kdc[28641](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260811 08:08:38.444980 28623 mini_kdc.cc:121] Time spent starting KDC: real 1.225s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435717191469-28623-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435717191469-28623-0/krb5kdc/test-user.keytab.
Aug 11 08:08:38 dist-test-slave-7lbf krb5kdc[28641](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435718, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:08:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:08:38Z Disabled control of system clock
WARNING: no policy specified for kudu/127.27.243.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.243.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.243.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab.
Entry for principal kudu/127.27.243.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab.
I20260811 08:08:38.560187 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435717191469-28623-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435717191469-28623-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435717191469-28623-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.243.254:40469
--webserver_interface=127.27.243.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab
--principal=kudu/127.27.243.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:41295
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.243.254:40469
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:08:38.675522 28662 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:08:38.675756 28662 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:08:38.675789 28662 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:08:38.677018 28662 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:08:38.677060 28662 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:08:38.677078 28662 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:08:38.677096 28662 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:08:38.677111 28662 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:08:38.679061 28662 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:41295
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435717191469-28623-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435717191469-28623-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.243.254:40469
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab
--principal=kudu/127.27.243.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.243.254:40469
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.243.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28662
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435717191469-28623-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:08:38.679440 28662 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:08:38.679697 28662 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:08:38.685827 28670 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:08:38.686391 28662 server_base.cc:1034] running on GCE node
W20260811 08:08:38.686738 28673 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:08:38.687068 28671 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:08:38.687392 28662 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:08:38.687741 28662 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:08:38.688902 28662 hybrid_clock.cc:648] HybridClock initialized: now 1786435718688905 us; error 51 us; skew 500 ppm
Aug 11 08:08:38 dist-test-slave-7lbf krb5kdc[28641](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435718, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:08:38.691725 28662 init.cc:377] Logged in from keytab as kudu/127.27.243.254@KRBTEST.COM (short username kudu)
I20260811 08:08:38.692384 28662 webserver.cc:460] Webserver started at http://127.27.243.254:42021/ using document root <none> and password file <none>
I20260811 08:08:38.692653 28662 fs_manager.cc:359] Metadata directory not provided
I20260811 08:08:38.692706 28662 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:08:38.692909 28662 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:08:38.694285 28662 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435717191469-28623-0/minicluster-data/master-0/data/instance:
uuid: "5866a7e832ac46b2ab447b05ba415750"
format_stamp: "Formatted at 2026-08-11 08:08:38 on dist-test-slave-7lbf"
server_key: "7af92954eff7ae01b6570947679cbb09"
server_key_iv: "6212cdce1cdd7de49cf6d6711d066de8"
server_key_version: "encryptionkey@0"
I20260811 08:08:38.694633 28662 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435717191469-28623-0/minicluster-data/master-0/wal/instance:
uuid: "5866a7e832ac46b2ab447b05ba415750"
format_stamp: "Formatted at 2026-08-11 08:08:38 on dist-test-slave-7lbf"
server_key: "7af92954eff7ae01b6570947679cbb09"
server_key_iv: "6212cdce1cdd7de49cf6d6711d066de8"
server_key_version: "encryptionkey@0"
I20260811 08:08:38.696626 28662 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260811 08:08:38.697655 28686 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:08:38.697935 28662 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:08:38.698022 28662 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435717191469-28623-0/minicluster-data/master-0/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435717191469-28623-0/minicluster-data/master-0/wal
uuid: "5866a7e832ac46b2ab447b05ba415750"
format_stamp: "Formatted at 2026-08-11 08:08:38 on dist-test-slave-7lbf"
server_key: "7af92954eff7ae01b6570947679cbb09"
server_key_iv: "6212cdce1cdd7de49cf6d6711d066de8"
server_key_version: "encryptionkey@0"
I20260811 08:08:38.698092 28662 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435717191469-28623-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435717191469-28623-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435717191469-28623-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:08:38.715381 28662 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:08:38.717904 28662 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:08:38.718138 28662 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:08:38.730343 28662 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.254:40469
I20260811 08:08:38.730518 28776 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.254:40469 every 8 connection(s)
I20260811 08:08:38.731143 28662 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
I20260811 08:08:38.732779 28777 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:08:38.736912 28777 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5866a7e832ac46b2ab447b05ba415750: Bootstrap starting.
I20260811 08:08:38.737419 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 28662
I20260811 08:08:38.737528 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435717191469-28623-0/minicluster-data/master-0/wal/instance
I20260811 08:08:38.738162 28623 external_mini_cluster.cc:1428] Setting key 50d3037ec5dd842b9c7d236d4db69123
I20260811 08:08:38.738498 28777 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5866a7e832ac46b2ab447b05ba415750: Neither blocks nor log segments found. Creating new log.
I20260811 08:08:38.739481 28777 log.cc:824] T 00000000000000000000000000000000 P 5866a7e832ac46b2ab447b05ba415750: Log is configured to *not* fsync() on all Append() calls
I20260811 08:08:38.740552 28777 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5866a7e832ac46b2ab447b05ba415750: No bootstrap required, opened a new log
I20260811 08:08:38.744318 28777 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5866a7e832ac46b2ab447b05ba415750 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5866a7e832ac46b2ab447b05ba415750" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 40469 } }
I20260811 08:08:38.744499 28777 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5866a7e832ac46b2ab447b05ba415750 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:08:38.744604 28777 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5866a7e832ac46b2ab447b05ba415750 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5866a7e832ac46b2ab447b05ba415750, State: Initialized, Role: FOLLOWER
I20260811 08:08:38.744772 28777 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5866a7e832ac46b2ab447b05ba415750 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5866a7e832ac46b2ab447b05ba415750" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 40469 } }
I20260811 08:08:38.744930 28777 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5866a7e832ac46b2ab447b05ba415750 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:08:38.744978 28777 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5866a7e832ac46b2ab447b05ba415750 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:08:38.745024 28777 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5866a7e832ac46b2ab447b05ba415750 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:08:38.745682 28777 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5866a7e832ac46b2ab447b05ba415750 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5866a7e832ac46b2ab447b05ba415750" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 40469 } }
I20260811 08:08:38.745905 28777 leader_election.cc:302] T 00000000000000000000000000000000 P 5866a7e832ac46b2ab447b05ba415750 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5866a7e832ac46b2ab447b05ba415750; no voters:
I20260811 08:08:38.746109 28777 leader_election.cc:288] T 00000000000000000000000000000000 P 5866a7e832ac46b2ab447b05ba415750 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:08:38.746302 28783 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5866a7e832ac46b2ab447b05ba415750 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:08:38.746610 28783 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5866a7e832ac46b2ab447b05ba415750 [term 1 LEADER]: Becoming Leader. State: Replica: 5866a7e832ac46b2ab447b05ba415750, State: Running, Role: LEADER
I20260811 08:08:38.746779 28777 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5866a7e832ac46b2ab447b05ba415750 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:08:38.746743 28783 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5866a7e832ac46b2ab447b05ba415750 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5866a7e832ac46b2ab447b05ba415750" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 40469 } }
I20260811 08:08:38.747390 28783 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5866a7e832ac46b2ab447b05ba415750 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5866a7e832ac46b2ab447b05ba415750. Latest consensus state: current_term: 1 leader_uuid: "5866a7e832ac46b2ab447b05ba415750" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5866a7e832ac46b2ab447b05ba415750" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 40469 } } }
I20260811 08:08:38.747478 28783 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5866a7e832ac46b2ab447b05ba415750 [sys.catalog]: This master's current role is: LEADER
I20260811 08:08:38.747588 28785 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5866a7e832ac46b2ab447b05ba415750 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5866a7e832ac46b2ab447b05ba415750" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5866a7e832ac46b2ab447b05ba415750" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 40469 } } }
I20260811 08:08:38.748111 28785 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5866a7e832ac46b2ab447b05ba415750 [sys.catalog]: This master's current role is: LEADER
I20260811 08:08:38.748675 28794 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:08:38.750360 28794 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:08:38.752862 28794 catalog_manager.cc:1347] Generated new cluster ID: b5efd7216bae4c969a4f51faa635332a
I20260811 08:08:38.752919 28794 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 08:08:38 dist-test-slave-7lbf krb5kdc[28641](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435718, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.243.254@KRBTEST.COM
I20260811 08:08:38.761662 28779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:38.739496 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49318 (local address 127.27.243.254:40469)
0811 08:08:38.739971 (+ 475us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:38.739982 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:38.740149 (+ 167us) server_negotiation.cc:407] Connection header received
0811 08:08:38.744708 (+ 4559us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:38.744717 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:38.744811 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:38.744947 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:38.747462 (+ 2515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:38.749681 (+ 2219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:38.751168 (+ 1487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:38.751914 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:38.752027 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:38.756688 (+ 4661us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:08:38.756692 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:08:38.756692 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:08:38.756707 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:08:38.759311 (+ 2604us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:38.759789 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:38.759793 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:38.759793 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:38.759982 (+ 189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:38.760250 (+ 268us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:38.760251 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:38.760251 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:38.760586 (+ 335us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:08:38.760965 (+ 379us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:38.761064 (+ 99us) server_negotiation.cc:299] Negotiation successful
0811 08:08:38.761218 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":264,"thread_start_us":74,"threads_started":1}
I20260811 08:08:38.763378 28794 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:08:38.763968 28794 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:08:38.768507 28794 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5866a7e832ac46b2ab447b05ba415750: Generated new TSK 0
I20260811 08:08:38.768669 28794 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.27.243.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.243.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.243.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.193.keytab.
Entry for principal kudu/127.27.243.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.193.keytab.
I20260811 08:08:38.800627 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435717191469-28623-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435717191469-28623-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435717191469-28623-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435717191469-28623-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.243.193:0
--local_ip_for_outbound_sockets=127.27.243.193
--webserver_interface=127.27.243.193
--webserver_port=0
--tserver_master_addrs=127.27.243.254:40469
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.193.keytab
--principal=kudu/127.27.243.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:41295
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:08:38.884424 28821 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:08:38.884627 28821 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:08:38.884661 28821 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:08:38.885860 28821 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:08:38.885905 28821 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:08:38.885946 28821 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.243.193
I20260811 08:08:38.887621 28821 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:41295
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435717191469-28623-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435717191469-28623-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.193.keytab
--principal=kudu/127.27.243.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.243.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435717191469-28623-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.243.193
--webserver_port=0
--tserver_master_addrs=127.27.243.254:40469
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28821
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.243.193
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435717191469-28623-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:08:38.887929 28821 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:08:38.888146 28821 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:08:38.894904 28828 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:08:38.894933 28827 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:08:38.894958 28831 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:08:38.895426 28821 server_base.cc:1034] running on GCE node
I20260811 08:08:38.895637 28821 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:08:38.895877 28821 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:08:38.897032 28821 hybrid_clock.cc:648] HybridClock initialized: now 1786435718897016 us; error 34 us; skew 500 ppm
Aug 11 08:08:38 dist-test-slave-7lbf krb5kdc[28641](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435718, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:08:38.900544 28821 init.cc:377] Logged in from keytab as kudu/127.27.243.193@KRBTEST.COM (short username kudu)
I20260811 08:08:38.901029 28821 webserver.cc:460] Webserver started at http://127.27.243.193:39931/ using document root <none> and password file <none>
I20260811 08:08:38.901307 28821 fs_manager.cc:359] Metadata directory not provided
I20260811 08:08:38.901420 28821 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:08:38.901594 28821 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:08:38.902890 28821 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435717191469-28623-0/minicluster-data/ts-0/data/instance:
uuid: "531304e58b6643eaa7ba5157069de343"
format_stamp: "Formatted at 2026-08-11 08:08:38 on dist-test-slave-7lbf"
server_key: "ae7c339935049670eb852d8a0255593b"
server_key_iv: "9f846457445ef4e7b3cbc5df5587fc83"
server_key_version: "encryptionkey@0"
I20260811 08:08:38.903343 28821 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435717191469-28623-0/minicluster-data/ts-0/wal/instance:
uuid: "531304e58b6643eaa7ba5157069de343"
format_stamp: "Formatted at 2026-08-11 08:08:38 on dist-test-slave-7lbf"
server_key: "ae7c339935049670eb852d8a0255593b"
server_key_iv: "9f846457445ef4e7b3cbc5df5587fc83"
server_key_version: "encryptionkey@0"
I20260811 08:08:38.904981 28821 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 08:08:38.905892 28843 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:08:38.906059 28821 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 08:08:38.906141 28821 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435717191469-28623-0/minicluster-data/ts-0/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435717191469-28623-0/minicluster-data/ts-0/wal
uuid: "531304e58b6643eaa7ba5157069de343"
format_stamp: "Formatted at 2026-08-11 08:08:38 on dist-test-slave-7lbf"
server_key: "ae7c339935049670eb852d8a0255593b"
server_key_iv: "9f846457445ef4e7b3cbc5df5587fc83"
server_key_version: "encryptionkey@0"
I20260811 08:08:38.906206 28821 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435717191469-28623-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435717191469-28623-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435717191469-28623-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:08:38.913805 28821 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:08:38.916020 28821 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:08:38.916193 28821 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:08:38.916560 28821 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:08:38.916916 28821 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:08:38.917011 28821 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:08:38.917052 28821 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:08:38.917078 28821 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:08:38.934352 28821 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.193:38653
I20260811 08:08:38.934554 29035 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.193:38653 every 8 connection(s)
I20260811 08:08:38.934839 28821 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435717191469-28623-0/minicluster-data/ts-0/data/info.pb
I20260811 08:08:38.936363 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 28821
I20260811 08:08:38.936448 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435717191469-28623-0/minicluster-data/ts-0/wal/instance
I20260811 08:08:38.936592 28623 external_mini_cluster.cc:1428] Setting key 845619b31f2ebc5ac1af07a0287f7311
Aug 11 08:08:38 dist-test-slave-7lbf krb5kdc[28641](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435718, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.193@KRBTEST.COM for kudu/127.27.243.254@KRBTEST.COM
I20260811 08:08:38.947261 28779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:38.935853 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.193:32993 (local address 127.27.243.254:40469)
0811 08:08:38.935911 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:38.935913 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:38.936204 (+ 291us) server_negotiation.cc:407] Connection header received
0811 08:08:38.938135 (+ 1931us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:38.938137 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:38.938148 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:38.938208 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:38.939078 (+ 870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:38.939870 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:38.941639 (+ 1769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:38.941906 (+ 267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:38.941982 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:38.944644 (+ 2662us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:08:38.944646 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:08:38.944646 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:08:38.944653 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:08:38.945929 (+ 1276us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:38.946306 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:38.946308 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:38.946308 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:38.946364 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:38.946583 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:38.946584 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:38.946584 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:38.946693 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:08:38.946751 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:38.947083 (+ 332us) server_negotiation.cc:299] Negotiation successful
0811 08:08:38.947174 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260811 08:08:38.947501 29041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:38.935803 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:40469 (local address 127.27.243.193:32993)
0811 08:08:38.936012 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0811 08:08:38.936065 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0811 08:08:38.938011 (+ 1946us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:08:38.938284 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:08:38.938288 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:08:38.938641 (+ 353us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:08:38.938953 (+ 312us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:38.938960 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:38.940015 (+ 1055us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:38.940016 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:38.941480 (+ 1464us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:38.941483 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:38.942005 (+ 522us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:38.942006 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:38.942211 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:38.942797 (+ 586us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:08:38.942808 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:08:38.944554 (+ 1746us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:08:38.946006 (+ 1452us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:08:38.946013 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:08:38.946016 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:08:38.946246 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:08:38.946419 (+ 173us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:08:38.946419 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:08:38.946420 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:08:38.946527 (+ 107us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:08:38.946768 (+ 241us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:08:38.946775 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:08:38.946954 (+ 179us) client_negotiation.cc:769] Sending connection context
0811 08:08:38.947055 (+ 101us) client_negotiation.cc:240] Negotiation successful
0811 08:08:38.947212 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":124,"threads_started":1}
I20260811 08:08:38.948079 29038 heartbeater.cc:347] Connected to a master server at 127.27.243.254:40469
I20260811 08:08:38.948171 29038 heartbeater.cc:464] Registering TS with master...
I20260811 08:08:38.948360 29038 heartbeater.cc:511] Master 127.27.243.254:40469 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.27.243.194@KRBTEST.COM; defaulting to no policy
I20260811 08:08:38.949383 28712 ts_manager.cc:194] Registered new tserver with Master: 531304e58b6643eaa7ba5157069de343 (127.27.243.193:38653)
I20260811 08:08:38.950261 28712 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.243.193@KRBTEST.COM'} at 127.27.243.193:32993
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.243.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.243.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.194.keytab.
Entry for principal kudu/127.27.243.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.194.keytab.
I20260811 08:08:38.966297 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435717191469-28623-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435717191469-28623-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435717191469-28623-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435717191469-28623-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.243.194:0
--local_ip_for_outbound_sockets=127.27.243.194
--webserver_interface=127.27.243.194
--webserver_port=0
--tserver_master_addrs=127.27.243.254:40469
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.194.keytab
--principal=kudu/127.27.243.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:41295
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:08:39.087282 29047 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:08:39.087477 29047 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:08:39.087502 29047 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:08:39.088606 29047 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:08:39.088639 29047 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:08:39.088665 29047 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.243.194
I20260811 08:08:39.090303 29047 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:41295
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435717191469-28623-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435717191469-28623-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.194.keytab
--principal=kudu/127.27.243.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.243.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435717191469-28623-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.243.194
--webserver_port=0
--tserver_master_addrs=127.27.243.254:40469
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29047
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.243.194
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435717191469-28623-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:08:39.090504 29047 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:08:39.090736 29047 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:08:39.096366 29058 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:08:39.096395 29059 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:08:39.096446 29061 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:08:39.096499 29047 server_base.cc:1034] running on GCE node
I20260811 08:08:39.096788 29047 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:08:39.097003 29047 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:08:39.098145 29047 hybrid_clock.cc:648] HybridClock initialized: now 1786435719098133 us; error 29 us; skew 500 ppm
Aug 11 08:08:39 dist-test-slave-7lbf krb5kdc[28641](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435719, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:08:39.101286 29047 init.cc:377] Logged in from keytab as kudu/127.27.243.194@KRBTEST.COM (short username kudu)
I20260811 08:08:39.101790 29047 webserver.cc:460] Webserver started at http://127.27.243.194:43043/ using document root <none> and password file <none>
I20260811 08:08:39.102032 29047 fs_manager.cc:359] Metadata directory not provided
I20260811 08:08:39.102084 29047 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:08:39.102216 29047 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:08:39.103384 29047 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435717191469-28623-0/minicluster-data/ts-1/data/instance:
uuid: "e1c7848f86574baa87795bfbd4e25255"
format_stamp: "Formatted at 2026-08-11 08:08:39 on dist-test-slave-7lbf"
server_key: "c248ac6b7ebf7aa71917c2e1d9d190a3"
server_key_iv: "859064d7acc25215d20d7394004b0741"
server_key_version: "encryptionkey@0"
I20260811 08:08:39.103806 29047 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435717191469-28623-0/minicluster-data/ts-1/wal/instance:
uuid: "e1c7848f86574baa87795bfbd4e25255"
format_stamp: "Formatted at 2026-08-11 08:08:39 on dist-test-slave-7lbf"
server_key: "c248ac6b7ebf7aa71917c2e1d9d190a3"
server_key_iv: "859064d7acc25215d20d7394004b0741"
server_key_version: "encryptionkey@0"
I20260811 08:08:39.105151 29047 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 08:08:39.105976 29072 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:08:39.106133 29047 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 08:08:39.106223 29047 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435717191469-28623-0/minicluster-data/ts-1/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435717191469-28623-0/minicluster-data/ts-1/wal
uuid: "e1c7848f86574baa87795bfbd4e25255"
format_stamp: "Formatted at 2026-08-11 08:08:39 on dist-test-slave-7lbf"
server_key: "c248ac6b7ebf7aa71917c2e1d9d190a3"
server_key_iv: "859064d7acc25215d20d7394004b0741"
server_key_version: "encryptionkey@0"
I20260811 08:08:39.106284 29047 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435717191469-28623-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435717191469-28623-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435717191469-28623-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:08:39.128562 29047 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:08:39.130842 29047 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:08:39.131017 29047 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:08:39.131461 29047 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:08:39.131842 29047 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:08:39.131886 29047 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:08:39.131916 29047 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:08:39.131933 29047 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:08:39.146979 29047 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.194:42061
I20260811 08:08:39.147042 29262 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.194:42061 every 8 connection(s)
I20260811 08:08:39.147351 29047 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435717191469-28623-0/minicluster-data/ts-1/data/info.pb
I20260811 08:08:39.152385 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 29047
I20260811 08:08:39.152484 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435717191469-28623-0/minicluster-data/ts-1/wal/instance
I20260811 08:08:39.152668 28623 external_mini_cluster.cc:1428] Setting key e86286415495508d333de8cbf3fbba89
Aug 11 08:08:39 dist-test-slave-7lbf krb5kdc[28641](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435719, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.194@KRBTEST.COM for kudu/127.27.243.254@KRBTEST.COM
I20260811 08:08:39.157763 28779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:39.148244 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.194:45641 (local address 127.27.243.254:40469)
0811 08:08:39.148289 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:39.148291 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:39.148491 (+ 200us) server_negotiation.cc:407] Connection header received
0811 08:08:39.149101 (+ 610us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:39.149103 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:39.149113 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:39.149162 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:39.150263 (+ 1101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:39.150766 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:39.151878 (+ 1112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:39.152057 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:39.152099 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:39.154778 (+ 2679us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:08:39.154779 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:08:39.154780 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:08:39.154787 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:08:39.156362 (+ 1575us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:39.156854 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:39.156855 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:39.156855 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:39.156906 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:39.157155 (+ 249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:39.157155 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:39.157155 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:39.157248 (+ 93us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:08:39.157294 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:39.157636 (+ 342us) server_negotiation.cc:299] Negotiation successful
0811 08:08:39.157699 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 08:08:39.158066 29268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:39.148217 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:40469 (local address 127.27.243.194:45641)
0811 08:08:39.148370 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0811 08:08:39.148410 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 08:08:39.148995 (+ 585us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:08:39.149223 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:08:39.149227 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:08:39.149984 (+ 757us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:08:39.150188 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:39.150193 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:39.150864 (+ 671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:39.150865 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:39.151817 (+ 952us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:39.151820 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:39.152144 (+ 324us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:39.152146 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:39.152417 (+ 271us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:39.153050 (+ 633us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:08:39.153061 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:08:39.154687 (+ 1626us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:08:39.156447 (+ 1760us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:08:39.156454 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:08:39.156456 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:08:39.156785 (+ 329us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:08:39.156964 (+ 179us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:08:39.156964 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:08:39.156965 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:08:39.157100 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:08:39.157299 (+ 199us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:08:39.157305 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:08:39.157472 (+ 167us) client_negotiation.cc:769] Sending connection context
0811 08:08:39.157621 (+ 149us) client_negotiation.cc:240] Negotiation successful
0811 08:08:39.157785 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":83,"threads_started":1}
I20260811 08:08:39.158659 29266 heartbeater.cc:347] Connected to a master server at 127.27.243.254:40469
I20260811 08:08:39.158761 29266 heartbeater.cc:464] Registering TS with master...
I20260811 08:08:39.158936 29266 heartbeater.cc:511] Master 127.27.243.254:40469 requested a full tablet report, sending...
I20260811 08:08:39.159312 28712 ts_manager.cc:194] Registered new tserver with Master: e1c7848f86574baa87795bfbd4e25255 (127.27.243.194:42061)
I20260811 08:08:39.159684 28712 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.243.194@KRBTEST.COM'} at 127.27.243.194:45641
WARNING: no policy specified for kudu/127.27.243.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.243.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.243.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.195.keytab.
Entry for principal kudu/127.27.243.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.195.keytab.
I20260811 08:08:39.182039 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435717191469-28623-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435717191469-28623-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435717191469-28623-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435717191469-28623-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.243.195:0
--local_ip_for_outbound_sockets=127.27.243.195
--webserver_interface=127.27.243.195
--webserver_port=0
--tserver_master_addrs=127.27.243.254:40469
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.195.keytab
--principal=kudu/127.27.243.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:41295
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:08:39.266085 29274 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:08:39.266276 29274 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:08:39.266309 29274 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:08:39.267418 29274 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:08:39.267458 29274 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:08:39.267493 29274 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.243.195
I20260811 08:08:39.268968 29274 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:41295
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435717191469-28623-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435717191469-28623-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.195.keytab
--principal=kudu/127.27.243.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.243.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435717191469-28623-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.243.195
--webserver_port=0
--tserver_master_addrs=127.27.243.254:40469
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29274
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.243.195
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435717191469-28623-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:08:39.269188 29274 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:08:39.269394 29274 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:08:39.275326 29289 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:08:39.275341 29285 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:08:39.275386 29283 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:08:39.275683 29274 server_base.cc:1034] running on GCE node
I20260811 08:08:39.275871 29274 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:08:39.276104 29274 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:08:39.277242 29274 hybrid_clock.cc:648] HybridClock initialized: now 1786435719277228 us; error 31 us; skew 500 ppm
Aug 11 08:08:39 dist-test-slave-7lbf krb5kdc[28641](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435719, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:08:39.279639 29274 init.cc:377] Logged in from keytab as kudu/127.27.243.195@KRBTEST.COM (short username kudu)
I20260811 08:08:39.280071 29274 webserver.cc:460] Webserver started at http://127.27.243.195:41315/ using document root <none> and password file <none>
I20260811 08:08:39.280272 29274 fs_manager.cc:359] Metadata directory not provided
I20260811 08:08:39.280329 29274 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:08:39.280457 29274 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:08:39.281437 29274 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435717191469-28623-0/minicluster-data/ts-2/data/instance:
uuid: "12487e7e06a54757bae233b991e4c141"
format_stamp: "Formatted at 2026-08-11 08:08:39 on dist-test-slave-7lbf"
server_key: "169013998b35d813dd931dced6c93d09"
server_key_iv: "0649479e0a8e539ce9cfa8a0ce698259"
server_key_version: "encryptionkey@0"
I20260811 08:08:39.281876 29274 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435717191469-28623-0/minicluster-data/ts-2/wal/instance:
uuid: "12487e7e06a54757bae233b991e4c141"
format_stamp: "Formatted at 2026-08-11 08:08:39 on dist-test-slave-7lbf"
server_key: "169013998b35d813dd931dced6c93d09"
server_key_iv: "0649479e0a8e539ce9cfa8a0ce698259"
server_key_version: "encryptionkey@0"
I20260811 08:08:39.283104 29274 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:08:39.283826 29297 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:08:39.283998 29274 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:08:39.284070 29274 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435717191469-28623-0/minicluster-data/ts-2/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435717191469-28623-0/minicluster-data/ts-2/wal
uuid: "12487e7e06a54757bae233b991e4c141"
format_stamp: "Formatted at 2026-08-11 08:08:39 on dist-test-slave-7lbf"
server_key: "169013998b35d813dd931dced6c93d09"
server_key_iv: "0649479e0a8e539ce9cfa8a0ce698259"
server_key_version: "encryptionkey@0"
I20260811 08:08:39.284130 29274 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435717191469-28623-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435717191469-28623-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435717191469-28623-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:08:39.293213 29274 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:08:39.294864 29274 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:08:39.294986 29274 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:08:39.295257 29274 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:08:39.295537 29274 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:08:39.295570 29274 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:08:39.295598 29274 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:08:39.295621 29274 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:08:39.301709 29274 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.195:45315
I20260811 08:08:39.301762 29492 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.195:45315 every 8 connection(s)
I20260811 08:08:39.302035 29274 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435717191469-28623-0/minicluster-data/ts-2/data/info.pb
I20260811 08:08:39.307548 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 29274
I20260811 08:08:39.307628 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435717191469-28623-0/minicluster-data/ts-2/wal/instance
I20260811 08:08:39.307801 28623 external_mini_cluster.cc:1428] Setting key 3cba39b3a11ff239f7b937e4fce31723
Aug 11 08:08:39 dist-test-slave-7lbf krb5kdc[28641](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435719, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.195@KRBTEST.COM for kudu/127.27.243.254@KRBTEST.COM
I20260811 08:08:39.311021 28779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:39.302743 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.195:41137 (local address 127.27.243.254:40469)
0811 08:08:39.302821 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:39.302823 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:39.302993 (+ 170us) server_negotiation.cc:407] Connection header received
0811 08:08:39.303473 (+ 480us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:39.303474 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:39.303485 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:39.303528 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:39.304435 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:39.304938 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:39.306022 (+ 1084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:39.306212 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:39.306264 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:39.308391 (+ 2127us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:08:39.308393 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:08:39.308393 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:08:39.308400 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:08:39.309910 (+ 1510us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:39.310250 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:39.310250 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:39.310250 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:39.310306 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:39.310468 (+ 162us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:39.310468 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:39.310469 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:39.310593 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:08:39.310670 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:39.310889 (+ 219us) server_negotiation.cc:299] Negotiation successful
0811 08:08:39.310956 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260811 08:08:39.311141 29499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:39.302716 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:40469 (local address 127.27.243.195:41137)
0811 08:08:39.302879 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0811 08:08:39.302917 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 08:08:39.303393 (+ 476us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:08:39.303592 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:08:39.303595 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:08:39.304155 (+ 560us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:08:39.304352 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:39.304356 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:39.305032 (+ 676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:39.305033 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:39.305939 (+ 906us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:39.305942 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:39.306279 (+ 337us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:39.306289 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:39.306387 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:39.306805 (+ 418us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:08:39.306816 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:08:39.308318 (+ 1502us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:08:39.309977 (+ 1659us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:08:39.309984 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:08:39.309986 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:08:39.310193 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:08:39.310347 (+ 154us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:08:39.310347 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:08:39.310347 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:08:39.310427 (+ 80us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:08:39.310660 (+ 233us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:08:39.310666 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:08:39.310773 (+ 107us) client_negotiation.cc:769] Sending connection context
0811 08:08:39.310859 (+ 86us) client_negotiation.cc:240] Negotiation successful
0811 08:08:39.310977 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":90,"threads_started":1}
I20260811 08:08:39.311556 29494 heartbeater.cc:347] Connected to a master server at 127.27.243.254:40469
I20260811 08:08:39.311645 29494 heartbeater.cc:464] Registering TS with master...
I20260811 08:08:39.311784 29494 heartbeater.cc:511] Master 127.27.243.254:40469 requested a full tablet report, sending...
I20260811 08:08:39.312114 28712 ts_manager.cc:194] Registered new tserver with Master: 12487e7e06a54757bae233b991e4c141 (127.27.243.195:45315)
I20260811 08:08:39.312482 28712 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.243.195@KRBTEST.COM'} at 127.27.243.195:41137
I20260811 08:08:39.319815 28623 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 08:08:39 dist-test-slave-7lbf krb5kdc[28641](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435719, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 08:08:39 dist-test-slave-7lbf krb5kdc[28641](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435719, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.27.243.193@KRBTEST.COM
I20260811 08:08:39.343777 29508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:39.336241 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50332 (local address 127.27.243.193:38653)
0811 08:08:39.336420 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:39.336425 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:39.336434 (+ 9us) server_negotiation.cc:407] Connection header received
0811 08:08:39.336460 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:39.336462 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:39.336476 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:39.336553 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:39.337125 (+ 572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:39.337926 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:39.338637 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:39.338957 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:39.339020 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:39.341155 (+ 2135us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:08:39.341164 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:08:39.341164 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:08:39.341170 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:08:39.342691 (+ 1521us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:39.343033 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:39.343035 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:39.343035 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:39.343088 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:39.343316 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:39.343317 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:39.343317 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:39.343462 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:08:39.343594 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:39.343627 (+ 33us) server_negotiation.cc:299] Negotiation successful
0811 08:08:39.343690 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":143,"thread_start_us":70,"threads_started":1}
W20260811 08:08:39.344282 28894 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50332
Aug 11 08:08:39 dist-test-slave-7lbf krb5kdc[28641](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435719, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 08:08:39 dist-test-slave-7lbf krb5kdc[28641](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435719, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.243.193@KRBTEST.COM
I20260811 08:08:39.365895 29508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:39.359647 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50342 (local address 127.27.243.193:38653)
0811 08:08:39.359705 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:39.359707 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:39.359716 (+ 9us) server_negotiation.cc:407] Connection header received
0811 08:08:39.359775 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:39.359776 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:39.359785 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:39.359883 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:39.360399 (+ 516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:39.360886 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:39.361597 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:39.361795 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:39.361852 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:39.363851 (+ 1999us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:08:39.363852 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:08:39.363852 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:08:39.363858 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:08:39.364968 (+ 1110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:39.365252 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:39.365253 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:39.365253 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:39.365295 (+ 42us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:39.365428 (+ 133us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:39.365429 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:39.365429 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:39.365580 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:08:39.365664 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:39.365736 (+ 72us) server_negotiation.cc:299] Negotiation successful
0811 08:08:39.365797 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 08:08:39.366340 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 28821
I20260811 08:08:39.379842 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 29047
I20260811 08:08:39.404337 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 29274
I20260811 08:08:39.416234 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 28662
2026-08-11T08:08:39Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (2224 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435717191469-28623-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:08:39 dist-test-slave-7lbf krb5kdc[29520](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:08:39 dist-test-slave-7lbf krb5kdc[29520](info): set up 2 sockets
Aug 11 08:08:39 dist-test-slave-7lbf krb5kdc[29520](info): commencing operation
krb5kdc: starting...
W20260811 08:08:40.580425 28623 mini_kdc.cc:121] Time spent starting KDC: real 1.142s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435717191469-28623-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435717191469-28623-0/krb5kdc/test-user.keytab.
Aug 11 08:08:40 dist-test-slave-7lbf krb5kdc[29520](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435720, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:08:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:08:40Z Disabled control of system clock
WARNING: no policy specified for kudu/127.27.243.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.243.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.243.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab.
Entry for principal kudu/127.27.243.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab.
I20260811 08:08:40.696035 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435717191469-28623-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435717191469-28623-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435717191469-28623-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.243.254:38023
--webserver_interface=127.27.243.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab
--principal=kudu/127.27.243.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:40029
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.243.254:38023
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:08:40.776189 29540 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:08:40.776404 29540 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:08:40.776435 29540 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:08:40.777575 29540 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:08:40.777614 29540 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:08:40.777634 29540 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:08:40.777648 29540 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:08:40.777664 29540 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:08:40.779126 29540 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:40029
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435717191469-28623-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435717191469-28623-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.243.254:38023
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab
--principal=kudu/127.27.243.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.243.254:38023
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.243.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29540
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435717191469-28623-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:08:40.779371 29540 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:08:40.779572 29540 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 08:08:40.784487 29540 server_base.cc:1034] running on GCE node
W20260811 08:08:40.784425 29552 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:08:40.784418 29551 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:08:40.784420 29554 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:08:40.784811 29540 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:08:40.785070 29540 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:08:40.786213 29540 hybrid_clock.cc:648] HybridClock initialized: now 1786435720786197 us; error 30 us; skew 500 ppm
Aug 11 08:08:40 dist-test-slave-7lbf krb5kdc[29520](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435720, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:08:40.796849 29540 init.cc:377] Logged in from keytab as kudu/127.27.243.254@KRBTEST.COM (short username kudu)
I20260811 08:08:40.797282 29540 webserver.cc:460] Webserver started at http://127.27.243.254:32785/ using document root <none> and password file <none>
I20260811 08:08:40.797551 29540 fs_manager.cc:359] Metadata directory not provided
I20260811 08:08:40.797616 29540 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:08:40.797744 29540 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:08:40.798774 29540 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435717191469-28623-0/minicluster-data/master-0/data/instance:
uuid: "c39bd882ac7843898c1647be56e555f4"
format_stamp: "Formatted at 2026-08-11 08:08:40 on dist-test-slave-7lbf"
server_key: "f02c330b0ec72e090eb8b93c8fce7ac1"
server_key_iv: "60babc39a1b387d9c5cf10d62e7b94af"
server_key_version: "encryptionkey@0"
I20260811 08:08:40.799120 29540 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435717191469-28623-0/minicluster-data/master-0/wal/instance:
uuid: "c39bd882ac7843898c1647be56e555f4"
format_stamp: "Formatted at 2026-08-11 08:08:40 on dist-test-slave-7lbf"
server_key: "f02c330b0ec72e090eb8b93c8fce7ac1"
server_key_iv: "60babc39a1b387d9c5cf10d62e7b94af"
server_key_version: "encryptionkey@0"
I20260811 08:08:40.800447 29540 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 08:08:40.801234 29563 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:08:40.801388 29540 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 08:08:40.801476 29540 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435717191469-28623-0/minicluster-data/master-0/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435717191469-28623-0/minicluster-data/master-0/wal
uuid: "c39bd882ac7843898c1647be56e555f4"
format_stamp: "Formatted at 2026-08-11 08:08:40 on dist-test-slave-7lbf"
server_key: "f02c330b0ec72e090eb8b93c8fce7ac1"
server_key_iv: "60babc39a1b387d9c5cf10d62e7b94af"
server_key_version: "encryptionkey@0"
I20260811 08:08:40.801563 29540 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435717191469-28623-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435717191469-28623-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435717191469-28623-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:08:40.833547 29540 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:08:40.835377 29540 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:08:40.835489 29540 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:08:40.839389 29540 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.254:38023
I20260811 08:08:40.839435 29651 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.254:38023 every 8 connection(s)
I20260811 08:08:40.839759 29540 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
I20260811 08:08:40.840601 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 29540
I20260811 08:08:40.840677 29655 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:08:40.840703 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435717191469-28623-0/minicluster-data/master-0/wal/instance
I20260811 08:08:40.840898 28623 external_mini_cluster.cc:1428] Setting key da06192124ed042324929316a5e450eb
I20260811 08:08:40.843875 29655 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c39bd882ac7843898c1647be56e555f4: Bootstrap starting.
I20260811 08:08:40.844599 29655 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c39bd882ac7843898c1647be56e555f4: Neither blocks nor log segments found. Creating new log.
I20260811 08:08:40.844923 29655 log.cc:824] T 00000000000000000000000000000000 P c39bd882ac7843898c1647be56e555f4: Log is configured to *not* fsync() on all Append() calls
I20260811 08:08:40.845721 29655 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c39bd882ac7843898c1647be56e555f4: No bootstrap required, opened a new log
Aug 11 08:08:40 dist-test-slave-7lbf krb5kdc[29520](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435720, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.243.254@KRBTEST.COM
I20260811 08:08:40.848459 29655 raft_consensus.cc:348] T 00000000000000000000000000000000 P c39bd882ac7843898c1647be56e555f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c39bd882ac7843898c1647be56e555f4" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 38023 } }
I20260811 08:08:40.848604 29655 raft_consensus.cc:374] T 00000000000000000000000000000000 P c39bd882ac7843898c1647be56e555f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:08:40.848641 29655 raft_consensus.cc:729] T 00000000000000000000000000000000 P c39bd882ac7843898c1647be56e555f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c39bd882ac7843898c1647be56e555f4, State: Initialized, Role: FOLLOWER
I20260811 08:08:40.848769 29655 consensus_queue.cc:260] T 00000000000000000000000000000000 P c39bd882ac7843898c1647be56e555f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c39bd882ac7843898c1647be56e555f4" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 38023 } }
I20260811 08:08:40.848847 29655 raft_consensus.cc:388] T 00000000000000000000000000000000 P c39bd882ac7843898c1647be56e555f4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:08:40.848881 29655 raft_consensus.cc:482] T 00000000000000000000000000000000 P c39bd882ac7843898c1647be56e555f4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:08:40.848932 29655 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c39bd882ac7843898c1647be56e555f4 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:08:40.849462 29655 raft_consensus.cc:504] T 00000000000000000000000000000000 P c39bd882ac7843898c1647be56e555f4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c39bd882ac7843898c1647be56e555f4" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 38023 } }
I20260811 08:08:40.849598 29655 leader_election.cc:302] T 00000000000000000000000000000000 P c39bd882ac7843898c1647be56e555f4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c39bd882ac7843898c1647be56e555f4; no voters:
I20260811 08:08:40.849768 29655 leader_election.cc:288] T 00000000000000000000000000000000 P c39bd882ac7843898c1647be56e555f4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:08:40.849812 29671 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c39bd882ac7843898c1647be56e555f4 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:08:40.849997 29671 raft_consensus.cc:686] T 00000000000000000000000000000000 P c39bd882ac7843898c1647be56e555f4 [term 1 LEADER]: Becoming Leader. State: Replica: c39bd882ac7843898c1647be56e555f4, State: Running, Role: LEADER
I20260811 08:08:40.850019 29655 sys_catalog.cc:564] T 00000000000000000000000000000000 P c39bd882ac7843898c1647be56e555f4 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:08:40.850198 29671 consensus_queue.cc:237] T 00000000000000000000000000000000 P c39bd882ac7843898c1647be56e555f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c39bd882ac7843898c1647be56e555f4" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 38023 } }
I20260811 08:08:40.851214 29673 sys_catalog.cc:455] T 00000000000000000000000000000000 P c39bd882ac7843898c1647be56e555f4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c39bd882ac7843898c1647be56e555f4. Latest consensus state: current_term: 1 leader_uuid: "c39bd882ac7843898c1647be56e555f4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c39bd882ac7843898c1647be56e555f4" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 38023 } } }
I20260811 08:08:40.851326 29673 sys_catalog.cc:458] T 00000000000000000000000000000000 P c39bd882ac7843898c1647be56e555f4 [sys.catalog]: This master's current role is: LEADER
I20260811 08:08:40.851533 29693 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:08:40.851557 29672 sys_catalog.cc:455] T 00000000000000000000000000000000 P c39bd882ac7843898c1647be56e555f4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c39bd882ac7843898c1647be56e555f4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c39bd882ac7843898c1647be56e555f4" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 38023 } } }
I20260811 08:08:40.851788 29672 sys_catalog.cc:458] T 00000000000000000000000000000000 P c39bd882ac7843898c1647be56e555f4 [sys.catalog]: This master's current role is: LEADER
I20260811 08:08:40.852016 29664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:40.841419 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50980 (local address 127.27.243.254:38023)
0811 08:08:40.841605 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:40.841612 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:40.841636 (+ 24us) server_negotiation.cc:407] Connection header received
0811 08:08:40.842199 (+ 563us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:40.842206 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:40.842255 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:40.842375 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:40.843145 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:40.844028 (+ 883us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:40.845013 (+ 985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:40.845415 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:40.845492 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:40.848161 (+ 2669us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:08:40.848165 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:08:40.848165 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:08:40.848176 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:08:40.849872 (+ 1696us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:40.850298 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:40.850300 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:40.850300 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:40.850410 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:40.850652 (+ 242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:40.850652 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:40.850653 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:40.850943 (+ 290us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:08:40.851558 (+ 615us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:40.851712 (+ 154us) server_negotiation.cc:299] Negotiation successful
0811 08:08:40.851845 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141,"thread_start_us":89,"threads_started":1}
I20260811 08:08:40.852224 29693 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:08:40.853689 29693 catalog_manager.cc:1347] Generated new cluster ID: 770302e524814f7797e09a97340895be
I20260811 08:08:40.853734 29693 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:08:40.861469 29693 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:08:40.861981 29693 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:08:40.868389 29693 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c39bd882ac7843898c1647be56e555f4: Generated new TSK 0
I20260811 08:08:40.868541 29693 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.27.243.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.243.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.243.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.193.keytab.
Entry for principal kudu/127.27.243.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.193.keytab.
I20260811 08:08:40.896263 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435717191469-28623-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435717191469-28623-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435717191469-28623-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435717191469-28623-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.243.193:0
--local_ip_for_outbound_sockets=127.27.243.193
--webserver_interface=127.27.243.193
--webserver_port=0
--tserver_master_addrs=127.27.243.254:38023
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.193.keytab
--principal=kudu/127.27.243.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:40029
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:08:40.976935 29701 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:08:40.977141 29701 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:08:40.977164 29701 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:08:40.978322 29701 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:08:40.978374 29701 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:08:40.978400 29701 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.243.193
I20260811 08:08:40.979903 29701 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:40029
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435717191469-28623-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435717191469-28623-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.193.keytab
--principal=kudu/127.27.243.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.243.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435717191469-28623-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.243.193
--webserver_port=0
--tserver_master_addrs=127.27.243.254:38023
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29701
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.243.193
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435717191469-28623-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:08:40.980136 29701 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:08:40.980376 29701 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:08:40.985122 29708 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:08:40.985342 29701 server_base.cc:1034] running on GCE node
W20260811 08:08:40.985116 29714 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:08:40.985134 29711 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:08:40.985695 29701 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:08:40.985926 29701 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:08:40.987087 29701 hybrid_clock.cc:648] HybridClock initialized: now 1786435720987071 us; error 28 us; skew 500 ppm
Aug 11 08:08:40 dist-test-slave-7lbf krb5kdc[29520](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435720, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:08:40.989471 29701 init.cc:377] Logged in from keytab as kudu/127.27.243.193@KRBTEST.COM (short username kudu)
I20260811 08:08:40.989890 29701 webserver.cc:460] Webserver started at http://127.27.243.193:42525/ using document root <none> and password file <none>
I20260811 08:08:40.990099 29701 fs_manager.cc:359] Metadata directory not provided
I20260811 08:08:40.990145 29701 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:08:40.990267 29701 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:08:40.991283 29701 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435717191469-28623-0/minicluster-data/ts-0/data/instance:
uuid: "9d5476f5d71b4ab691e9b2428174d279"
format_stamp: "Formatted at 2026-08-11 08:08:40 on dist-test-slave-7lbf"
server_key: "e4854f4d729ae3bed30fb5fae2ab29a2"
server_key_iv: "5cbc366122fdc92d211c2decadf54038"
server_key_version: "encryptionkey@0"
I20260811 08:08:40.991622 29701 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435717191469-28623-0/minicluster-data/ts-0/wal/instance:
uuid: "9d5476f5d71b4ab691e9b2428174d279"
format_stamp: "Formatted at 2026-08-11 08:08:40 on dist-test-slave-7lbf"
server_key: "e4854f4d729ae3bed30fb5fae2ab29a2"
server_key_iv: "5cbc366122fdc92d211c2decadf54038"
server_key_version: "encryptionkey@0"
I20260811 08:08:40.992800 29701 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 08:08:40.993430 29722 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:08:40.993592 29701 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 08:08:40.993675 29701 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435717191469-28623-0/minicluster-data/ts-0/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435717191469-28623-0/minicluster-data/ts-0/wal
uuid: "9d5476f5d71b4ab691e9b2428174d279"
format_stamp: "Formatted at 2026-08-11 08:08:40 on dist-test-slave-7lbf"
server_key: "e4854f4d729ae3bed30fb5fae2ab29a2"
server_key_iv: "5cbc366122fdc92d211c2decadf54038"
server_key_version: "encryptionkey@0"
I20260811 08:08:40.993737 29701 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435717191469-28623-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435717191469-28623-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435717191469-28623-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:08:41.004962 29701 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:08:41.006680 29701 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:08:41.006812 29701 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:08:41.007006 29701 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:08:41.007297 29701 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:08:41.007332 29701 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:08:41.007360 29701 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:08:41.007377 29701 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:08:41.012784 29701 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.193:43205
I20260811 08:08:41.012840 29919 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.193:43205 every 8 connection(s)
I20260811 08:08:41.013128 29701 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435717191469-28623-0/minicluster-data/ts-0/data/info.pb
Aug 11 08:08:41 dist-test-slave-7lbf krb5kdc[29520](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435720, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.193@KRBTEST.COM for kudu/127.27.243.254@KRBTEST.COM
I20260811 08:08:41.020879 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 29701
I20260811 08:08:41.020953 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435717191469-28623-0/minicluster-data/ts-0/wal/instance
I20260811 08:08:41.021095 28623 external_mini_cluster.cc:1428] Setting key ceaf656758b0c994f9259fd0c8810388
I20260811 08:08:41.022468 29664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:41.013834 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.193:34189 (local address 127.27.243.254:38023)
0811 08:08:41.013881 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:41.013883 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:41.014093 (+ 210us) server_negotiation.cc:407] Connection header received
0811 08:08:41.015033 (+ 940us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:41.015034 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:41.015047 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:41.015099 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:41.015737 (+ 638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:41.016235 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:41.017243 (+ 1008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:41.017461 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:41.017536 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:41.019621 (+ 2085us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:08:41.019623 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:08:41.019623 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:08:41.019630 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:08:41.020954 (+ 1324us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:41.021427 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:41.021429 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:41.021429 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:41.021497 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:41.021780 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:41.021781 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:41.021782 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:41.021914 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:08:41.021965 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:41.022309 (+ 344us) server_negotiation.cc:299] Negotiation successful
0811 08:08:41.022402 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 08:08:41.022694 29924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:41.013803 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:38023 (local address 127.27.243.193:34189)
0811 08:08:41.013977 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0811 08:08:41.014012 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0811 08:08:41.014926 (+ 914us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:08:41.015174 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:08:41.015178 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:08:41.015454 (+ 276us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:08:41.015644 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:41.015649 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:41.016321 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:41.016323 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:41.017158 (+ 835us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:41.017161 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:41.017566 (+ 405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:41.017568 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:41.017685 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:41.018172 (+ 487us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:08:41.018181 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:08:41.019531 (+ 1350us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:08:41.021059 (+ 1528us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:08:41.021067 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:08:41.021068 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:08:41.021345 (+ 277us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:08:41.021576 (+ 231us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:08:41.021577 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:08:41.021578 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:08:41.021708 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:08:41.021984 (+ 276us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:08:41.021993 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:08:41.022158 (+ 165us) client_negotiation.cc:769] Sending connection context
0811 08:08:41.022297 (+ 139us) client_negotiation.cc:240] Negotiation successful
0811 08:08:41.022470 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":93,"threads_started":1}
I20260811 08:08:41.023240 29920 heartbeater.cc:347] Connected to a master server at 127.27.243.254:38023
I20260811 08:08:41.023339 29920 heartbeater.cc:464] Registering TS with master...
I20260811 08:08:41.023559 29920 heartbeater.cc:511] Master 127.27.243.254:38023 requested a full tablet report, sending...
I20260811 08:08:41.024121 29593 ts_manager.cc:194] Registered new tserver with Master: 9d5476f5d71b4ab691e9b2428174d279 (127.27.243.193:43205)
I20260811 08:08:41.024744 29593 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.243.193@KRBTEST.COM'} at 127.27.243.193:34189
WARNING: no policy specified for kudu/127.27.243.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.243.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.243.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.194.keytab.
Entry for principal kudu/127.27.243.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.194.keytab.
I20260811 08:08:41.047603 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435717191469-28623-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435717191469-28623-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435717191469-28623-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435717191469-28623-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.243.194:0
--local_ip_for_outbound_sockets=127.27.243.194
--webserver_interface=127.27.243.194
--webserver_port=0
--tserver_master_addrs=127.27.243.254:38023
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.194.keytab
--principal=kudu/127.27.243.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:40029
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:08:41.127712 29929 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:08:41.127918 29929 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:08:41.127941 29929 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:08:41.129055 29929 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:08:41.129096 29929 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:08:41.129122 29929 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.243.194
I20260811 08:08:41.130627 29929 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:40029
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435717191469-28623-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435717191469-28623-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.194.keytab
--principal=kudu/127.27.243.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.243.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435717191469-28623-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.243.194
--webserver_port=0
--tserver_master_addrs=127.27.243.254:38023
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29929
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.243.194
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435717191469-28623-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:08:41.130865 29929 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:08:41.131075 29929 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:08:41.135811 29938 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:08:41.135835 29942 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:08:41.135962 29929 server_base.cc:1034] running on GCE node
W20260811 08:08:41.136062 29936 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:08:41.136289 29929 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:08:41.136513 29929 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:08:41.137650 29929 hybrid_clock.cc:648] HybridClock initialized: now 1786435721137638 us; error 36 us; skew 500 ppm
Aug 11 08:08:41 dist-test-slave-7lbf krb5kdc[29520](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435721, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:08:41.140061 29929 init.cc:377] Logged in from keytab as kudu/127.27.243.194@KRBTEST.COM (short username kudu)
I20260811 08:08:41.140496 29929 webserver.cc:460] Webserver started at http://127.27.243.194:35559/ using document root <none> and password file <none>
I20260811 08:08:41.140715 29929 fs_manager.cc:359] Metadata directory not provided
I20260811 08:08:41.140763 29929 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:08:41.140897 29929 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:08:41.141970 29929 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435717191469-28623-0/minicluster-data/ts-1/data/instance:
uuid: "446cc24b681c4f8b99b976fc0ce0746a"
format_stamp: "Formatted at 2026-08-11 08:08:41 on dist-test-slave-7lbf"
server_key: "a9d5cee6365e9d136d0316fdc4ae3dd6"
server_key_iv: "8712a560892b3e14ec98ae93e9e18fd1"
server_key_version: "encryptionkey@0"
I20260811 08:08:41.142313 29929 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435717191469-28623-0/minicluster-data/ts-1/wal/instance:
uuid: "446cc24b681c4f8b99b976fc0ce0746a"
format_stamp: "Formatted at 2026-08-11 08:08:41 on dist-test-slave-7lbf"
server_key: "a9d5cee6365e9d136d0316fdc4ae3dd6"
server_key_iv: "8712a560892b3e14ec98ae93e9e18fd1"
server_key_version: "encryptionkey@0"
I20260811 08:08:41.143651 29929 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 08:08:41.144340 29958 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:08:41.144500 29929 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 08:08:41.144583 29929 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435717191469-28623-0/minicluster-data/ts-1/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435717191469-28623-0/minicluster-data/ts-1/wal
uuid: "446cc24b681c4f8b99b976fc0ce0746a"
format_stamp: "Formatted at 2026-08-11 08:08:41 on dist-test-slave-7lbf"
server_key: "a9d5cee6365e9d136d0316fdc4ae3dd6"
server_key_iv: "8712a560892b3e14ec98ae93e9e18fd1"
server_key_version: "encryptionkey@0"
I20260811 08:08:41.144644 29929 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435717191469-28623-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435717191469-28623-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435717191469-28623-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:08:41.188690 29929 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:08:41.190902 29929 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:08:41.191047 29929 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:08:41.191282 29929 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:08:41.191625 29929 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:08:41.191663 29929 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:08:41.191694 29929 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:08:41.191710 29929 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:08:41.197418 29929 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.194:38765
I20260811 08:08:41.197494 30175 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.194:38765 every 8 connection(s)
I20260811 08:08:41.197827 29929 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435717191469-28623-0/minicluster-data/ts-1/data/info.pb
I20260811 08:08:41.202662 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 29929
I20260811 08:08:41.202736 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435717191469-28623-0/minicluster-data/ts-1/wal/instance
I20260811 08:08:41.202926 28623 external_mini_cluster.cc:1428] Setting key 83ffe4cc1c74b73947293cd7ee8417fc
Aug 11 08:08:41 dist-test-slave-7lbf krb5kdc[29520](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435721, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.194@KRBTEST.COM for kudu/127.27.243.254@KRBTEST.COM
I20260811 08:08:41.207182 29664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:41.198540 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.194:41111 (local address 127.27.243.254:38023)
0811 08:08:41.198583 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:41.198585 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:41.198795 (+ 210us) server_negotiation.cc:407] Connection header received
0811 08:08:41.199758 (+ 963us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:41.199760 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:41.199771 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:41.199825 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:41.200483 (+ 658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:41.200988 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:41.202058 (+ 1070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:41.202264 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:41.202319 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:41.204573 (+ 2254us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:08:41.204574 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:08:41.204575 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:08:41.204582 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:08:41.205921 (+ 1339us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:41.206284 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:41.206285 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:41.206286 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:41.206353 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:41.206573 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:41.206574 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:41.206574 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:41.206686 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:08:41.206742 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:41.207005 (+ 263us) server_negotiation.cc:299] Negotiation successful
0811 08:08:41.207095 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 08:08:41.207388 30178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:41.198505 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:38023 (local address 127.27.243.194:41111)
0811 08:08:41.198679 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0811 08:08:41.198717 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 08:08:41.199649 (+ 932us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:08:41.199911 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:08:41.199915 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:08:41.200176 (+ 261us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:08:41.200388 (+ 212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:41.200394 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:41.201078 (+ 684us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:41.201080 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:41.201977 (+ 897us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:41.201980 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:41.202332 (+ 352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:41.202334 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:41.202456 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:41.202933 (+ 477us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:08:41.202942 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:08:41.204472 (+ 1530us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:08:41.205999 (+ 1527us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:08:41.206006 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:08:41.206008 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:08:41.206219 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:08:41.206406 (+ 187us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:08:41.206407 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:08:41.206407 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:08:41.206517 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:08:41.206741 (+ 224us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:08:41.206748 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:08:41.206889 (+ 141us) client_negotiation.cc:769] Sending connection context
0811 08:08:41.206977 (+ 88us) client_negotiation.cc:240] Negotiation successful
0811 08:08:41.207126 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":93,"threads_started":1}
I20260811 08:08:41.207841 30176 heartbeater.cc:347] Connected to a master server at 127.27.243.254:38023
I20260811 08:08:41.207949 30176 heartbeater.cc:464] Registering TS with master...
I20260811 08:08:41.208146 30176 heartbeater.cc:511] Master 127.27.243.254:38023 requested a full tablet report, sending...
I20260811 08:08:41.208539 29593 ts_manager.cc:194] Registered new tserver with Master: 446cc24b681c4f8b99b976fc0ce0746a (127.27.243.194:38765)
I20260811 08:08:41.209043 29593 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.243.194@KRBTEST.COM'} at 127.27.243.194:41111
WARNING: no policy specified for kudu/127.27.243.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.243.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.243.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.195.keytab.
Entry for principal kudu/127.27.243.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.195.keytab.
I20260811 08:08:41.228302 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435717191469-28623-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435717191469-28623-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435717191469-28623-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435717191469-28623-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.243.195:0
--local_ip_for_outbound_sockets=127.27.243.195
--webserver_interface=127.27.243.195
--webserver_port=0
--tserver_master_addrs=127.27.243.254:38023
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.195.keytab
--principal=kudu/127.27.243.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:40029
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:08:41.312517 30186 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:08:41.312719 30186 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:08:41.312743 30186 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:08:41.313846 30186 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:08:41.313882 30186 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:08:41.313910 30186 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.243.195
I20260811 08:08:41.315346 30186 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:40029
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435717191469-28623-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435717191469-28623-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.195.keytab
--principal=kudu/127.27.243.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.243.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435717191469-28623-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.243.195
--webserver_port=0
--tserver_master_addrs=127.27.243.254:38023
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30186
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.243.195
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435717191469-28623-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:08:41.315527 30186 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:08:41.315706 30186 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:08:41.320546 30197 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:08:41.320536 30198 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:08:41.320632 30186 server_base.cc:1034] running on GCE node
W20260811 08:08:41.320536 30200 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:08:41.321007 30186 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:08:41.321206 30186 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:08:41.322355 30186 hybrid_clock.cc:648] HybridClock initialized: now 1786435721322336 us; error 31 us; skew 500 ppm
Aug 11 08:08:41 dist-test-slave-7lbf krb5kdc[29520](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435721, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:08:41.324852 30186 init.cc:377] Logged in from keytab as kudu/127.27.243.195@KRBTEST.COM (short username kudu)
I20260811 08:08:41.325261 30186 webserver.cc:460] Webserver started at http://127.27.243.195:37869/ using document root <none> and password file <none>
I20260811 08:08:41.325446 30186 fs_manager.cc:359] Metadata directory not provided
I20260811 08:08:41.325485 30186 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:08:41.325623 30186 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:08:41.326581 30186 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435717191469-28623-0/minicluster-data/ts-2/data/instance:
uuid: "ed5c965cb47b4ad191c0a322412b678b"
format_stamp: "Formatted at 2026-08-11 08:08:41 on dist-test-slave-7lbf"
server_key: "1f98627844307ca624b0ae77cf5b5292"
server_key_iv: "24e9071ff27c50714fd1e0b508b58b6e"
server_key_version: "encryptionkey@0"
I20260811 08:08:41.326874 30186 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435717191469-28623-0/minicluster-data/ts-2/wal/instance:
uuid: "ed5c965cb47b4ad191c0a322412b678b"
format_stamp: "Formatted at 2026-08-11 08:08:41 on dist-test-slave-7lbf"
server_key: "1f98627844307ca624b0ae77cf5b5292"
server_key_iv: "24e9071ff27c50714fd1e0b508b58b6e"
server_key_version: "encryptionkey@0"
I20260811 08:08:41.328106 30186 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 08:08:41.328742 30214 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:08:41.328924 30186 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 08:08:41.329005 30186 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435717191469-28623-0/minicluster-data/ts-2/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435717191469-28623-0/minicluster-data/ts-2/wal
uuid: "ed5c965cb47b4ad191c0a322412b678b"
format_stamp: "Formatted at 2026-08-11 08:08:41 on dist-test-slave-7lbf"
server_key: "1f98627844307ca624b0ae77cf5b5292"
server_key_iv: "24e9071ff27c50714fd1e0b508b58b6e"
server_key_version: "encryptionkey@0"
I20260811 08:08:41.329073 30186 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435717191469-28623-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435717191469-28623-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435717191469-28623-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:08:41.353854 30186 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:08:41.355612 30186 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:08:41.355748 30186 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:08:41.355960 30186 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:08:41.356252 30186 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:08:41.356285 30186 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:08:41.356323 30186 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:08:41.356348 30186 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:08:41.361876 30186 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.195:44049
I20260811 08:08:41.361931 30405 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.195:44049 every 8 connection(s)
I20260811 08:08:41.362221 30186 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435717191469-28623-0/minicluster-data/ts-2/data/info.pb
I20260811 08:08:41.363212 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 30186
I20260811 08:08:41.363303 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435717191469-28623-0/minicluster-data/ts-2/wal/instance
I20260811 08:08:41.363456 28623 external_mini_cluster.cc:1428] Setting key 35b248526e1a568c0e9a845de57178b8
Aug 11 08:08:41 dist-test-slave-7lbf krb5kdc[29520](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435721, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.195@KRBTEST.COM for kudu/127.27.243.254@KRBTEST.COM
I20260811 08:08:41.371513 29664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:41.362900 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.195:47033 (local address 127.27.243.254:38023)
0811 08:08:41.362962 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:41.362964 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:41.363181 (+ 217us) server_negotiation.cc:407] Connection header received
0811 08:08:41.364293 (+ 1112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:41.364295 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:41.364309 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:41.364367 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:41.365002 (+ 635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:41.365546 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:41.366555 (+ 1009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:41.366752 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:41.366815 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:41.369124 (+ 2309us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:08:41.369126 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:08:41.369126 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:08:41.369134 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:08:41.370258 (+ 1124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:41.370630 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:41.370632 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:41.370632 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:41.370684 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:41.370905 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:41.370906 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:41.370907 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:41.371015 (+ 108us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:08:41.371072 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:41.371327 (+ 255us) server_negotiation.cc:299] Negotiation successful
0811 08:08:41.371424 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 08:08:41.371658 30411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:41.362858 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:38023 (local address 127.27.243.195:47033)
0811 08:08:41.363031 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0811 08:08:41.363093 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0811 08:08:41.364184 (+ 1091us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:08:41.364445 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:08:41.364449 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:08:41.364710 (+ 261us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:08:41.364906 (+ 196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:41.364911 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:41.365633 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:41.365634 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:41.366463 (+ 829us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:41.366466 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:41.366833 (+ 367us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:41.366834 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:41.366967 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:41.367413 (+ 446us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:08:41.367422 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:08:41.369037 (+ 1615us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:08:41.370330 (+ 1293us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:08:41.370337 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:08:41.370339 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:08:41.370562 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:08:41.370737 (+ 175us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:08:41.370738 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:08:41.370738 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:08:41.370841 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:08:41.371070 (+ 229us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:08:41.371077 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:08:41.371210 (+ 133us) client_negotiation.cc:769] Sending connection context
0811 08:08:41.371298 (+ 88us) client_negotiation.cc:240] Negotiation successful
0811 08:08:41.371447 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":90,"threads_started":1}
I20260811 08:08:41.372090 30408 heartbeater.cc:347] Connected to a master server at 127.27.243.254:38023
I20260811 08:08:41.372164 30408 heartbeater.cc:464] Registering TS with master...
I20260811 08:08:41.372331 30408 heartbeater.cc:511] Master 127.27.243.254:38023 requested a full tablet report, sending...
I20260811 08:08:41.372682 29593 ts_manager.cc:194] Registered new tserver with Master: ed5c965cb47b4ad191c0a322412b678b (127.27.243.195:44049)
I20260811 08:08:41.373037 29593 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.243.195@KRBTEST.COM'} at 127.27.243.195:47033
I20260811 08:08:41.375053 28623 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 08:08:41.382308 29664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:41.376887 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50992 (local address 127.27.243.254:38023)
0811 08:08:41.376943 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:41.376944 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:41.376980 (+ 36us) server_negotiation.cc:407] Connection header received
0811 08:08:41.377020 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:41.377021 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:41.377029 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:41.377071 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:41.377543 (+ 472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:41.378006 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:41.378708 (+ 702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:41.378893 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:41.378940 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:41.380070 (+ 1130us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:08:41.380071 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:08:41.380072 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:08:41.380078 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:08:41.381216 (+ 1138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:41.381570 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:41.381571 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:41.381571 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:41.381619 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:41.381775 (+ 156us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:41.381775 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:41.381776 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:41.381914 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:08:41.381985 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:41.382188 (+ 203us) server_negotiation.cc:299] Negotiation successful
0811 08:08:41.382246 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260811 08:08:41.384882 29593 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50992:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 08:08:41.386776 29593 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 08:08:41.393951 30428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:41.389682 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.193:43205 (local address 127.0.0.1:40658)
0811 08:08:41.389914 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0811 08:08:41.389987 (+ 73us) client_negotiation.cc:174] Beginning negotiation
0811 08:08:41.390050 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:08:41.390342 (+ 292us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:08:41.390353 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:08:41.390356 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:08:41.390421 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:41.390423 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:41.391766 (+ 1343us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:41.391767 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:41.392708 (+ 941us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:41.392712 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:41.393655 (+ 943us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:41.393656 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:41.393734 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:41.393749 (+ 15us) client_negotiation.cc:769] Sending connection context
0811 08:08:41.393824 (+ 75us) client_negotiation.cc:240] Negotiation successful
0811 08:08:41.393876 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":199,"mutex_wait_us":76,"thread_start_us":70,"threads_started":1}
I20260811 08:08:41.393963 30435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:41.389990 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40658 (local address 127.27.243.193:43205)
0811 08:08:41.390170 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:41.390176 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:41.390185 (+ 9us) server_negotiation.cc:407] Connection header received
0811 08:08:41.390220 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:41.390222 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:41.390234 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:41.390311 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:08:41.390509 (+ 198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:41.391677 (+ 1168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:41.392826 (+ 1149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:41.393578 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:41.393652 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:41.393706 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:41.393846 (+ 140us) server_negotiation.cc:299] Negotiation successful
0811 08:08:41.393885 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":152,"thread_start_us":78,"threads_started":1}
I20260811 08:08:41.394196 30430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:41.389730 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.195:44049 (local address 127.0.0.1:48122)
0811 08:08:41.390145 (+ 415us) negotiation.cc:107] Waiting for socket to connect
0811 08:08:41.390154 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 08:08:41.390189 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:08:41.390443 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:08:41.390444 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:08:41.390446 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:08:41.390509 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:41.390511 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:41.391928 (+ 1417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:41.391929 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:41.393048 (+ 1119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:41.393051 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:41.393986 (+ 935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:41.393987 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:41.394060 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:41.394065 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 08:08:41.394093 (+ 28us) client_negotiation.cc:240] Negotiation successful
0811 08:08:41.394131 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":397,"mutex_wait_us":6,"thread_start_us":98,"threads_started":1}
I20260811 08:08:41.394539 30433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:41.389832 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48122 (local address 127.27.243.195:44049)
0811 08:08:41.390287 (+ 455us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:41.390290 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:41.390297 (+ 7us) server_negotiation.cc:407] Connection header received
0811 08:08:41.390327 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:41.390329 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:41.390341 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:41.390431 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:08:41.390600 (+ 169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:41.391673 (+ 1073us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:41.393134 (+ 1461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:41.393888 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:41.394371 (+ 483us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:41.394432 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:41.394453 (+ 21us) server_negotiation.cc:299] Negotiation successful
0811 08:08:41.394485 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":428,"thread_start_us":82,"threads_started":1}
I20260811 08:08:41.394830 29804 tablet_service.cc:1467] Processing CreateTablet for tablet 043a0e5a607b4775b901ae3af1a2a7a9 (DEFAULT_TABLE table=test-table [id=819c12a8ae074030af1e1db571f3282b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:08:41.395179 30427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:41.389748 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.194:38765 (local address 127.0.0.1:34222)
0811 08:08:41.390431 (+ 683us) negotiation.cc:107] Waiting for socket to connect
0811 08:08:41.390441 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 08:08:41.390490 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:08:41.390689 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:08:41.390690 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:08:41.390692 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:08:41.390741 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:41.390743 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:41.391711 (+ 968us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:41.391712 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:41.393058 (+ 1346us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:41.393061 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:41.394866 (+ 1805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:41.394868 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:41.394949 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:41.394954 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 08:08:41.395066 (+ 112us) client_negotiation.cc:240] Negotiation successful
0811 08:08:41.395108 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":670,"mutex_wait_us":71,"thread_start_us":75,"threads_started":1}
I20260811 08:08:41.395092 30294 tablet_service.cc:1467] Processing CreateTablet for tablet 043a0e5a607b4775b901ae3af1a2a7a9 (DEFAULT_TABLE table=test-table [id=819c12a8ae074030af1e1db571f3282b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:08:41.395226 29804 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 043a0e5a607b4775b901ae3af1a2a7a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:08:41.395525 30434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:41.389984 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34222 (local address 127.27.243.194:38765)
0811 08:08:41.390173 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:41.390177 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:41.390548 (+ 371us) server_negotiation.cc:407] Connection header received
0811 08:08:41.390595 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:41.390597 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:41.390612 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:41.390685 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:08:41.390803 (+ 118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:41.391615 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:41.393582 (+ 1967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:41.394530 (+ 948us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:41.394772 (+ 242us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:41.394834 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:41.395346 (+ 512us) server_negotiation.cc:299] Negotiation successful
0811 08:08:41.395446 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":147,"thread_start_us":82,"threads_started":1}
I20260811 08:08:41.395558 30294 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 043a0e5a607b4775b901ae3af1a2a7a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:08:41.398167 30038 tablet_service.cc:1467] Processing CreateTablet for tablet 043a0e5a607b4775b901ae3af1a2a7a9 (DEFAULT_TABLE table=test-table [id=819c12a8ae074030af1e1db571f3282b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:08:41.398355 30438 tablet_bootstrap.cc:492] T 043a0e5a607b4775b901ae3af1a2a7a9 P ed5c965cb47b4ad191c0a322412b678b: Bootstrap starting.
I20260811 08:08:41.398540 30038 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 043a0e5a607b4775b901ae3af1a2a7a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:08:41.398905 30438 tablet_bootstrap.cc:654] T 043a0e5a607b4775b901ae3af1a2a7a9 P ed5c965cb47b4ad191c0a322412b678b: Neither blocks nor log segments found. Creating new log.
I20260811 08:08:41.399534 30438 log.cc:824] T 043a0e5a607b4775b901ae3af1a2a7a9 P ed5c965cb47b4ad191c0a322412b678b: Log is configured to *not* fsync() on all Append() calls
I20260811 08:08:41.400239 30438 tablet_bootstrap.cc:492] T 043a0e5a607b4775b901ae3af1a2a7a9 P ed5c965cb47b4ad191c0a322412b678b: No bootstrap required, opened a new log
I20260811 08:08:41.400282 30438 ts_tablet_manager.cc:1397] T 043a0e5a607b4775b901ae3af1a2a7a9 P ed5c965cb47b4ad191c0a322412b678b: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 08:08:41.400913 30441 tablet_bootstrap.cc:492] T 043a0e5a607b4775b901ae3af1a2a7a9 P 446cc24b681c4f8b99b976fc0ce0746a: Bootstrap starting.
I20260811 08:08:41.401132 30437 tablet_bootstrap.cc:492] T 043a0e5a607b4775b901ae3af1a2a7a9 P 9d5476f5d71b4ab691e9b2428174d279: Bootstrap starting.
I20260811 08:08:41.401816 30437 tablet_bootstrap.cc:654] T 043a0e5a607b4775b901ae3af1a2a7a9 P 9d5476f5d71b4ab691e9b2428174d279: Neither blocks nor log segments found. Creating new log.
I20260811 08:08:41.401954 30441 tablet_bootstrap.cc:654] T 043a0e5a607b4775b901ae3af1a2a7a9 P 446cc24b681c4f8b99b976fc0ce0746a: Neither blocks nor log segments found. Creating new log.
I20260811 08:08:41.402007 30438 raft_consensus.cc:348] T 043a0e5a607b4775b901ae3af1a2a7a9 P ed5c965cb47b4ad191c0a322412b678b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d5476f5d71b4ab691e9b2428174d279" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 43205 } } peers { permanent_uuid: "ed5c965cb47b4ad191c0a322412b678b" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 44049 } } peers { permanent_uuid: "446cc24b681c4f8b99b976fc0ce0746a" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 38765 } }
I20260811 08:08:41.402168 30438 raft_consensus.cc:374] T 043a0e5a607b4775b901ae3af1a2a7a9 P ed5c965cb47b4ad191c0a322412b678b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:08:41.402205 30438 raft_consensus.cc:729] T 043a0e5a607b4775b901ae3af1a2a7a9 P ed5c965cb47b4ad191c0a322412b678b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed5c965cb47b4ad191c0a322412b678b, State: Initialized, Role: FOLLOWER
I20260811 08:08:41.402333 30438 consensus_queue.cc:260] T 043a0e5a607b4775b901ae3af1a2a7a9 P ed5c965cb47b4ad191c0a322412b678b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d5476f5d71b4ab691e9b2428174d279" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 43205 } } peers { permanent_uuid: "ed5c965cb47b4ad191c0a322412b678b" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 44049 } } peers { permanent_uuid: "446cc24b681c4f8b99b976fc0ce0746a" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 38765 } }
I20260811 08:08:41.402448 30437 log.cc:824] T 043a0e5a607b4775b901ae3af1a2a7a9 P 9d5476f5d71b4ab691e9b2428174d279: Log is configured to *not* fsync() on all Append() calls
I20260811 08:08:41.402554 30441 log.cc:824] T 043a0e5a607b4775b901ae3af1a2a7a9 P 446cc24b681c4f8b99b976fc0ce0746a: Log is configured to *not* fsync() on all Append() calls
I20260811 08:08:41.402601 30438 ts_tablet_manager.cc:1428] T 043a0e5a607b4775b901ae3af1a2a7a9 P ed5c965cb47b4ad191c0a322412b678b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 08:08:41.402776 30408 heartbeater.cc:503] Master 127.27.243.254:38023 was elected leader, sending a full tablet report...
I20260811 08:08:41.403209 30437 tablet_bootstrap.cc:492] T 043a0e5a607b4775b901ae3af1a2a7a9 P 9d5476f5d71b4ab691e9b2428174d279: No bootstrap required, opened a new log
I20260811 08:08:41.403232 30441 tablet_bootstrap.cc:492] T 043a0e5a607b4775b901ae3af1a2a7a9 P 446cc24b681c4f8b99b976fc0ce0746a: No bootstrap required, opened a new log
I20260811 08:08:41.403330 30441 ts_tablet_manager.cc:1397] T 043a0e5a607b4775b901ae3af1a2a7a9 P 446cc24b681c4f8b99b976fc0ce0746a: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 08:08:41.403329 30437 ts_tablet_manager.cc:1397] T 043a0e5a607b4775b901ae3af1a2a7a9 P 9d5476f5d71b4ab691e9b2428174d279: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 08:08:41.404971 30441 raft_consensus.cc:348] T 043a0e5a607b4775b901ae3af1a2a7a9 P 446cc24b681c4f8b99b976fc0ce0746a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d5476f5d71b4ab691e9b2428174d279" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 43205 } } peers { permanent_uuid: "ed5c965cb47b4ad191c0a322412b678b" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 44049 } } peers { permanent_uuid: "446cc24b681c4f8b99b976fc0ce0746a" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 38765 } }
I20260811 08:08:41.404995 30437 raft_consensus.cc:348] T 043a0e5a607b4775b901ae3af1a2a7a9 P 9d5476f5d71b4ab691e9b2428174d279 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d5476f5d71b4ab691e9b2428174d279" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 43205 } } peers { permanent_uuid: "ed5c965cb47b4ad191c0a322412b678b" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 44049 } } peers { permanent_uuid: "446cc24b681c4f8b99b976fc0ce0746a" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 38765 } }
I20260811 08:08:41.405113 30437 raft_consensus.cc:374] T 043a0e5a607b4775b901ae3af1a2a7a9 P 9d5476f5d71b4ab691e9b2428174d279 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:08:41.405103 30441 raft_consensus.cc:374] T 043a0e5a607b4775b901ae3af1a2a7a9 P 446cc24b681c4f8b99b976fc0ce0746a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:08:41.405133 30437 raft_consensus.cc:729] T 043a0e5a607b4775b901ae3af1a2a7a9 P 9d5476f5d71b4ab691e9b2428174d279 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d5476f5d71b4ab691e9b2428174d279, State: Initialized, Role: FOLLOWER
I20260811 08:08:41.405136 30441 raft_consensus.cc:729] T 043a0e5a607b4775b901ae3af1a2a7a9 P 446cc24b681c4f8b99b976fc0ce0746a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 446cc24b681c4f8b99b976fc0ce0746a, State: Initialized, Role: FOLLOWER
I20260811 08:08:41.405251 30437 consensus_queue.cc:260] T 043a0e5a607b4775b901ae3af1a2a7a9 P 9d5476f5d71b4ab691e9b2428174d279 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d5476f5d71b4ab691e9b2428174d279" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 43205 } } peers { permanent_uuid: "ed5c965cb47b4ad191c0a322412b678b" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 44049 } } peers { permanent_uuid: "446cc24b681c4f8b99b976fc0ce0746a" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 38765 } }
I20260811 08:08:41.405249 30441 consensus_queue.cc:260] T 043a0e5a607b4775b901ae3af1a2a7a9 P 446cc24b681c4f8b99b976fc0ce0746a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d5476f5d71b4ab691e9b2428174d279" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 43205 } } peers { permanent_uuid: "ed5c965cb47b4ad191c0a322412b678b" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 44049 } } peers { permanent_uuid: "446cc24b681c4f8b99b976fc0ce0746a" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 38765 } }
I20260811 08:08:41.405536 30437 ts_tablet_manager.cc:1428] T 043a0e5a607b4775b901ae3af1a2a7a9 P 9d5476f5d71b4ab691e9b2428174d279: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260811 08:08:41.405539 30441 ts_tablet_manager.cc:1428] T 043a0e5a607b4775b901ae3af1a2a7a9 P 446cc24b681c4f8b99b976fc0ce0746a: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260811 08:08:41.405539 30176 heartbeater.cc:503] Master 127.27.243.254:38023 was elected leader, sending a full tablet report...
I20260811 08:08:41.405732 29920 heartbeater.cc:503] Master 127.27.243.254:38023 was elected leader, sending a full tablet report...
I20260811 08:08:41.409438 30448 raft_consensus.cc:482] T 043a0e5a607b4775b901ae3af1a2a7a9 P 9d5476f5d71b4ab691e9b2428174d279 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:08:41.409503 30448 raft_consensus.cc:504] T 043a0e5a607b4775b901ae3af1a2a7a9 P 9d5476f5d71b4ab691e9b2428174d279 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d5476f5d71b4ab691e9b2428174d279" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 43205 } } peers { permanent_uuid: "ed5c965cb47b4ad191c0a322412b678b" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 44049 } } peers { permanent_uuid: "446cc24b681c4f8b99b976fc0ce0746a" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 38765 } }
I20260811 08:08:41.409986 30448 leader_election.cc:288] T 043a0e5a607b4775b901ae3af1a2a7a9 P 9d5476f5d71b4ab691e9b2428174d279 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed5c965cb47b4ad191c0a322412b678b (127.27.243.195:44049), 446cc24b681c4f8b99b976fc0ce0746a (127.27.243.194:38765)
I20260811 08:08:41.412706 30434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:41.410196 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.193:47123 (local address 127.27.243.194:38765)
0811 08:08:41.410232 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:41.410233 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:41.410245 (+ 12us) server_negotiation.cc:407] Connection header received
0811 08:08:41.410312 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:41.410313 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:41.410320 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:41.410381 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:08:41.410506 (+ 125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:41.411107 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:41.412026 (+ 919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:41.412407 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:41.412467 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:41.412474 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:41.412619 (+ 145us) server_negotiation.cc:299] Negotiation successful
0811 08:08:41.412651 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260811 08:08:41.412735 30433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:41.410200 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.193:50235 (local address 127.27.243.195:44049)
0811 08:08:41.410237 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:41.410239 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:41.410459 (+ 220us) server_negotiation.cc:407] Connection header received
0811 08:08:41.410486 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:41.410487 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:41.410496 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:41.410561 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:08:41.410691 (+ 130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:41.411223 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:41.412098 (+ 875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:41.412450 (+ 352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:41.412518 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:41.412526 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:41.412644 (+ 118us) server_negotiation.cc:299] Negotiation successful
0811 08:08:41.412679 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 08:08:41.412735 29924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:41.410148 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.194:38765 (local address 127.27.243.193:47123)
0811 08:08:41.410208 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0811 08:08:41.410218 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 08:08:41.410255 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:08:41.410383 (+ 128us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:08:41.410384 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:08:41.410385 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:08:41.410444 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:41.410445 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:41.411174 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:41.411175 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:41.411948 (+ 773us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:41.411951 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:41.412485 (+ 534us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:41.412486 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:41.412559 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:41.412562 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 08:08:41.412603 (+ 41us) client_negotiation.cc:240] Negotiation successful
0811 08:08:41.412639 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":44}
I20260811 08:08:41.412756 30450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:41.410148 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.195:44049 (local address 127.27.243.193:50235)
0811 08:08:41.410390 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0811 08:08:41.410401 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 08:08:41.410454 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:08:41.410562 (+ 108us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:08:41.410563 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:08:41.410564 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:08:41.410639 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:41.410641 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:41.411297 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:41.411298 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:41.412024 (+ 726us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:41.412026 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:41.412528 (+ 502us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:41.412529 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:41.412581 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:41.412584 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 08:08:41.412634 (+ 50us) client_negotiation.cc:240] Negotiation successful
0811 08:08:41.412666 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":223,"mutex_wait_us":98,"thread_start_us":83,"threads_started":1}
I20260811 08:08:41.413081 30075 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "043a0e5a607b4775b901ae3af1a2a7a9" candidate_uuid: "9d5476f5d71b4ab691e9b2428174d279" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "446cc24b681c4f8b99b976fc0ce0746a" is_pre_election: true
I20260811 08:08:41.413213 30075 raft_consensus.cc:2454] T 043a0e5a607b4775b901ae3af1a2a7a9 P 446cc24b681c4f8b99b976fc0ce0746a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d5476f5d71b4ab691e9b2428174d279 in term 0.
I20260811 08:08:41.413465 29726 leader_election.cc:302] T 043a0e5a607b4775b901ae3af1a2a7a9 P 9d5476f5d71b4ab691e9b2428174d279 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446cc24b681c4f8b99b976fc0ce0746a, 9d5476f5d71b4ab691e9b2428174d279; no voters:
I20260811 08:08:41.413585 30448 raft_consensus.cc:2781] T 043a0e5a607b4775b901ae3af1a2a7a9 P 9d5476f5d71b4ab691e9b2428174d279 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 08:08:41.413650 30448 raft_consensus.cc:482] T 043a0e5a607b4775b901ae3af1a2a7a9 P 9d5476f5d71b4ab691e9b2428174d279 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 08:08:41.413678 30448 raft_consensus.cc:3037] T 043a0e5a607b4775b901ae3af1a2a7a9 P 9d5476f5d71b4ab691e9b2428174d279 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:08:41.414284 30448 raft_consensus.cc:504] T 043a0e5a607b4775b901ae3af1a2a7a9 P 9d5476f5d71b4ab691e9b2428174d279 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d5476f5d71b4ab691e9b2428174d279" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 43205 } } peers { permanent_uuid: "ed5c965cb47b4ad191c0a322412b678b" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 44049 } } peers { permanent_uuid: "446cc24b681c4f8b99b976fc0ce0746a" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 38765 } }
I20260811 08:08:41.414398 30448 leader_election.cc:288] T 043a0e5a607b4775b901ae3af1a2a7a9 P 9d5476f5d71b4ab691e9b2428174d279 [CANDIDATE]: Term 1 election: Requested vote from peers ed5c965cb47b4ad191c0a322412b678b (127.27.243.195:44049), 446cc24b681c4f8b99b976fc0ce0746a (127.27.243.194:38765)
I20260811 08:08:41.414562 30075 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "043a0e5a607b4775b901ae3af1a2a7a9" candidate_uuid: "9d5476f5d71b4ab691e9b2428174d279" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "446cc24b681c4f8b99b976fc0ce0746a"
I20260811 08:08:41.414626 30075 raft_consensus.cc:3037] T 043a0e5a607b4775b901ae3af1a2a7a9 P 446cc24b681c4f8b99b976fc0ce0746a [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:08:41.414681 30326 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "043a0e5a607b4775b901ae3af1a2a7a9" candidate_uuid: "9d5476f5d71b4ab691e9b2428174d279" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed5c965cb47b4ad191c0a322412b678b"
I20260811 08:08:41.414789 30326 raft_consensus.cc:3037] T 043a0e5a607b4775b901ae3af1a2a7a9 P ed5c965cb47b4ad191c0a322412b678b [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:08:41.414920 30329 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "043a0e5a607b4775b901ae3af1a2a7a9" candidate_uuid: "9d5476f5d71b4ab691e9b2428174d279" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed5c965cb47b4ad191c0a322412b678b" is_pre_election: true
I20260811 08:08:41.415364 30075 raft_consensus.cc:2454] T 043a0e5a607b4775b901ae3af1a2a7a9 P 446cc24b681c4f8b99b976fc0ce0746a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d5476f5d71b4ab691e9b2428174d279 in term 1.
I20260811 08:08:41.415505 29726 leader_election.cc:302] T 043a0e5a607b4775b901ae3af1a2a7a9 P 9d5476f5d71b4ab691e9b2428174d279 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446cc24b681c4f8b99b976fc0ce0746a, 9d5476f5d71b4ab691e9b2428174d279; no voters:
I20260811 08:08:41.415552 30326 raft_consensus.cc:2454] T 043a0e5a607b4775b901ae3af1a2a7a9 P ed5c965cb47b4ad191c0a322412b678b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d5476f5d71b4ab691e9b2428174d279 in term 1.
I20260811 08:08:41.415642 30448 raft_consensus.cc:2781] T 043a0e5a607b4775b901ae3af1a2a7a9 P 9d5476f5d71b4ab691e9b2428174d279 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:08:41.415778 30448 raft_consensus.cc:686] T 043a0e5a607b4775b901ae3af1a2a7a9 P 9d5476f5d71b4ab691e9b2428174d279 [term 1 LEADER]: Becoming Leader. State: Replica: 9d5476f5d71b4ab691e9b2428174d279, State: Running, Role: LEADER
I20260811 08:08:41.415861 30448 consensus_queue.cc:237] T 043a0e5a607b4775b901ae3af1a2a7a9 P 9d5476f5d71b4ab691e9b2428174d279 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d5476f5d71b4ab691e9b2428174d279" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 43205 } } peers { permanent_uuid: "ed5c965cb47b4ad191c0a322412b678b" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 44049 } } peers { permanent_uuid: "446cc24b681c4f8b99b976fc0ce0746a" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 38765 } }
I20260811 08:08:41.416633 29593 catalog_manager.cc:5495] T 043a0e5a607b4775b901ae3af1a2a7a9 P 9d5476f5d71b4ab691e9b2428174d279 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9d5476f5d71b4ab691e9b2428174d279 (127.27.243.193). New cstate: current_term: 1 leader_uuid: "9d5476f5d71b4ab691e9b2428174d279" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d5476f5d71b4ab691e9b2428174d279" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 43205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed5c965cb47b4ad191c0a322412b678b" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 44049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "446cc24b681c4f8b99b976fc0ce0746a" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 38765 } health_report { overall_health: UNKNOWN } } }
Aug 11 08:08:41 dist-test-slave-7lbf krb5kdc[29520](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435720, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.243.193@KRBTEST.COM
I20260811 08:08:41.432616 30435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:41.425793 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40668 (local address 127.27.243.193:43205)
0811 08:08:41.425835 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:41.425837 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:41.425929 (+ 92us) server_negotiation.cc:407] Connection header received
0811 08:08:41.425988 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:41.425988 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:41.425997 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:41.426038 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:41.426601 (+ 563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:41.427071 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:41.427838 (+ 767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:41.428035 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:41.428087 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:41.430265 (+ 2178us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:08:41.430273 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:08:41.430273 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:08:41.430279 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:08:41.431746 (+ 1467us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:41.432031 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:41.432034 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:41.432034 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:41.432082 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:41.432208 (+ 126us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:41.432208 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:41.432208 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:41.432318 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:08:41.432436 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:41.432461 (+ 25us) server_negotiation.cc:299] Negotiation successful
0811 08:08:41.432534 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
Aug 11 08:08:41 dist-test-slave-7lbf krb5kdc[29520](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435721, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
W20260811 08:08:41.448446 30177 tablet.cc:2369] T 043a0e5a607b4775b901ae3af1a2a7a9 P 446cc24b681c4f8b99b976fc0ce0746a: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 11 08:08:41 dist-test-slave-7lbf krb5kdc[29520](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435721, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.27.243.193@KRBTEST.COM
I20260811 08:08:41.455283 30435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:41.448734 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40676 (local address 127.27.243.193:43205)
0811 08:08:41.448789 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:41.448791 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:41.448880 (+ 89us) server_negotiation.cc:407] Connection header received
0811 08:08:41.448945 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:41.448946 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:41.448955 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:41.449011 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:41.449542 (+ 531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:41.450078 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:41.450791 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:41.450998 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:41.451052 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:41.453120 (+ 2068us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:08:41.453122 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:08:41.453122 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:08:41.453129 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:08:41.454275 (+ 1146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:41.454567 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:41.454568 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:41.454569 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:41.454617 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:41.454777 (+ 160us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:41.454778 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:41.454779 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:41.454871 (+ 92us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:08:41.454972 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:41.455120 (+ 148us) server_negotiation.cc:299] Negotiation successful
0811 08:08:41.455195 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
Aug 11 08:08:41 dist-test-slave-7lbf krb5kdc[29520](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435721, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 08:08:41 dist-test-slave-7lbf krb5kdc[29520](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435721, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.243.193@KRBTEST.COM
I20260811 08:08:41.477079 30435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:41.470479 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40680 (local address 127.27.243.193:43205)
0811 08:08:41.470565 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:41.470567 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:41.470617 (+ 50us) server_negotiation.cc:407] Connection header received
0811 08:08:41.470680 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:41.470681 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:41.470690 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:41.470742 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:41.471277 (+ 535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:41.471740 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:41.472428 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:41.472622 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:41.472674 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:41.474724 (+ 2050us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:08:41.474726 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:08:41.474726 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:08:41.474733 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:08:41.475972 (+ 1239us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:41.476271 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:41.476272 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:41.476273 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:41.476341 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:41.476545 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:41.476546 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:41.476546 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:41.476663 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:08:41.476805 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:41.476943 (+ 138us) server_negotiation.cc:299] Negotiation successful
0811 08:08:41.477006 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
W20260811 08:08:41.477895 29773 tablet_service.cc:2908] Rejecting scan request for tablet 043a0e5a607b4775b901ae3af1a2a7a9: Uninitialized: clean time has not yet been initialized
I20260811 08:08:41.478809 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 29701
I20260811 08:08:41.491806 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 29929
I20260811 08:08:41.505869 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 30186
I20260811 08:08:41.514680 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 29540
2026-08-11T08:08:41Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (2105 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435717191469-28623-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:08:41 dist-test-slave-7lbf krb5kdc[30468](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:08:41 dist-test-slave-7lbf krb5kdc[30468](info): set up 2 sockets
Aug 11 08:08:41 dist-test-slave-7lbf krb5kdc[30468](info): commencing operation
krb5kdc: starting...
W20260811 08:08:42.683939 28623 mini_kdc.cc:121] Time spent starting KDC: real 1.140s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435717191469-28623-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435717191469-28623-0/krb5kdc/test-user.keytab.
Aug 11 08:08:42 dist-test-slave-7lbf krb5kdc[30468](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435722, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:08:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:08:42Z Disabled control of system clock
WARNING: no policy specified for kudu/127.27.243.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.243.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.243.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab.
Entry for principal kudu/127.27.243.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab.
I20260811 08:08:42.802428 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435717191469-28623-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435717191469-28623-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435717191469-28623-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.243.254:36047
--webserver_interface=127.27.243.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab
--principal=kudu/127.27.243.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:40335
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.243.254:36047
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:08:42.883263 30488 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:08:42.883461 30488 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:08:42.883482 30488 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:08:42.884605 30488 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:08:42.884645 30488 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260811 08:08:42.884658 30488 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:08:42.884672 30488 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:08:42.884696 30488 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:08:42.884719 30488 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:08:42.886210 30488 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:40335
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435717191469-28623-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435717191469-28623-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.243.254:36047
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab
--principal=kudu/127.27.243.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.243.254:36047
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.243.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30488
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435717191469-28623-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:08:42.886446 30488 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:08:42.886664 30488 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:08:42.891474 30495 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:08:42.891501 30502 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:08:42.891475 30496 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:08:42.891763 30488 server_base.cc:1034] running on GCE node
I20260811 08:08:42.891993 30488 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:08:42.892261 30488 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:08:42.893402 30488 hybrid_clock.cc:648] HybridClock initialized: now 1786435722893386 us; error 32 us; skew 500 ppm
Aug 11 08:08:42 dist-test-slave-7lbf krb5kdc[30468](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435722, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:08:42.895766 30488 init.cc:377] Logged in from keytab as kudu/127.27.243.254@KRBTEST.COM (short username kudu)
I20260811 08:08:42.896140 30488 webserver.cc:460] Webserver started at http://127.27.243.254:41151/ using document root <none> and password file <none>
I20260811 08:08:42.896332 30488 fs_manager.cc:359] Metadata directory not provided
I20260811 08:08:42.896380 30488 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:08:42.896473 30488 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:08:42.897574 30488 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435717191469-28623-0/minicluster-data/master-0/data/instance:
uuid: "a0d1897730f34a929944530c836f6fba"
format_stamp: "Formatted at 2026-08-11 08:08:42 on dist-test-slave-7lbf"
server_key: "7ea314f754ae06c63593bf296b65c710"
server_key_iv: "0e10c3d58ff8d07a85a44b9d7e382ad4"
server_key_version: "encryptionkey@0"
I20260811 08:08:42.897903 30488 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435717191469-28623-0/minicluster-data/master-0/wal/instance:
uuid: "a0d1897730f34a929944530c836f6fba"
format_stamp: "Formatted at 2026-08-11 08:08:42 on dist-test-slave-7lbf"
server_key: "7ea314f754ae06c63593bf296b65c710"
server_key_iv: "0e10c3d58ff8d07a85a44b9d7e382ad4"
server_key_version: "encryptionkey@0"
I20260811 08:08:42.899093 30488 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 08:08:42.899734 30513 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:08:42.899928 30488 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 08:08:42.900018 30488 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435717191469-28623-0/minicluster-data/master-0/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435717191469-28623-0/minicluster-data/master-0/wal
uuid: "a0d1897730f34a929944530c836f6fba"
format_stamp: "Formatted at 2026-08-11 08:08:42 on dist-test-slave-7lbf"
server_key: "7ea314f754ae06c63593bf296b65c710"
server_key_iv: "0e10c3d58ff8d07a85a44b9d7e382ad4"
server_key_version: "encryptionkey@0"
I20260811 08:08:42.900084 30488 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435717191469-28623-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435717191469-28623-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435717191469-28623-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:08:42.921178 30488 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:08:42.923231 30488 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:08:42.923358 30488 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:08:42.928020 30488 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.254:36047
I20260811 08:08:42.928114 30621 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.254:36047 every 8 connection(s)
I20260811 08:08:42.928385 30488 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
I20260811 08:08:42.929066 30622 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:08:42.931486 30622 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a0d1897730f34a929944530c836f6fba: Bootstrap starting.
I20260811 08:08:42.932089 30622 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a0d1897730f34a929944530c836f6fba: Neither blocks nor log segments found. Creating new log.
I20260811 08:08:42.932384 30622 log.cc:824] T 00000000000000000000000000000000 P a0d1897730f34a929944530c836f6fba: Log is configured to *not* fsync() on all Append() calls
I20260811 08:08:42.933122 30622 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a0d1897730f34a929944530c836f6fba: No bootstrap required, opened a new log
I20260811 08:08:42.935462 30622 raft_consensus.cc:348] T 00000000000000000000000000000000 P a0d1897730f34a929944530c836f6fba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0d1897730f34a929944530c836f6fba" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 36047 } }
I20260811 08:08:42.935607 30622 raft_consensus.cc:374] T 00000000000000000000000000000000 P a0d1897730f34a929944530c836f6fba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:08:42.935643 30622 raft_consensus.cc:729] T 00000000000000000000000000000000 P a0d1897730f34a929944530c836f6fba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0d1897730f34a929944530c836f6fba, State: Initialized, Role: FOLLOWER
I20260811 08:08:42.935775 30622 consensus_queue.cc:260] T 00000000000000000000000000000000 P a0d1897730f34a929944530c836f6fba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0d1897730f34a929944530c836f6fba" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 36047 } }
I20260811 08:08:42.935853 30622 raft_consensus.cc:388] T 00000000000000000000000000000000 P a0d1897730f34a929944530c836f6fba [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:08:42.935889 30622 raft_consensus.cc:482] T 00000000000000000000000000000000 P a0d1897730f34a929944530c836f6fba [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:08:42.935937 30622 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a0d1897730f34a929944530c836f6fba [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:08:42.936492 30622 raft_consensus.cc:504] T 00000000000000000000000000000000 P a0d1897730f34a929944530c836f6fba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0d1897730f34a929944530c836f6fba" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 36047 } }
I20260811 08:08:42.936594 30622 leader_election.cc:302] T 00000000000000000000000000000000 P a0d1897730f34a929944530c836f6fba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a0d1897730f34a929944530c836f6fba; no voters:
I20260811 08:08:42.936753 30622 leader_election.cc:288] T 00000000000000000000000000000000 P a0d1897730f34a929944530c836f6fba [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:08:42.936784 30628 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a0d1897730f34a929944530c836f6fba [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:08:42.936928 30628 raft_consensus.cc:686] T 00000000000000000000000000000000 P a0d1897730f34a929944530c836f6fba [term 1 LEADER]: Becoming Leader. State: Replica: a0d1897730f34a929944530c836f6fba, State: Running, Role: LEADER
I20260811 08:08:42.937057 30628 consensus_queue.cc:237] T 00000000000000000000000000000000 P a0d1897730f34a929944530c836f6fba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0d1897730f34a929944530c836f6fba" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 36047 } }
I20260811 08:08:42.937194 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 30488
I20260811 08:08:42.937290 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435717191469-28623-0/minicluster-data/master-0/wal/instance
I20260811 08:08:42.937419 30631 sys_catalog.cc:455] T 00000000000000000000000000000000 P a0d1897730f34a929944530c836f6fba [sys.catalog]: SysCatalogTable state changed. Reason: New leader a0d1897730f34a929944530c836f6fba. Latest consensus state: current_term: 1 leader_uuid: "a0d1897730f34a929944530c836f6fba" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0d1897730f34a929944530c836f6fba" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 36047 } } }
I20260811 08:08:42.937487 28623 external_mini_cluster.cc:1428] Setting key 54893edd7e842cec1fb99503414fed3a
I20260811 08:08:42.937562 30622 sys_catalog.cc:564] T 00000000000000000000000000000000 P a0d1897730f34a929944530c836f6fba [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:08:42.937614 30631 sys_catalog.cc:458] T 00000000000000000000000000000000 P a0d1897730f34a929944530c836f6fba [sys.catalog]: This master's current role is: LEADER
I20260811 08:08:42.937414 30630 sys_catalog.cc:455] T 00000000000000000000000000000000 P a0d1897730f34a929944530c836f6fba [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a0d1897730f34a929944530c836f6fba" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0d1897730f34a929944530c836f6fba" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 36047 } } }
I20260811 08:08:42.938088 30630 sys_catalog.cc:458] T 00000000000000000000000000000000 P a0d1897730f34a929944530c836f6fba [sys.catalog]: This master's current role is: LEADER
I20260811 08:08:42.938414 30635 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:08:42.939020 30635 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:08:42.940589 30635 catalog_manager.cc:1347] Generated new cluster ID: c9b584d2ad3c4244872a8ecfbb914f8c
I20260811 08:08:42.940649 30635 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 08:08:42 dist-test-slave-7lbf krb5kdc[30468](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435722, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.243.254@KRBTEST.COM
I20260811 08:08:42.948874 30640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:42.938196 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54366 (local address 127.27.243.254:36047)
0811 08:08:42.938376 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:42.938387 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:42.938420 (+ 33us) server_negotiation.cc:407] Connection header received
0811 08:08:42.938537 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:42.938544 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:42.938594 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:42.938711 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:42.939437 (+ 726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:42.940539 (+ 1102us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:42.941606 (+ 1067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:42.942240 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:42.942359 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:42.945063 (+ 2704us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:08:42.945067 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:08:42.945067 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:08:42.945079 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:08:42.947077 (+ 1998us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:42.947518 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:42.947522 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:42.947522 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:42.947651 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:42.947840 (+ 189us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:42.947841 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:42.947841 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:42.948147 (+ 306us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:08:42.948328 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:42.948397 (+ 69us) server_negotiation.cc:299] Negotiation successful
0811 08:08:42.948651 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":128,"thread_start_us":79,"threads_started":1}
I20260811 08:08:42.949316 30635 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:08:42.949874 30635 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:08:42.955933 30635 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a0d1897730f34a929944530c836f6fba: Generated new TSK 0
I20260811 08:08:42.956096 30635 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.27.243.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.243.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.243.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.193.keytab.
Entry for principal kudu/127.27.243.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.193.keytab.
I20260811 08:08:42.981720 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435717191469-28623-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435717191469-28623-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435717191469-28623-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435717191469-28623-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.243.193:0
--local_ip_for_outbound_sockets=127.27.243.193
--webserver_interface=127.27.243.193
--webserver_port=0
--tserver_master_addrs=127.27.243.254:36047
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.193.keytab
--principal=kudu/127.27.243.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:40335
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:08:43.062789 30666 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:08:43.063023 30666 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:08:43.063059 30666 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:08:43.064203 30666 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:08:43.064244 30666 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:08:43.064270 30666 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 08:08:43.064292 30666 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.243.193
I20260811 08:08:43.065733 30666 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:40335
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435717191469-28623-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435717191469-28623-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.193.keytab
--principal=kudu/127.27.243.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.243.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435717191469-28623-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.243.193
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.27.243.254:36047
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30666
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.243.193
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435717191469-28623-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:08:43.065965 30666 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:08:43.066181 30666 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:08:43.071009 30672 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:08:43.070978 30674 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:08:43.071002 30666 server_base.cc:1034] running on GCE node
W20260811 08:08:43.071105 30677 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:08:43.071399 30666 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:08:43.071628 30666 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:08:43.072754 30666 hybrid_clock.cc:648] HybridClock initialized: now 1786435723072746 us; error 26 us; skew 500 ppm
Aug 11 08:08:43 dist-test-slave-7lbf krb5kdc[30468](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435723, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:08:43.075241 30666 init.cc:377] Logged in from keytab as kudu/127.27.243.193@KRBTEST.COM (short username kudu)
I20260811 08:08:43.075650 30666 webserver.cc:460] Webserver started at http://127.27.243.193:41731/ using document root <none> and password file <none>
I20260811 08:08:43.075882 30666 fs_manager.cc:359] Metadata directory not provided
I20260811 08:08:43.075932 30666 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:08:43.076059 30666 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:08:43.077068 30666 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435717191469-28623-0/minicluster-data/ts-0/data/instance:
uuid: "6b1a549810a647dd9e4d80eed67ce8e0"
format_stamp: "Formatted at 2026-08-11 08:08:43 on dist-test-slave-7lbf"
server_key: "8edfd203fb1e7023883d1e0703dcaf04"
server_key_iv: "b8a8d67ab9618df5722ed26dfe9d203e"
server_key_version: "encryptionkey@0"
I20260811 08:08:43.077389 30666 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435717191469-28623-0/minicluster-data/ts-0/wal/instance:
uuid: "6b1a549810a647dd9e4d80eed67ce8e0"
format_stamp: "Formatted at 2026-08-11 08:08:43 on dist-test-slave-7lbf"
server_key: "8edfd203fb1e7023883d1e0703dcaf04"
server_key_iv: "b8a8d67ab9618df5722ed26dfe9d203e"
server_key_version: "encryptionkey@0"
I20260811 08:08:43.078632 30666 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 08:08:43.079312 30690 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:08:43.079447 30666 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 08:08:43.079530 30666 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435717191469-28623-0/minicluster-data/ts-0/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435717191469-28623-0/minicluster-data/ts-0/wal
uuid: "6b1a549810a647dd9e4d80eed67ce8e0"
format_stamp: "Formatted at 2026-08-11 08:08:43 on dist-test-slave-7lbf"
server_key: "8edfd203fb1e7023883d1e0703dcaf04"
server_key_iv: "b8a8d67ab9618df5722ed26dfe9d203e"
server_key_version: "encryptionkey@0"
I20260811 08:08:43.079591 30666 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435717191469-28623-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435717191469-28623-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435717191469-28623-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:08:43.112056 30666 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:08:43.114254 30666 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:08:43.114405 30666 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:08:43.114943 30666 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:08:43.114980 30666 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:08:43.115011 30666 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:08:43.115029 30666 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 08:08:43 dist-test-slave-7lbf krb5kdc[30468](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435723, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.193@KRBTEST.COM for kudu/127.27.243.254@KRBTEST.COM
I20260811 08:08:43.124315 30666 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.193:33111
I20260811 08:08:43.124383 30884 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.193:33111 every 8 connection(s)
I20260811 08:08:43.124732 30666 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435717191469-28623-0/minicluster-data/ts-0/data/info.pb
I20260811 08:08:43.124920 30640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:43.115593 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.193:35687 (local address 127.27.243.254:36047)
0811 08:08:43.115658 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:43.115661 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:43.115870 (+ 209us) server_negotiation.cc:407] Connection header received
0811 08:08:43.116580 (+ 710us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:43.116582 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:43.116598 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:43.116626 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:43.117640 (+ 1014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:43.118279 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:43.119489 (+ 1210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:43.119726 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:43.119789 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:43.122154 (+ 2365us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:08:43.122156 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:08:43.122156 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:08:43.122164 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:08:43.123511 (+ 1347us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:43.123877 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:43.123878 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:43.123878 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:43.123933 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:43.124166 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:43.124168 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:43.124168 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:43.124333 (+ 165us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:08:43.124404 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:43.124738 (+ 334us) server_negotiation.cc:299] Negotiation successful
0811 08:08:43.124825 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260811 08:08:43.125090 30708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:43.115557 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36047 (local address 127.27.243.193:35687)
0811 08:08:43.115728 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0811 08:08:43.115780 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0811 08:08:43.116441 (+ 661us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:08:43.116835 (+ 394us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:08:43.116839 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:08:43.117200 (+ 361us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:08:43.117503 (+ 303us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:43.117510 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:43.118378 (+ 868us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:43.118379 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:43.119403 (+ 1024us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:43.119406 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:43.119802 (+ 396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:43.119802 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:43.119916 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:43.120400 (+ 484us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:08:43.120411 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:08:43.122065 (+ 1654us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:08:43.123588 (+ 1523us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:08:43.123596 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:08:43.123598 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:08:43.123811 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:08:43.123989 (+ 178us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:08:43.123990 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:08:43.123990 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:08:43.124100 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:08:43.124434 (+ 334us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:08:43.124440 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:08:43.124592 (+ 152us) client_negotiation.cc:769] Sending connection context
0811 08:08:43.124703 (+ 111us) client_negotiation.cc:240] Negotiation successful
0811 08:08:43.124870 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":78,"threads_started":1}
I20260811 08:08:43.125676 30887 heartbeater.cc:347] Connected to a master server at 127.27.243.254:36047
I20260811 08:08:43.125759 30887 heartbeater.cc:464] Registering TS with master...
I20260811 08:08:43.125926 30887 heartbeater.cc:511] Master 127.27.243.254:36047 requested a full tablet report, sending...
I20260811 08:08:43.126457 30543 ts_manager.cc:194] Registered new tserver with Master: 6b1a549810a647dd9e4d80eed67ce8e0 (127.27.243.193:33111)
I20260811 08:08:43.126837 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 30666
I20260811 08:08:43.126929 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435717191469-28623-0/minicluster-data/ts-0/wal/instance
I20260811 08:08:43.127077 28623 external_mini_cluster.cc:1428] Setting key a4f5f829d1345a09a217342d29f6852e
I20260811 08:08:43.127228 30543 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.243.193@KRBTEST.COM'} at 127.27.243.193:35687
I20260811 08:08:43.132342 30897 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:43.126732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36047 (local address 127.27.243.193:53065)
0811 08:08:43.126858 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0811 08:08:43.126869 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 08:08:43.126918 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:08:43.127382 (+ 464us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:08:43.127383 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:08:43.127572 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:08:43.127647 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:43.127649 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:43.128279 (+ 630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:43.128280 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:43.128925 (+ 645us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:43.128928 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:43.129231 (+ 303us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:43.129232 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:43.129298 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:43.129685 (+ 387us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:08:43.129690 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:08:43.130006 (+ 316us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:08:43.131554 (+ 1548us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:08:43.131555 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:08:43.131556 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:08:43.131705 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:08:43.131886 (+ 181us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:08:43.131886 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:08:43.131887 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:08:43.131929 (+ 42us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:08:43.132129 (+ 200us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:08:43.132130 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:08:43.132163 (+ 33us) client_negotiation.cc:769] Sending connection context
0811 08:08:43.132206 (+ 43us) client_negotiation.cc:240] Negotiation successful
0811 08:08:43.132274 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":99,"thread_start_us":71,"threads_started":1}
I20260811 08:08:43.132426 30640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:43.127216 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.193:53065 (local address 127.27.243.254:36047)
0811 08:08:43.127272 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:43.127274 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:43.127282 (+ 8us) server_negotiation.cc:407] Connection header received
0811 08:08:43.127301 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:43.127302 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:43.127320 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:43.127371 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:43.127722 (+ 351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:43.128180 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:43.129010 (+ 830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:43.129179 (+ 169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:43.129219 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:43.130082 (+ 863us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:08:43.130083 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:08:43.130084 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:08:43.130090 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:08:43.131481 (+ 1391us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:43.131768 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:43.131770 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:43.131770 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:43.131830 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:43.131973 (+ 143us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:43.131974 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:43.131974 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:43.132082 (+ 108us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:08:43.132139 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:43.132237 (+ 98us) server_negotiation.cc:299] Negotiation successful
0811 08:08:43.132341 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
WARNING: no policy specified for kudu/127.27.243.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.243.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.243.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.194.keytab.
Entry for principal kudu/127.27.243.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.194.keytab.
I20260811 08:08:43.152237 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435717191469-28623-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435717191469-28623-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435717191469-28623-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435717191469-28623-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.243.194:0
--local_ip_for_outbound_sockets=127.27.243.194
--webserver_interface=127.27.243.194
--webserver_port=0
--tserver_master_addrs=127.27.243.254:36047
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.194.keytab
--principal=kudu/127.27.243.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:40335
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:08:43.231401 30901 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:08:43.231594 30901 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:08:43.231616 30901 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:08:43.232703 30901 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:08:43.232735 30901 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:08:43.232753 30901 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 08:08:43.232769 30901 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.243.194
I20260811 08:08:43.234141 30901 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:40335
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435717191469-28623-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435717191469-28623-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.194.keytab
--principal=kudu/127.27.243.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.243.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435717191469-28623-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.243.194
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.27.243.254:36047
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30901
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.243.194
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435717191469-28623-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:08:43.234313 30901 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:08:43.234488 30901 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:08:43.239266 30912 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:08:43.239471 30901 server_base.cc:1034] running on GCE node
W20260811 08:08:43.239271 30920 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:08:43.239272 30916 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:08:43.239790 30901 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:08:43.240031 30901 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:08:43.241210 30901 hybrid_clock.cc:648] HybridClock initialized: now 1786435723241195 us; error 28 us; skew 500 ppm
Aug 11 08:08:43 dist-test-slave-7lbf krb5kdc[30468](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435723, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:08:43.243709 30901 init.cc:377] Logged in from keytab as kudu/127.27.243.194@KRBTEST.COM (short username kudu)
I20260811 08:08:43.244187 30901 webserver.cc:460] Webserver started at http://127.27.243.194:34227/ using document root <none> and password file <none>
I20260811 08:08:43.244410 30901 fs_manager.cc:359] Metadata directory not provided
I20260811 08:08:43.244458 30901 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:08:43.244585 30901 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:08:43.245627 30901 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435717191469-28623-0/minicluster-data/ts-1/data/instance:
uuid: "c54a48b5e348467385be062155f9a860"
format_stamp: "Formatted at 2026-08-11 08:08:43 on dist-test-slave-7lbf"
server_key: "01122c0dd283406ea1e87e36f709b620"
server_key_iv: "b11a7c7ea45b92160d1c1764ac2a10ad"
server_key_version: "encryptionkey@0"
I20260811 08:08:43.245973 30901 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435717191469-28623-0/minicluster-data/ts-1/wal/instance:
uuid: "c54a48b5e348467385be062155f9a860"
format_stamp: "Formatted at 2026-08-11 08:08:43 on dist-test-slave-7lbf"
server_key: "01122c0dd283406ea1e87e36f709b620"
server_key_iv: "b11a7c7ea45b92160d1c1764ac2a10ad"
server_key_version: "encryptionkey@0"
I20260811 08:08:43.247267 30901 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:08:43.247996 30936 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:08:43.248154 30901 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 08:08:43.248243 30901 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435717191469-28623-0/minicluster-data/ts-1/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435717191469-28623-0/minicluster-data/ts-1/wal
uuid: "c54a48b5e348467385be062155f9a860"
format_stamp: "Formatted at 2026-08-11 08:08:43 on dist-test-slave-7lbf"
server_key: "01122c0dd283406ea1e87e36f709b620"
server_key_iv: "b11a7c7ea45b92160d1c1764ac2a10ad"
server_key_version: "encryptionkey@0"
I20260811 08:08:43.248314 30901 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435717191469-28623-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435717191469-28623-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435717191469-28623-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:08:43.288604 30901 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:08:43.290715 30901 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:08:43.290836 30901 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:08:43.291323 30901 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:08:43.291366 30901 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:08:43.291399 30901 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:08:43.291416 30901 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 08:08:43 dist-test-slave-7lbf krb5kdc[30468](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435723, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.194@KRBTEST.COM for kudu/127.27.243.254@KRBTEST.COM
I20260811 08:08:43.298280 30901 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.194:40843
I20260811 08:08:43.298375 31124 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.194:40843 every 8 connection(s)
I20260811 08:08:43.298683 30901 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435717191469-28623-0/minicluster-data/ts-1/data/info.pb
I20260811 08:08:43.300711 30640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:43.291881 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.194:43317 (local address 127.27.243.254:36047)
0811 08:08:43.291925 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:43.291927 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:43.292138 (+ 211us) server_negotiation.cc:407] Connection header received
0811 08:08:43.292682 (+ 544us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:43.292684 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:43.292698 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:43.292760 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:43.293594 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:43.294147 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:43.295136 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:43.295345 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:43.295402 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:43.298282 (+ 2880us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:08:43.298284 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:08:43.298284 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:08:43.298294 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:08:43.299669 (+ 1375us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:43.300032 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:43.300033 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:43.300033 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:43.300086 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:43.300246 (+ 160us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:43.300247 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:43.300247 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:43.300343 (+ 96us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:08:43.300389 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:43.300588 (+ 199us) server_negotiation.cc:299] Negotiation successful
0811 08:08:43.300647 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 08:08:43.300863 30952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:43.291857 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36047 (local address 127.27.243.194:43317)
0811 08:08:43.292020 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0811 08:08:43.292056 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 08:08:43.292555 (+ 499us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:08:43.292847 (+ 292us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:08:43.292851 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:08:43.293196 (+ 345us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:08:43.293485 (+ 289us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:43.293491 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:43.294241 (+ 750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:43.294242 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:43.295053 (+ 811us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:43.295055 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:43.295439 (+ 384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:43.295440 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:43.295563 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:43.296017 (+ 454us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:08:43.296027 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:08:43.298188 (+ 2161us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:08:43.299738 (+ 1550us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:08:43.299744 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:08:43.299746 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:08:43.299968 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:08:43.300126 (+ 158us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:08:43.300126 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:08:43.300126 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:08:43.300208 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:08:43.300387 (+ 179us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:08:43.300390 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:08:43.300496 (+ 106us) client_negotiation.cc:769] Sending connection context
0811 08:08:43.300571 (+ 75us) client_negotiation.cc:240] Negotiation successful
0811 08:08:43.300685 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":82,"threads_started":1}
I20260811 08:08:43.301308 31125 heartbeater.cc:347] Connected to a master server at 127.27.243.254:36047
I20260811 08:08:43.301405 31125 heartbeater.cc:464] Registering TS with master...
I20260811 08:08:43.301602 31125 heartbeater.cc:511] Master 127.27.243.254:36047 requested a full tablet report, sending...
I20260811 08:08:43.302011 30545 ts_manager.cc:194] Registered new tserver with Master: c54a48b5e348467385be062155f9a860 (127.27.243.194:40843)
I20260811 08:08:43.302441 30545 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.243.194@KRBTEST.COM'} at 127.27.243.194:43317
I20260811 08:08:43.307179 30640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:43.302401 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.194:36479 (local address 127.27.243.254:36047)
0811 08:08:43.302445 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:43.302447 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:43.302514 (+ 67us) server_negotiation.cc:407] Connection header received
0811 08:08:43.302610 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:43.302611 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:43.302621 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:43.302669 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:43.302987 (+ 318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:43.303527 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:43.304211 (+ 684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:43.304401 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:43.304450 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:43.305246 (+ 796us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:08:43.305247 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:08:43.305248 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:08:43.305254 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:08:43.306384 (+ 1130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:43.306656 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:43.306657 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:43.306657 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:43.306699 (+ 42us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:43.306819 (+ 120us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:43.306819 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:43.306819 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:43.306938 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:08:43.306981 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:43.307071 (+ 90us) server_negotiation.cc:299] Negotiation successful
0811 08:08:43.307123 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 08:08:43.307237 31134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:43.302335 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36047 (local address 127.27.243.194:36479)
0811 08:08:43.302457 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0811 08:08:43.302468 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 08:08:43.302528 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:08:43.302674 (+ 146us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:08:43.302675 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:08:43.302857 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:08:43.302913 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:43.302915 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:43.303605 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:43.303606 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:43.304147 (+ 541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:43.304148 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:43.304455 (+ 307us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:43.304455 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:43.304513 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:43.304901 (+ 388us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:08:43.304905 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:08:43.305153 (+ 248us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:08:43.306453 (+ 1300us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:08:43.306454 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:08:43.306454 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:08:43.306604 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:08:43.306739 (+ 135us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:08:43.306740 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:08:43.306740 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:08:43.306783 (+ 43us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:08:43.306977 (+ 194us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:08:43.306977 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:08:43.307010 (+ 33us) client_negotiation.cc:769] Sending connection context
0811 08:08:43.307053 (+ 43us) client_negotiation.cc:240] Negotiation successful
0811 08:08:43.307143 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":94,"thread_start_us":68,"threads_started":1}
I20260811 08:08:43.307250 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 30901
I20260811 08:08:43.307327 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435717191469-28623-0/minicluster-data/ts-1/wal/instance
I20260811 08:08:43.307476 28623 external_mini_cluster.cc:1428] Setting key 2b380627f8a96a448bc2541cdd239c0a
WARNING: no policy specified for kudu/127.27.243.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.243.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.243.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.195.keytab.
Entry for principal kudu/127.27.243.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.195.keytab.
I20260811 08:08:43.332635 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435717191469-28623-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435717191469-28623-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435717191469-28623-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435717191469-28623-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.243.195:0
--local_ip_for_outbound_sockets=127.27.243.195
--webserver_interface=127.27.243.195
--webserver_port=0
--tserver_master_addrs=127.27.243.254:36047
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.195.keytab
--principal=kudu/127.27.243.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:40335
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:08:43.414790 31137 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:08:43.415010 31137 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:08:43.415032 31137 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:08:43.416160 31137 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:08:43.416201 31137 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:08:43.416222 31137 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 08:08:43.416252 31137 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.243.195
I20260811 08:08:43.417758 31137 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:40335
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435717191469-28623-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435717191469-28623-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.195.keytab
--principal=kudu/127.27.243.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.243.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435717191469-28623-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.243.195
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.27.243.254:36047
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31137
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.243.195
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435717191469-28623-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:08:43.418000 31137 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:08:43.418215 31137 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:08:43.423040 31144 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:08:43.423151 31137 server_base.cc:1034] running on GCE node
W20260811 08:08:43.423040 31152 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:08:43.423224 31145 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:08:43.423516 31137 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:08:43.423756 31137 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:08:43.424908 31137 hybrid_clock.cc:648] HybridClock initialized: now 1786435723424896 us; error 33 us; skew 500 ppm
Aug 11 08:08:43 dist-test-slave-7lbf krb5kdc[30468](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435723, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:08:43.427395 31137 init.cc:377] Logged in from keytab as kudu/127.27.243.195@KRBTEST.COM (short username kudu)
I20260811 08:08:43.427802 31137 webserver.cc:460] Webserver started at http://127.27.243.195:39499/ using document root <none> and password file <none>
I20260811 08:08:43.428000 31137 fs_manager.cc:359] Metadata directory not provided
I20260811 08:08:43.428040 31137 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:08:43.428195 31137 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:08:43.429227 31137 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435717191469-28623-0/minicluster-data/ts-2/data/instance:
uuid: "4521d70728e642029114d612c6b34522"
format_stamp: "Formatted at 2026-08-11 08:08:43 on dist-test-slave-7lbf"
server_key: "d15dd44e015ff198cb453f7eed62279b"
server_key_iv: "8f128e9020ba5a06082d1f222b5fe699"
server_key_version: "encryptionkey@0"
I20260811 08:08:43.429560 31137 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435717191469-28623-0/minicluster-data/ts-2/wal/instance:
uuid: "4521d70728e642029114d612c6b34522"
format_stamp: "Formatted at 2026-08-11 08:08:43 on dist-test-slave-7lbf"
server_key: "d15dd44e015ff198cb453f7eed62279b"
server_key_iv: "8f128e9020ba5a06082d1f222b5fe699"
server_key_version: "encryptionkey@0"
I20260811 08:08:43.430734 31137 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 08:08:43.431371 31162 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:08:43.431550 31137 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 08:08:43.431634 31137 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435717191469-28623-0/minicluster-data/ts-2/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435717191469-28623-0/minicluster-data/ts-2/wal
uuid: "4521d70728e642029114d612c6b34522"
format_stamp: "Formatted at 2026-08-11 08:08:43 on dist-test-slave-7lbf"
server_key: "d15dd44e015ff198cb453f7eed62279b"
server_key_iv: "8f128e9020ba5a06082d1f222b5fe699"
server_key_version: "encryptionkey@0"
I20260811 08:08:43.431690 31137 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435717191469-28623-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435717191469-28623-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435717191469-28623-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:08:43.446909 31137 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:08:43.448982 31137 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:08:43.449092 31137 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:08:43.449596 31137 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:08:43.449640 31137 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:08:43.449662 31137 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:08:43.449673 31137 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 08:08:43 dist-test-slave-7lbf krb5kdc[30468](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435723, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.195@KRBTEST.COM for kudu/127.27.243.254@KRBTEST.COM
I20260811 08:08:43.456609 31137 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.195:37495
I20260811 08:08:43.456660 31353 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.195:37495 every 8 connection(s)
I20260811 08:08:43.456990 31137 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435717191469-28623-0/minicluster-data/ts-2/data/info.pb
I20260811 08:08:43.457816 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 31137
I20260811 08:08:43.457902 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435717191469-28623-0/minicluster-data/ts-2/wal/instance
I20260811 08:08:43.458068 28623 external_mini_cluster.cc:1428] Setting key fb77fe642b75dbb2e16f1554c7480db1
I20260811 08:08:43.459311 30640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:43.450017 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.195:60121 (local address 127.27.243.254:36047)
0811 08:08:43.450081 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:43.450084 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:43.450267 (+ 183us) server_negotiation.cc:407] Connection header received
0811 08:08:43.450778 (+ 511us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:43.450779 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:43.450793 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:43.450878 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:43.451696 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:43.452478 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:43.453917 (+ 1439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:43.454118 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:43.454177 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:43.456288 (+ 2111us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:08:43.456289 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:08:43.456290 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:08:43.456298 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:08:43.457794 (+ 1496us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:43.458291 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:43.458292 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:43.458292 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:43.458448 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:43.458724 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:43.458725 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:43.458726 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:43.458866 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:08:43.458930 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:43.459182 (+ 252us) server_negotiation.cc:299] Negotiation successful
0811 08:08:43.459249 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 08:08:43.459467 31177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:43.449985 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36047 (local address 127.27.243.195:60121)
0811 08:08:43.450142 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0811 08:08:43.450182 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 08:08:43.450683 (+ 501us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:08:43.450964 (+ 281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:08:43.450968 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:08:43.451305 (+ 337us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:08:43.451587 (+ 282us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:43.451595 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:43.452593 (+ 998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:43.452595 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:43.453830 (+ 1235us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:43.453834 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:43.454204 (+ 370us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:43.454205 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:43.454321 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:43.454770 (+ 449us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:08:43.454779 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:08:43.456194 (+ 1415us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:08:43.457879 (+ 1685us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:08:43.457887 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:08:43.457889 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:08:43.458163 (+ 274us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:08:43.458517 (+ 354us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:08:43.458518 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:08:43.458518 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:08:43.458658 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:08:43.458925 (+ 267us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:08:43.458930 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:08:43.459070 (+ 140us) client_negotiation.cc:769] Sending connection context
0811 08:08:43.459155 (+ 85us) client_negotiation.cc:240] Negotiation successful
0811 08:08:43.459274 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":88,"threads_started":1}
I20260811 08:08:43.459920 31356 heartbeater.cc:347] Connected to a master server at 127.27.243.254:36047
I20260811 08:08:43.460005 31356 heartbeater.cc:464] Registering TS with master...
I20260811 08:08:43.460184 31356 heartbeater.cc:511] Master 127.27.243.254:36047 requested a full tablet report, sending...
I20260811 08:08:43.460605 30543 ts_manager.cc:194] Registered new tserver with Master: 4521d70728e642029114d612c6b34522 (127.27.243.195:37495)
I20260811 08:08:43.461056 30543 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.243.195@KRBTEST.COM'} at 127.27.243.195:60121
I20260811 08:08:43.465564 30640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:43.460950 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.195:50541 (local address 127.27.243.254:36047)
0811 08:08:43.460991 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:43.460992 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:43.461068 (+ 76us) server_negotiation.cc:407] Connection header received
0811 08:08:43.461124 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:43.461125 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:43.461134 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:43.461184 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:43.461552 (+ 368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:43.462015 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:43.462675 (+ 660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:43.462875 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:43.462928 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:43.463650 (+ 722us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:08:43.463651 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:08:43.463651 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:08:43.463657 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:08:43.464590 (+ 933us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:43.464884 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:43.464885 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:43.464885 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:43.464940 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:43.465094 (+ 154us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:43.465095 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:43.465095 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:43.465194 (+ 99us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:08:43.465247 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:43.465382 (+ 135us) server_negotiation.cc:299] Negotiation successful
0811 08:08:43.465453 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 08:08:43.465579 31369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:43.460890 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36047 (local address 127.27.243.195:50541)
0811 08:08:43.461007 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0811 08:08:43.461017 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 08:08:43.461073 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:08:43.461196 (+ 123us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:08:43.461197 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:08:43.461394 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:08:43.461463 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:43.461465 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:43.462103 (+ 638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:43.462104 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:43.462606 (+ 502us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:43.462607 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:43.462934 (+ 327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:43.462935 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:43.463007 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:43.463307 (+ 300us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:08:43.463310 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:08:43.463574 (+ 264us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:08:43.464665 (+ 1091us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:08:43.464666 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:08:43.464667 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:08:43.464819 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:08:43.464992 (+ 173us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:08:43.464993 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:08:43.464993 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:08:43.465045 (+ 52us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:08:43.465247 (+ 202us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:08:43.465248 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:08:43.465292 (+ 44us) client_negotiation.cc:769] Sending connection context
0811 08:08:43.465360 (+ 68us) client_negotiation.cc:240] Negotiation successful
0811 08:08:43.465455 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":93,"thread_start_us":65,"threads_started":1}
I20260811 08:08:43.469709 28623 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 08:08:43 dist-test-slave-7lbf krb5kdc[30468](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435723, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 08:08:43 dist-test-slave-7lbf krb5kdc[30468](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435723, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.27.243.254@KRBTEST.COM
I20260811 08:08:43.492573 30640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:43.486207 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54374 (local address 127.27.243.254:36047)
0811 08:08:43.486260 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:43.486262 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:43.486270 (+ 8us) server_negotiation.cc:407] Connection header received
0811 08:08:43.486364 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:43.486365 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:43.486374 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:43.486420 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:43.486934 (+ 514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:43.487415 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:43.488130 (+ 715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:43.488363 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:43.488421 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:43.490385 (+ 1964us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:08:43.490386 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:08:43.490387 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:08:43.490394 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:08:43.491567 (+ 1173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:43.491888 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:43.491889 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:43.491890 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:43.491941 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:43.492099 (+ 158us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:43.492100 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:43.492100 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:43.492200 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:08:43.492284 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:43.492414 (+ 130us) server_negotiation.cc:299] Negotiation successful
0811 08:08:43.492486 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260811 08:08:43.493937 30543 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54374:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 08:08:43.495431 30543 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 08:08:43.501847 31390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:43.497908 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.194:40843 (local address 127.0.0.1:38966)
0811 08:08:43.498115 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0811 08:08:43.498123 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 08:08:43.498160 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:08:43.498480 (+ 320us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:08:43.498481 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:08:43.498485 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:08:43.498568 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:43.498570 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:43.499472 (+ 902us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:43.499474 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:43.500577 (+ 1103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:43.500580 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:43.501502 (+ 922us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:43.501503 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:43.501639 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:43.501655 (+ 16us) client_negotiation.cc:769] Sending connection context
0811 08:08:43.501720 (+ 65us) client_negotiation.cc:240] Negotiation successful
0811 08:08:43.501775 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":197,"mutex_wait_us":5,"thread_start_us":66,"threads_started":1}
I20260811 08:08:43.501979 31400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:43.498134 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38966 (local address 127.27.243.194:40843)
0811 08:08:43.498311 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:43.498314 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:43.498324 (+ 10us) server_negotiation.cc:407] Connection header received
0811 08:08:43.498366 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:43.498368 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:43.498382 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:43.498647 (+ 265us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:08:43.498710 (+ 63us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:43.499393 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:43.500665 (+ 1272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:43.501417 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:43.501501 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:43.501581 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:43.501825 (+ 244us) server_negotiation.cc:299] Negotiation successful
0811 08:08:43.501880 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":144,"thread_start_us":89,"threads_started":1}
I20260811 08:08:43.502014 31398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:43.497689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.193:33111 (local address 127.0.0.1:52774)
0811 08:08:43.498012 (+ 323us) negotiation.cc:107] Waiting for socket to connect
0811 08:08:43.498023 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 08:08:43.498074 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:08:43.498480 (+ 406us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:08:43.498481 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:08:43.498483 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:08:43.498640 (+ 157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:43.498643 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:43.499911 (+ 1268us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:43.499912 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:43.500904 (+ 992us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:43.500906 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:43.501727 (+ 821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:43.501728 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:43.501826 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:43.501832 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 08:08:43.501897 (+ 65us) client_negotiation.cc:240] Negotiation successful
0811 08:08:43.501940 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":303,"mutex_wait_us":133,"thread_start_us":96,"threads_started":1}
I20260811 08:08:43.502241 31399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:43.497959 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52774 (local address 127.27.243.193:33111)
0811 08:08:43.498280 (+ 321us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:43.498285 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:43.498295 (+ 10us) server_negotiation.cc:407] Connection header received
0811 08:08:43.498358 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:43.498360 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:43.498375 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:43.498551 (+ 176us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:08:43.498712 (+ 161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:43.499822 (+ 1110us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:43.500976 (+ 1154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:43.501638 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:43.501714 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:43.501769 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:43.502088 (+ 319us) server_negotiation.cc:299] Negotiation successful
0811 08:08:43.502134 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":280,"thread_start_us":101,"threads_started":1}
I20260811 08:08:43.502874 31014 tablet_service.cc:1467] Processing CreateTablet for tablet 46c2345c27bb4d80a612b68abf53c5ae (DEFAULT_TABLE table=test-table [id=d1e0246541524d8dbde5b2784178b060]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:08:43.502914 30775 tablet_service.cc:1467] Processing CreateTablet for tablet 46c2345c27bb4d80a612b68abf53c5ae (DEFAULT_TABLE table=test-table [id=d1e0246541524d8dbde5b2784178b060]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:08:43.503237 31014 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 46c2345c27bb4d80a612b68abf53c5ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:08:43.503258 30775 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 46c2345c27bb4d80a612b68abf53c5ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:08:43.505687 31391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:43.497679 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.195:37495 (local address 127.0.0.1:44862)
0811 08:08:43.497848 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0811 08:08:43.497893 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 08:08:43.497960 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:08:43.498476 (+ 516us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:08:43.498479 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:08:43.498481 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:08:43.498557 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:43.498559 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:43.499905 (+ 1346us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:43.499906 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:43.500943 (+ 1037us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:43.500947 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:43.502047 (+ 1100us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:43.502048 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:43.502104 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:43.502107 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 08:08:43.502263 (+ 156us) client_negotiation.cc:240] Negotiation successful
0811 08:08:43.505613 (+ 3350us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"mutex_wait_us":39,"thread_start_us":46,"threads_started":1}
I20260811 08:08:43.505911 31401 tablet_bootstrap.cc:492] T 46c2345c27bb4d80a612b68abf53c5ae P c54a48b5e348467385be062155f9a860: Bootstrap starting.
I20260811 08:08:43.506309 31402 tablet_bootstrap.cc:492] T 46c2345c27bb4d80a612b68abf53c5ae P 6b1a549810a647dd9e4d80eed67ce8e0: Bootstrap starting.
I20260811 08:08:43.506418 31396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:43.497786 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44862 (local address 127.27.243.195:37495)
0811 08:08:43.498211 (+ 425us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:43.498216 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:43.498228 (+ 12us) server_negotiation.cc:407] Connection header received
0811 08:08:43.498271 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:43.498273 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:43.498299 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:43.498388 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:08:43.498649 (+ 261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:43.499780 (+ 1131us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:43.501049 (+ 1269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:43.501833 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:43.501961 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:43.502018 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:43.506205 (+ 4187us) server_negotiation.cc:299] Negotiation successful
0811 08:08:43.506248 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":384,"thread_start_us":87,"threads_started":1}
I20260811 08:08:43.506573 31401 tablet_bootstrap.cc:654] T 46c2345c27bb4d80a612b68abf53c5ae P c54a48b5e348467385be062155f9a860: Neither blocks nor log segments found. Creating new log.
I20260811 08:08:43.506911 31401 log.cc:824] T 46c2345c27bb4d80a612b68abf53c5ae P c54a48b5e348467385be062155f9a860: Log is configured to *not* fsync() on all Append() calls
I20260811 08:08:43.506968 31402 tablet_bootstrap.cc:654] T 46c2345c27bb4d80a612b68abf53c5ae P 6b1a549810a647dd9e4d80eed67ce8e0: Neither blocks nor log segments found. Creating new log.
I20260811 08:08:43.506930 31235 tablet_service.cc:1467] Processing CreateTablet for tablet 46c2345c27bb4d80a612b68abf53c5ae (DEFAULT_TABLE table=test-table [id=d1e0246541524d8dbde5b2784178b060]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:08:43.507265 31235 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 46c2345c27bb4d80a612b68abf53c5ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:08:43.507273 31402 log.cc:824] T 46c2345c27bb4d80a612b68abf53c5ae P 6b1a549810a647dd9e4d80eed67ce8e0: Log is configured to *not* fsync() on all Append() calls
I20260811 08:08:43.507691 31401 tablet_bootstrap.cc:492] T 46c2345c27bb4d80a612b68abf53c5ae P c54a48b5e348467385be062155f9a860: No bootstrap required, opened a new log
I20260811 08:08:43.507764 31401 ts_tablet_manager.cc:1397] T 46c2345c27bb4d80a612b68abf53c5ae P c54a48b5e348467385be062155f9a860: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 08:08:43.508020 31402 tablet_bootstrap.cc:492] T 46c2345c27bb4d80a612b68abf53c5ae P 6b1a549810a647dd9e4d80eed67ce8e0: No bootstrap required, opened a new log
I20260811 08:08:43.508087 31402 ts_tablet_manager.cc:1397] T 46c2345c27bb4d80a612b68abf53c5ae P 6b1a549810a647dd9e4d80eed67ce8e0: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 08:08:43.509797 31401 raft_consensus.cc:348] T 46c2345c27bb4d80a612b68abf53c5ae P c54a48b5e348467385be062155f9a860 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1a549810a647dd9e4d80eed67ce8e0" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 33111 } } peers { permanent_uuid: "4521d70728e642029114d612c6b34522" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 37495 } } peers { permanent_uuid: "c54a48b5e348467385be062155f9a860" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 40843 } }
I20260811 08:08:43.509976 31408 tablet_bootstrap.cc:492] T 46c2345c27bb4d80a612b68abf53c5ae P 4521d70728e642029114d612c6b34522: Bootstrap starting.
I20260811 08:08:43.510048 31401 raft_consensus.cc:374] T 46c2345c27bb4d80a612b68abf53c5ae P c54a48b5e348467385be062155f9a860 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:08:43.510003 31402 raft_consensus.cc:348] T 46c2345c27bb4d80a612b68abf53c5ae P 6b1a549810a647dd9e4d80eed67ce8e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1a549810a647dd9e4d80eed67ce8e0" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 33111 } } peers { permanent_uuid: "4521d70728e642029114d612c6b34522" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 37495 } } peers { permanent_uuid: "c54a48b5e348467385be062155f9a860" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 40843 } }
I20260811 08:08:43.510152 31402 raft_consensus.cc:374] T 46c2345c27bb4d80a612b68abf53c5ae P 6b1a549810a647dd9e4d80eed67ce8e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:08:43.510156 31401 raft_consensus.cc:729] T 46c2345c27bb4d80a612b68abf53c5ae P c54a48b5e348467385be062155f9a860 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c54a48b5e348467385be062155f9a860, State: Initialized, Role: FOLLOWER
I20260811 08:08:43.510216 31402 raft_consensus.cc:729] T 46c2345c27bb4d80a612b68abf53c5ae P 6b1a549810a647dd9e4d80eed67ce8e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b1a549810a647dd9e4d80eed67ce8e0, State: Initialized, Role: FOLLOWER
I20260811 08:08:43.510299 31401 consensus_queue.cc:260] T 46c2345c27bb4d80a612b68abf53c5ae P c54a48b5e348467385be062155f9a860 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1a549810a647dd9e4d80eed67ce8e0" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 33111 } } peers { permanent_uuid: "4521d70728e642029114d612c6b34522" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 37495 } } peers { permanent_uuid: "c54a48b5e348467385be062155f9a860" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 40843 } }
I20260811 08:08:43.510387 31402 consensus_queue.cc:260] T 46c2345c27bb4d80a612b68abf53c5ae P 6b1a549810a647dd9e4d80eed67ce8e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1a549810a647dd9e4d80eed67ce8e0" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 33111 } } peers { permanent_uuid: "4521d70728e642029114d612c6b34522" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 37495 } } peers { permanent_uuid: "c54a48b5e348467385be062155f9a860" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 40843 } }
I20260811 08:08:43.510600 31401 ts_tablet_manager.cc:1428] T 46c2345c27bb4d80a612b68abf53c5ae P c54a48b5e348467385be062155f9a860: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 08:08:43.510648 31402 ts_tablet_manager.cc:1428] T 46c2345c27bb4d80a612b68abf53c5ae P 6b1a549810a647dd9e4d80eed67ce8e0: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 08:08:43.510795 31125 heartbeater.cc:503] Master 127.27.243.254:36047 was elected leader, sending a full tablet report...
I20260811 08:08:43.510773 30887 heartbeater.cc:503] Master 127.27.243.254:36047 was elected leader, sending a full tablet report...
I20260811 08:08:43.510983 31408 tablet_bootstrap.cc:654] T 46c2345c27bb4d80a612b68abf53c5ae P 4521d70728e642029114d612c6b34522: Neither blocks nor log segments found. Creating new log.
I20260811 08:08:43.511351 31408 log.cc:824] T 46c2345c27bb4d80a612b68abf53c5ae P 4521d70728e642029114d612c6b34522: Log is configured to *not* fsync() on all Append() calls
I20260811 08:08:43.511992 31408 tablet_bootstrap.cc:492] T 46c2345c27bb4d80a612b68abf53c5ae P 4521d70728e642029114d612c6b34522: No bootstrap required, opened a new log
I20260811 08:08:43.512055 31408 ts_tablet_manager.cc:1397] T 46c2345c27bb4d80a612b68abf53c5ae P 4521d70728e642029114d612c6b34522: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 08:08:43.513449 31408 raft_consensus.cc:348] T 46c2345c27bb4d80a612b68abf53c5ae P 4521d70728e642029114d612c6b34522 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1a549810a647dd9e4d80eed67ce8e0" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 33111 } } peers { permanent_uuid: "4521d70728e642029114d612c6b34522" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 37495 } } peers { permanent_uuid: "c54a48b5e348467385be062155f9a860" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 40843 } }
I20260811 08:08:43.513650 31408 raft_consensus.cc:374] T 46c2345c27bb4d80a612b68abf53c5ae P 4521d70728e642029114d612c6b34522 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:08:43.513702 31408 raft_consensus.cc:729] T 46c2345c27bb4d80a612b68abf53c5ae P 4521d70728e642029114d612c6b34522 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4521d70728e642029114d612c6b34522, State: Initialized, Role: FOLLOWER
I20260811 08:08:43.513815 31408 consensus_queue.cc:260] T 46c2345c27bb4d80a612b68abf53c5ae P 4521d70728e642029114d612c6b34522 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1a549810a647dd9e4d80eed67ce8e0" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 33111 } } peers { permanent_uuid: "4521d70728e642029114d612c6b34522" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 37495 } } peers { permanent_uuid: "c54a48b5e348467385be062155f9a860" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 40843 } }
I20260811 08:08:43.514057 31408 ts_tablet_manager.cc:1428] T 46c2345c27bb4d80a612b68abf53c5ae P 4521d70728e642029114d612c6b34522: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 08:08:43.514094 31356 heartbeater.cc:503] Master 127.27.243.254:36047 was elected leader, sending a full tablet report...
W20260811 08:08:43.549304 31126 tablet.cc:2369] T 46c2345c27bb4d80a612b68abf53c5ae P c54a48b5e348467385be062155f9a860: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 08:08:43.625698 30889 tablet.cc:2369] T 46c2345c27bb4d80a612b68abf53c5ae P 6b1a549810a647dd9e4d80eed67ce8e0: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 08:08:43.707918 31357 tablet.cc:2369] T 46c2345c27bb4d80a612b68abf53c5ae P 4521d70728e642029114d612c6b34522: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 08:08:43.735064 31409 raft_consensus.cc:482] T 46c2345c27bb4d80a612b68abf53c5ae P c54a48b5e348467385be062155f9a860 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:08:43.735210 31409 raft_consensus.cc:504] T 46c2345c27bb4d80a612b68abf53c5ae P c54a48b5e348467385be062155f9a860 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1a549810a647dd9e4d80eed67ce8e0" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 33111 } } peers { permanent_uuid: "4521d70728e642029114d612c6b34522" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 37495 } } peers { permanent_uuid: "c54a48b5e348467385be062155f9a860" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 40843 } }
I20260811 08:08:43.735605 31409 leader_election.cc:288] T 46c2345c27bb4d80a612b68abf53c5ae P c54a48b5e348467385be062155f9a860 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b1a549810a647dd9e4d80eed67ce8e0 (127.27.243.193:33111), 4521d70728e642029114d612c6b34522 (127.27.243.195:37495)
I20260811 08:08:43.738533 30952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:43.735835 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.193:33111 (local address 127.27.243.194:59103)
0811 08:08:43.735884 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0811 08:08:43.735898 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 08:08:43.735957 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:08:43.736130 (+ 173us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:08:43.736131 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:08:43.736132 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:08:43.736202 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:43.736203 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:43.736823 (+ 620us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:43.736824 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:43.737640 (+ 816us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:43.737643 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:43.738254 (+ 611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:43.738255 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:43.738342 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:43.738352 (+ 10us) client_negotiation.cc:769] Sending connection context
0811 08:08:43.738397 (+ 45us) client_negotiation.cc:240] Negotiation successful
0811 08:08:43.738435 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":23}
I20260811 08:08:43.738528 31396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:43.735951 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.194:57181 (local address 127.27.243.195:37495)
0811 08:08:43.736000 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:43.736002 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:43.736088 (+ 86us) server_negotiation.cc:407] Connection header received
0811 08:08:43.736150 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:43.736151 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:43.736160 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:43.736205 (+ 45us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:08:43.736347 (+ 142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:43.736813 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:43.737777 (+ 964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:43.738179 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:43.738242 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:43.738251 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:43.738384 (+ 133us) server_negotiation.cc:299] Negotiation successful
0811 08:08:43.738460 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 08:08:43.738512 31399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:43.735970 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.194:59103 (local address 127.27.243.193:33111)
0811 08:08:43.736026 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:43.736028 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:43.736036 (+ 8us) server_negotiation.cc:407] Connection header received
0811 08:08:43.736062 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:43.736062 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:43.736071 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:43.736118 (+ 47us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:08:43.736264 (+ 146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:43.736745 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:43.737728 (+ 983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:43.738184 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:43.738247 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:43.738256 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:43.738409 (+ 153us) server_negotiation.cc:299] Negotiation successful
0811 08:08:43.738444 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260811 08:08:43.738575 31417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:43.735851 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.195:37495 (local address 127.27.243.194:57181)
0811 08:08:43.736020 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0811 08:08:43.736029 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 08:08:43.736097 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:08:43.736212 (+ 115us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:08:43.736213 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:08:43.736227 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:08:43.736290 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:43.736292 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:43.736885 (+ 593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:43.736886 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:43.737687 (+ 801us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:43.737689 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:43.738250 (+ 561us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:43.738251 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:43.738323 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:43.738326 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 08:08:43.738372 (+ 46us) client_negotiation.cc:240] Negotiation successful
0811 08:08:43.738409 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":107,"threads_started":1}
I20260811 08:08:43.738888 31271 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "46c2345c27bb4d80a612b68abf53c5ae" candidate_uuid: "c54a48b5e348467385be062155f9a860" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4521d70728e642029114d612c6b34522" is_pre_election: true
I20260811 08:08:43.738901 30815 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "46c2345c27bb4d80a612b68abf53c5ae" candidate_uuid: "c54a48b5e348467385be062155f9a860" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1a549810a647dd9e4d80eed67ce8e0" is_pre_election: true
I20260811 08:08:43.739045 30815 raft_consensus.cc:2454] T 46c2345c27bb4d80a612b68abf53c5ae P 6b1a549810a647dd9e4d80eed67ce8e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c54a48b5e348467385be062155f9a860 in term 0.
I20260811 08:08:43.739045 31271 raft_consensus.cc:2454] T 46c2345c27bb4d80a612b68abf53c5ae P 4521d70728e642029114d612c6b34522 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c54a48b5e348467385be062155f9a860 in term 0.
I20260811 08:08:43.739271 30939 leader_election.cc:302] T 46c2345c27bb4d80a612b68abf53c5ae P c54a48b5e348467385be062155f9a860 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4521d70728e642029114d612c6b34522, c54a48b5e348467385be062155f9a860; no voters:
I20260811 08:08:43.739403 31409 raft_consensus.cc:2781] T 46c2345c27bb4d80a612b68abf53c5ae P c54a48b5e348467385be062155f9a860 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 08:08:43.739470 31409 raft_consensus.cc:482] T 46c2345c27bb4d80a612b68abf53c5ae P c54a48b5e348467385be062155f9a860 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 08:08:43.739490 31409 raft_consensus.cc:3037] T 46c2345c27bb4d80a612b68abf53c5ae P c54a48b5e348467385be062155f9a860 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:08:43.740597 31409 raft_consensus.cc:504] T 46c2345c27bb4d80a612b68abf53c5ae P c54a48b5e348467385be062155f9a860 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1a549810a647dd9e4d80eed67ce8e0" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 33111 } } peers { permanent_uuid: "4521d70728e642029114d612c6b34522" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 37495 } } peers { permanent_uuid: "c54a48b5e348467385be062155f9a860" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 40843 } }
I20260811 08:08:43.740720 31409 leader_election.cc:288] T 46c2345c27bb4d80a612b68abf53c5ae P c54a48b5e348467385be062155f9a860 [CANDIDATE]: Term 1 election: Requested vote from peers 6b1a549810a647dd9e4d80eed67ce8e0 (127.27.243.193:33111), 4521d70728e642029114d612c6b34522 (127.27.243.195:37495)
I20260811 08:08:43.740918 30815 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "46c2345c27bb4d80a612b68abf53c5ae" candidate_uuid: "c54a48b5e348467385be062155f9a860" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1a549810a647dd9e4d80eed67ce8e0"
I20260811 08:08:43.740957 31271 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "46c2345c27bb4d80a612b68abf53c5ae" candidate_uuid: "c54a48b5e348467385be062155f9a860" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4521d70728e642029114d612c6b34522"
I20260811 08:08:43.741005 30815 raft_consensus.cc:3037] T 46c2345c27bb4d80a612b68abf53c5ae P 6b1a549810a647dd9e4d80eed67ce8e0 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:08:43.741036 31271 raft_consensus.cc:3037] T 46c2345c27bb4d80a612b68abf53c5ae P 4521d70728e642029114d612c6b34522 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:08:43.741745 30815 raft_consensus.cc:2454] T 46c2345c27bb4d80a612b68abf53c5ae P 6b1a549810a647dd9e4d80eed67ce8e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c54a48b5e348467385be062155f9a860 in term 1.
I20260811 08:08:43.741794 31271 raft_consensus.cc:2454] T 46c2345c27bb4d80a612b68abf53c5ae P 4521d70728e642029114d612c6b34522 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c54a48b5e348467385be062155f9a860 in term 1.
I20260811 08:08:43.741931 30938 leader_election.cc:302] T 46c2345c27bb4d80a612b68abf53c5ae P c54a48b5e348467385be062155f9a860 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b1a549810a647dd9e4d80eed67ce8e0, c54a48b5e348467385be062155f9a860; no voters:
I20260811 08:08:43.742036 31409 raft_consensus.cc:2781] T 46c2345c27bb4d80a612b68abf53c5ae P c54a48b5e348467385be062155f9a860 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:08:43.742192 31409 raft_consensus.cc:686] T 46c2345c27bb4d80a612b68abf53c5ae P c54a48b5e348467385be062155f9a860 [term 1 LEADER]: Becoming Leader. State: Replica: c54a48b5e348467385be062155f9a860, State: Running, Role: LEADER
I20260811 08:08:43.742278 31409 consensus_queue.cc:237] T 46c2345c27bb4d80a612b68abf53c5ae P c54a48b5e348467385be062155f9a860 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1a549810a647dd9e4d80eed67ce8e0" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 33111 } } peers { permanent_uuid: "4521d70728e642029114d612c6b34522" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 37495 } } peers { permanent_uuid: "c54a48b5e348467385be062155f9a860" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 40843 } }
I20260811 08:08:43.743070 30545 catalog_manager.cc:5495] T 46c2345c27bb4d80a612b68abf53c5ae P c54a48b5e348467385be062155f9a860 reported cstate change: term changed from 0 to 1, leader changed from <none> to c54a48b5e348467385be062155f9a860 (127.27.243.194). New cstate: current_term: 1 leader_uuid: "c54a48b5e348467385be062155f9a860" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1a549810a647dd9e4d80eed67ce8e0" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 33111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4521d70728e642029114d612c6b34522" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 37495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c54a48b5e348467385be062155f9a860" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 40843 } health_report { overall_health: HEALTHY } } }
I20260811 08:08:43.784787 31400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:43.782342 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38978 (local address 127.27.243.194:40843)
0811 08:08:43.782392 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:43.782394 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:43.782403 (+ 9us) server_negotiation.cc:407] Connection header received
0811 08:08:43.782470 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:43.782471 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:43.782488 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:43.782547 (+ 59us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:08:43.782648 (+ 101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:43.783186 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:43.784077 (+ 891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:43.784274 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:43.784333 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:43.784504 (+ 171us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:08:43.784609 (+ 105us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:08:43.784662 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:43.784694 (+ 32us) server_negotiation.cc:299] Negotiation successful
0811 08:08:43.784714 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 08:08:43.786764 30815 raft_consensus.cc:1261] T 46c2345c27bb4d80a612b68abf53c5ae P 6b1a549810a647dd9e4d80eed67ce8e0 [term 1 FOLLOWER]: Refusing update from remote peer c54a48b5e348467385be062155f9a860: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:08:43.787111 31418 consensus_queue.cc:1035] T 46c2345c27bb4d80a612b68abf53c5ae P c54a48b5e348467385be062155f9a860 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b1a549810a647dd9e4d80eed67ce8e0" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 33111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:08:43.788751 31271 raft_consensus.cc:1261] T 46c2345c27bb4d80a612b68abf53c5ae P 4521d70728e642029114d612c6b34522 [term 1 FOLLOWER]: Refusing update from remote peer c54a48b5e348467385be062155f9a860: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:08:43.789026 31409 consensus_queue.cc:1035] T 46c2345c27bb4d80a612b68abf53c5ae P c54a48b5e348467385be062155f9a860 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4521d70728e642029114d612c6b34522" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:08:43.791220 31423 mvcc.cc:205] Tried to move back new op lower bound from 7317240724627673088 to 7317240724448948224. Current Snapshot: MvccSnapshot[applied={T|T < 7317240724627673088 or (T in {7317240724627673088})}]
I20260811 08:08:43.793586 30543 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54374:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:08:43.793668 30543 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54374:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:08:43.794431 30543 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a0d1897730f34a929944530c836f6fba: Sending DeleteTablet for 3 replicas of tablet 46c2345c27bb4d80a612b68abf53c5ae
I20260811 08:08:43.794833 31014 tablet_service.cc:1514] Processing DeleteTablet for tablet 46c2345c27bb4d80a612b68abf53c5ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:08:43 UTC) from {username='kudu', principal='kudu/127.27.243.254@KRBTEST.COM'} at 127.0.0.1:38966
I20260811 08:08:43.794872 31235 tablet_service.cc:1514] Processing DeleteTablet for tablet 46c2345c27bb4d80a612b68abf53c5ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:08:43 UTC) from {username='kudu', principal='kudu/127.27.243.254@KRBTEST.COM'} at 127.0.0.1:44862
I20260811 08:08:43.795105 31447 tablet_replica.cc:330] T 46c2345c27bb4d80a612b68abf53c5ae P 4521d70728e642029114d612c6b34522: stopping tablet replica
I20260811 08:08:43.795106 30775 tablet_service.cc:1514] Processing DeleteTablet for tablet 46c2345c27bb4d80a612b68abf53c5ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:08:43 UTC) from {username='kudu', principal='kudu/127.27.243.254@KRBTEST.COM'} at 127.0.0.1:52774
I20260811 08:08:43.795182 31447 raft_consensus.cc:2229] T 46c2345c27bb4d80a612b68abf53c5ae P 4521d70728e642029114d612c6b34522 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:08:43.795266 31447 raft_consensus.cc:2258] T 46c2345c27bb4d80a612b68abf53c5ae P 4521d70728e642029114d612c6b34522 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:08:43.795300 31448 tablet_replica.cc:330] T 46c2345c27bb4d80a612b68abf53c5ae P 6b1a549810a647dd9e4d80eed67ce8e0: stopping tablet replica
I20260811 08:08:43.795387 31448 raft_consensus.cc:2229] T 46c2345c27bb4d80a612b68abf53c5ae P 6b1a549810a647dd9e4d80eed67ce8e0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:08:43.795617 31446 tablet_replica.cc:330] T 46c2345c27bb4d80a612b68abf53c5ae P c54a48b5e348467385be062155f9a860: stopping tablet replica
I20260811 08:08:43.795655 31448 raft_consensus.cc:2258] T 46c2345c27bb4d80a612b68abf53c5ae P 6b1a549810a647dd9e4d80eed67ce8e0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:08:43.795632 30543 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54374:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 08:08:43.795763 31446 raft_consensus.cc:2229] T 46c2345c27bb4d80a612b68abf53c5ae P c54a48b5e348467385be062155f9a860 [term 1 LEADER]: Raft consensus shutting down.
W20260811 08:08:43.795773 30543 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 08:08:43.795910 31446 raft_consensus.cc:2258] T 46c2345c27bb4d80a612b68abf53c5ae P c54a48b5e348467385be062155f9a860 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:08:43.796175 31448 ts_tablet_manager.cc:1905] T 46c2345c27bb4d80a612b68abf53c5ae P 6b1a549810a647dd9e4d80eed67ce8e0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:08:43.796341 31446 ts_tablet_manager.cc:1905] T 46c2345c27bb4d80a612b68abf53c5ae P c54a48b5e348467385be062155f9a860: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:08:43.797351 30775 tablet_service.cc:1467] Processing CreateTablet for tablet 05063ad82d4047fd838c560e8ca626fa (DEFAULT_TABLE table=test-table [id=0e5aa1184d7641ad88604f32c2a7a021]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:08:43.797451 30775 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 05063ad82d4047fd838c560e8ca626fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:08:43.797921 31448 ts_tablet_manager.cc:1918] T 46c2345c27bb4d80a612b68abf53c5ae P 6b1a549810a647dd9e4d80eed67ce8e0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:08:43.797984 31448 log.cc:1196] T 46c2345c27bb4d80a612b68abf53c5ae P 6b1a549810a647dd9e4d80eed67ce8e0: Deleting WAL directory at /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435717191469-28623-0/minicluster-data/ts-0/wal/wals/46c2345c27bb4d80a612b68abf53c5ae
I20260811 08:08:43.798013 31446 ts_tablet_manager.cc:1918] T 46c2345c27bb4d80a612b68abf53c5ae P c54a48b5e348467385be062155f9a860: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:08:43.798077 31446 log.cc:1196] T 46c2345c27bb4d80a612b68abf53c5ae P c54a48b5e348467385be062155f9a860: Deleting WAL directory at /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435717191469-28623-0/minicluster-data/ts-1/wal/wals/46c2345c27bb4d80a612b68abf53c5ae
I20260811 08:08:43.798233 31448 ts_tablet_manager.cc:1939] T 46c2345c27bb4d80a612b68abf53c5ae P 6b1a549810a647dd9e4d80eed67ce8e0: Deleting consensus metadata
I20260811 08:08:43.798318 31446 ts_tablet_manager.cc:1939] T 46c2345c27bb4d80a612b68abf53c5ae P c54a48b5e348467385be062155f9a860: Deleting consensus metadata
I20260811 08:08:43.798560 31402 tablet_bootstrap.cc:492] T 05063ad82d4047fd838c560e8ca626fa P 6b1a549810a647dd9e4d80eed67ce8e0: Bootstrap starting.
I20260811 08:08:43.798640 30515 catalog_manager.cc:4841] TS 6b1a549810a647dd9e4d80eed67ce8e0 (127.27.243.193:33111): tablet 46c2345c27bb4d80a612b68abf53c5ae (table test-table [id=d1e0246541524d8dbde5b2784178b060]) successfully deleted
I20260811 08:08:43.798921 31402 tablet_bootstrap.cc:654] T 05063ad82d4047fd838c560e8ca626fa P 6b1a549810a647dd9e4d80eed67ce8e0: Neither blocks nor log segments found. Creating new log.
I20260811 08:08:43.799256 30516 catalog_manager.cc:4841] TS c54a48b5e348467385be062155f9a860 (127.27.243.194:40843): tablet 46c2345c27bb4d80a612b68abf53c5ae (table test-table [id=d1e0246541524d8dbde5b2784178b060]) successfully deleted
I20260811 08:08:43.799341 31014 tablet_service.cc:1467] Processing CreateTablet for tablet 05063ad82d4047fd838c560e8ca626fa (DEFAULT_TABLE table=test-table [id=0e5aa1184d7641ad88604f32c2a7a021]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:08:43.799441 31402 tablet_bootstrap.cc:492] T 05063ad82d4047fd838c560e8ca626fa P 6b1a549810a647dd9e4d80eed67ce8e0: No bootstrap required, opened a new log
I20260811 08:08:43.799453 31014 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 05063ad82d4047fd838c560e8ca626fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:08:43.799437 31235 tablet_service.cc:1467] Processing CreateTablet for tablet 05063ad82d4047fd838c560e8ca626fa (DEFAULT_TABLE table=test-table [id=0e5aa1184d7641ad88604f32c2a7a021]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:08:43.799479 31402 ts_tablet_manager.cc:1397] T 05063ad82d4047fd838c560e8ca626fa P 6b1a549810a647dd9e4d80eed67ce8e0: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 08:08:43.799539 31235 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 05063ad82d4047fd838c560e8ca626fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:08:43.799847 31402 raft_consensus.cc:348] T 05063ad82d4047fd838c560e8ca626fa P 6b1a549810a647dd9e4d80eed67ce8e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1a549810a647dd9e4d80eed67ce8e0" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 33111 } } peers { permanent_uuid: "c54a48b5e348467385be062155f9a860" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 40843 } } peers { permanent_uuid: "4521d70728e642029114d612c6b34522" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 37495 } }
I20260811 08:08:43.799916 31402 raft_consensus.cc:374] T 05063ad82d4047fd838c560e8ca626fa P 6b1a549810a647dd9e4d80eed67ce8e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:08:43.799935 31402 raft_consensus.cc:729] T 05063ad82d4047fd838c560e8ca626fa P 6b1a549810a647dd9e4d80eed67ce8e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b1a549810a647dd9e4d80eed67ce8e0, State: Initialized, Role: FOLLOWER
I20260811 08:08:43.799978 31402 consensus_queue.cc:260] T 05063ad82d4047fd838c560e8ca626fa P 6b1a549810a647dd9e4d80eed67ce8e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1a549810a647dd9e4d80eed67ce8e0" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 33111 } } peers { permanent_uuid: "c54a48b5e348467385be062155f9a860" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 40843 } } peers { permanent_uuid: "4521d70728e642029114d612c6b34522" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 37495 } }
I20260811 08:08:43.800069 31402 ts_tablet_manager.cc:1428] T 05063ad82d4047fd838c560e8ca626fa P 6b1a549810a647dd9e4d80eed67ce8e0: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 08:08:43.800652 31401 tablet_bootstrap.cc:492] T 05063ad82d4047fd838c560e8ca626fa P c54a48b5e348467385be062155f9a860: Bootstrap starting.
I20260811 08:08:43.801052 31401 tablet_bootstrap.cc:654] T 05063ad82d4047fd838c560e8ca626fa P c54a48b5e348467385be062155f9a860: Neither blocks nor log segments found. Creating new log.
I20260811 08:08:43.801401 31408 tablet_bootstrap.cc:492] T 05063ad82d4047fd838c560e8ca626fa P 4521d70728e642029114d612c6b34522: Bootstrap starting.
I20260811 08:08:43.801827 31408 tablet_bootstrap.cc:654] T 05063ad82d4047fd838c560e8ca626fa P 4521d70728e642029114d612c6b34522: Neither blocks nor log segments found. Creating new log.
I20260811 08:08:43.802335 31447 ts_tablet_manager.cc:1905] T 46c2345c27bb4d80a612b68abf53c5ae P 4521d70728e642029114d612c6b34522: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:08:43.802477 31408 tablet_bootstrap.cc:492] T 05063ad82d4047fd838c560e8ca626fa P 4521d70728e642029114d612c6b34522: No bootstrap required, opened a new log
I20260811 08:08:43.802502 31401 tablet_bootstrap.cc:492] T 05063ad82d4047fd838c560e8ca626fa P c54a48b5e348467385be062155f9a860: No bootstrap required, opened a new log
I20260811 08:08:43.802520 31408 ts_tablet_manager.cc:1397] T 05063ad82d4047fd838c560e8ca626fa P 4521d70728e642029114d612c6b34522: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260811 08:08:43.802543 31401 ts_tablet_manager.cc:1397] T 05063ad82d4047fd838c560e8ca626fa P c54a48b5e348467385be062155f9a860: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 08:08:43.802659 31408 raft_consensus.cc:348] T 05063ad82d4047fd838c560e8ca626fa P 4521d70728e642029114d612c6b34522 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1a549810a647dd9e4d80eed67ce8e0" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 33111 } } peers { permanent_uuid: "c54a48b5e348467385be062155f9a860" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 40843 } } peers { permanent_uuid: "4521d70728e642029114d612c6b34522" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 37495 } }
I20260811 08:08:43.802677 31401 raft_consensus.cc:348] T 05063ad82d4047fd838c560e8ca626fa P c54a48b5e348467385be062155f9a860 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1a549810a647dd9e4d80eed67ce8e0" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 33111 } } peers { permanent_uuid: "c54a48b5e348467385be062155f9a860" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 40843 } } peers { permanent_uuid: "4521d70728e642029114d612c6b34522" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 37495 } }
I20260811 08:08:43.802726 31408 raft_consensus.cc:374] T 05063ad82d4047fd838c560e8ca626fa P 4521d70728e642029114d612c6b34522 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:08:43.802736 31401 raft_consensus.cc:374] T 05063ad82d4047fd838c560e8ca626fa P c54a48b5e348467385be062155f9a860 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:08:43.802747 31408 raft_consensus.cc:729] T 05063ad82d4047fd838c560e8ca626fa P 4521d70728e642029114d612c6b34522 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4521d70728e642029114d612c6b34522, State: Initialized, Role: FOLLOWER
I20260811 08:08:43.802755 31401 raft_consensus.cc:729] T 05063ad82d4047fd838c560e8ca626fa P c54a48b5e348467385be062155f9a860 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c54a48b5e348467385be062155f9a860, State: Initialized, Role: FOLLOWER
I20260811 08:08:43.802795 31401 consensus_queue.cc:260] T 05063ad82d4047fd838c560e8ca626fa P c54a48b5e348467385be062155f9a860 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1a549810a647dd9e4d80eed67ce8e0" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 33111 } } peers { permanent_uuid: "c54a48b5e348467385be062155f9a860" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 40843 } } peers { permanent_uuid: "4521d70728e642029114d612c6b34522" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 37495 } }
I20260811 08:08:43.802806 31408 consensus_queue.cc:260] T 05063ad82d4047fd838c560e8ca626fa P 4521d70728e642029114d612c6b34522 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1a549810a647dd9e4d80eed67ce8e0" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 33111 } } peers { permanent_uuid: "c54a48b5e348467385be062155f9a860" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 40843 } } peers { permanent_uuid: "4521d70728e642029114d612c6b34522" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 37495 } }
I20260811 08:08:43.802881 31401 ts_tablet_manager.cc:1428] T 05063ad82d4047fd838c560e8ca626fa P c54a48b5e348467385be062155f9a860: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 08:08:43.802891 31408 ts_tablet_manager.cc:1428] T 05063ad82d4047fd838c560e8ca626fa P 4521d70728e642029114d612c6b34522: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 08:08:43.803959 31447 ts_tablet_manager.cc:1918] T 46c2345c27bb4d80a612b68abf53c5ae P 4521d70728e642029114d612c6b34522: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:08:43.804020 31447 log.cc:1196] T 46c2345c27bb4d80a612b68abf53c5ae P 4521d70728e642029114d612c6b34522: Deleting WAL directory at /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435717191469-28623-0/minicluster-data/ts-2/wal/wals/46c2345c27bb4d80a612b68abf53c5ae
I20260811 08:08:43.804214 31447 ts_tablet_manager.cc:1939] T 46c2345c27bb4d80a612b68abf53c5ae P 4521d70728e642029114d612c6b34522: Deleting consensus metadata
I20260811 08:08:43.804554 30516 catalog_manager.cc:4841] TS 4521d70728e642029114d612c6b34522 (127.27.243.195:37495): tablet 46c2345c27bb4d80a612b68abf53c5ae (table test-table [id=d1e0246541524d8dbde5b2784178b060]) successfully deleted
I20260811 08:08:43.876046 31442 raft_consensus.cc:482] T 05063ad82d4047fd838c560e8ca626fa P 4521d70728e642029114d612c6b34522 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:08:43.876185 31442 raft_consensus.cc:504] T 05063ad82d4047fd838c560e8ca626fa P 4521d70728e642029114d612c6b34522 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1a549810a647dd9e4d80eed67ce8e0" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 33111 } } peers { permanent_uuid: "c54a48b5e348467385be062155f9a860" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 40843 } } peers { permanent_uuid: "4521d70728e642029114d612c6b34522" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 37495 } }
I20260811 08:08:43.876611 31442 leader_election.cc:288] T 05063ad82d4047fd838c560e8ca626fa P 4521d70728e642029114d612c6b34522 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b1a549810a647dd9e4d80eed67ce8e0 (127.27.243.193:33111), c54a48b5e348467385be062155f9a860 (127.27.243.194:40843)
I20260811 08:08:43.880263 31400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:43.876973 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.195:45987 (local address 127.27.243.194:40843)
0811 08:08:43.877031 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:43.877033 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:43.877046 (+ 13us) server_negotiation.cc:407] Connection header received
0811 08:08:43.877141 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:43.877142 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:43.877157 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:43.877234 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:08:43.877399 (+ 165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:43.877907 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:43.879331 (+ 1424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:43.879844 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:43.879939 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:43.879951 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:43.880146 (+ 195us) server_negotiation.cc:299] Negotiation successful
0811 08:08:43.880195 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260811 08:08:43.880280 31456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:43.876764 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.194:40843 (local address 127.27.243.195:45987)
0811 08:08:43.876991 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0811 08:08:43.876999 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 08:08:43.877059 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:08:43.877244 (+ 185us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:08:43.877245 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:08:43.877247 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:08:43.877308 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:43.877310 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:43.877980 (+ 670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:43.877981 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:43.879226 (+ 1245us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:43.879228 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:43.879978 (+ 750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:43.879980 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:43.880042 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:43.880046 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 08:08:43.880120 (+ 74us) client_negotiation.cc:240] Negotiation successful
0811 08:08:43.880166 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":215,"mutex_wait_us":94,"thread_start_us":66,"threads_started":1}
I20260811 08:08:43.880591 31046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "05063ad82d4047fd838c560e8ca626fa" candidate_uuid: "4521d70728e642029114d612c6b34522" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c54a48b5e348467385be062155f9a860" is_pre_election: true
I20260811 08:08:43.880721 31046 raft_consensus.cc:2454] T 05063ad82d4047fd838c560e8ca626fa P c54a48b5e348467385be062155f9a860 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4521d70728e642029114d612c6b34522 in term 0.
I20260811 08:08:43.880947 31177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:43.876766 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.193:33111 (local address 127.27.243.195:46147)
0811 08:08:43.876840 (+ 74us) negotiation.cc:107] Waiting for socket to connect
0811 08:08:43.876852 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 08:08:43.876896 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:08:43.877158 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:08:43.877159 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:08:43.877161 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:08:43.877234 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:43.877236 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:43.878158 (+ 922us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:43.878159 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:43.879213 (+ 1054us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:43.879216 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:43.880672 (+ 1456us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:43.880674 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:43.880767 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:43.880771 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 08:08:43.880825 (+ 54us) client_negotiation.cc:240] Negotiation successful
0811 08:08:43.880868 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":54,"mutex_wait_us":4}
I20260811 08:08:43.880968 31164 leader_election.cc:302] T 05063ad82d4047fd838c560e8ca626fa P 4521d70728e642029114d612c6b34522 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4521d70728e642029114d612c6b34522, c54a48b5e348467385be062155f9a860; no voters:
I20260811 08:08:43.881145 31442 raft_consensus.cc:2781] T 05063ad82d4047fd838c560e8ca626fa P 4521d70728e642029114d612c6b34522 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 08:08:43.881196 31442 raft_consensus.cc:482] T 05063ad82d4047fd838c560e8ca626fa P 4521d70728e642029114d612c6b34522 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 08:08:43.881218 31442 raft_consensus.cc:3037] T 05063ad82d4047fd838c560e8ca626fa P 4521d70728e642029114d612c6b34522 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:08:43.881669 31399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:43.876997 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.195:46147 (local address 127.27.243.193:33111)
0811 08:08:43.877044 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:43.877046 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:43.877053 (+ 7us) server_negotiation.cc:407] Connection header received
0811 08:08:43.877081 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:43.877082 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:43.877091 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:43.877140 (+ 49us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:08:43.877332 (+ 192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:43.878074 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:43.879995 (+ 1921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:43.880542 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:43.880623 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:43.880631 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:43.881579 (+ 948us) server_negotiation.cc:299] Negotiation successful
0811 08:08:43.881620 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 08:08:43.881881 30815 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "05063ad82d4047fd838c560e8ca626fa" candidate_uuid: "4521d70728e642029114d612c6b34522" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1a549810a647dd9e4d80eed67ce8e0" is_pre_election: true
I20260811 08:08:43.881969 30815 raft_consensus.cc:2454] T 05063ad82d4047fd838c560e8ca626fa P 6b1a549810a647dd9e4d80eed67ce8e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4521d70728e642029114d612c6b34522 in term 0.
I20260811 08:08:43.882315 31442 raft_consensus.cc:504] T 05063ad82d4047fd838c560e8ca626fa P 4521d70728e642029114d612c6b34522 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1a549810a647dd9e4d80eed67ce8e0" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 33111 } } peers { permanent_uuid: "c54a48b5e348467385be062155f9a860" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 40843 } } peers { permanent_uuid: "4521d70728e642029114d612c6b34522" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 37495 } }
I20260811 08:08:43.882489 31442 leader_election.cc:288] T 05063ad82d4047fd838c560e8ca626fa P 4521d70728e642029114d612c6b34522 [CANDIDATE]: Term 1 election: Requested vote from peers 6b1a549810a647dd9e4d80eed67ce8e0 (127.27.243.193:33111), c54a48b5e348467385be062155f9a860 (127.27.243.194:40843)
I20260811 08:08:43.882673 31046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "05063ad82d4047fd838c560e8ca626fa" candidate_uuid: "4521d70728e642029114d612c6b34522" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c54a48b5e348467385be062155f9a860"
I20260811 08:08:43.882756 31046 raft_consensus.cc:3037] T 05063ad82d4047fd838c560e8ca626fa P c54a48b5e348467385be062155f9a860 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:08:43.882736 30815 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "05063ad82d4047fd838c560e8ca626fa" candidate_uuid: "4521d70728e642029114d612c6b34522" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1a549810a647dd9e4d80eed67ce8e0"
I20260811 08:08:43.882813 30815 raft_consensus.cc:3037] T 05063ad82d4047fd838c560e8ca626fa P 6b1a549810a647dd9e4d80eed67ce8e0 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:08:43.883526 31046 raft_consensus.cc:2454] T 05063ad82d4047fd838c560e8ca626fa P c54a48b5e348467385be062155f9a860 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4521d70728e642029114d612c6b34522 in term 1.
I20260811 08:08:43.883626 30815 raft_consensus.cc:2454] T 05063ad82d4047fd838c560e8ca626fa P 6b1a549810a647dd9e4d80eed67ce8e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4521d70728e642029114d612c6b34522 in term 1.
I20260811 08:08:43.883709 31164 leader_election.cc:302] T 05063ad82d4047fd838c560e8ca626fa P 4521d70728e642029114d612c6b34522 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4521d70728e642029114d612c6b34522, c54a48b5e348467385be062155f9a860; no voters:
I20260811 08:08:43.883808 31442 raft_consensus.cc:2781] T 05063ad82d4047fd838c560e8ca626fa P 4521d70728e642029114d612c6b34522 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:08:43.883890 31442 raft_consensus.cc:686] T 05063ad82d4047fd838c560e8ca626fa P 4521d70728e642029114d612c6b34522 [term 1 LEADER]: Becoming Leader. State: Replica: 4521d70728e642029114d612c6b34522, State: Running, Role: LEADER
I20260811 08:08:43.883960 31442 consensus_queue.cc:237] T 05063ad82d4047fd838c560e8ca626fa P 4521d70728e642029114d612c6b34522 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1a549810a647dd9e4d80eed67ce8e0" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 33111 } } peers { permanent_uuid: "c54a48b5e348467385be062155f9a860" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 40843 } } peers { permanent_uuid: "4521d70728e642029114d612c6b34522" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 37495 } }
I20260811 08:08:43.884760 30543 catalog_manager.cc:5495] T 05063ad82d4047fd838c560e8ca626fa P 4521d70728e642029114d612c6b34522 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4521d70728e642029114d612c6b34522 (127.27.243.195). New cstate: current_term: 1 leader_uuid: "4521d70728e642029114d612c6b34522" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1a549810a647dd9e4d80eed67ce8e0" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 33111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c54a48b5e348467385be062155f9a860" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 40843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4521d70728e642029114d612c6b34522" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 37495 } health_report { overall_health: HEALTHY } } }
Aug 11 08:08:43 dist-test-slave-7lbf krb5kdc[30468](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435722, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.254@KRBTEST.COM for kudu/127.27.243.254@KRBTEST.COM
I20260811 08:08:43.924698 31466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:43.918303 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36047 (local address 127.0.0.1:54380)
0811 08:08:43.918478 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0811 08:08:43.918489 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 08:08:43.918555 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:08:43.918677 (+ 122us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:08:43.918678 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:08:43.918994 (+ 316us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:08:43.919045 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:43.919047 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:43.919744 (+ 697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:43.919745 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:43.920287 (+ 542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:43.920289 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:43.920640 (+ 351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:43.920641 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:43.920682 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:43.921169 (+ 487us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:08:43.921173 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:08:43.922530 (+ 1357us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:08:43.923813 (+ 1283us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:08:43.923821 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:08:43.923823 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:08:43.924031 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:08:43.924193 (+ 162us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:08:43.924193 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:08:43.924193 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:08:43.924247 (+ 54us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:08:43.924436 (+ 189us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:08:43.924441 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:08:43.924485 (+ 44us) client_negotiation.cc:769] Sending connection context
0811 08:08:43.924534 (+ 49us) client_negotiation.cc:240] Negotiation successful
0811 08:08:43.924623 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":79,"threads_started":1}
I20260811 08:08:43.924772 30640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:43.918371 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54380 (local address 127.27.243.254:36047)
0811 08:08:43.918438 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:43.918440 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:43.918546 (+ 106us) server_negotiation.cc:407] Connection header received
0811 08:08:43.918599 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:43.918600 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:43.918609 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:43.918657 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:43.919143 (+ 486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:43.919660 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:43.920390 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:43.920577 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:43.920633 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:43.922606 (+ 1973us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:08:43.922607 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:08:43.922607 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:08:43.922614 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:08:43.923727 (+ 1113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:43.924095 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:43.924096 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:43.924096 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:43.924144 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:43.924285 (+ 141us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:43.924286 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:43.924286 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:43.924392 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:08:43.924437 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:43.924563 (+ 126us) server_negotiation.cc:299] Negotiation successful
0811 08:08:43.924675 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":43,"server-negotiator.queue_time_us":35}
I20260811 08:08:43.926937 30543 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.27.243.254@KRBTEST.COM'} at 127.0.0.1:54380:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260811 08:08:43.927240 30543 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 08:08:43.930189 31235 tablet_service.cc:1467] Processing CreateTablet for tablet a189dd91a7c64dd78a540c5b4d1cd5e7 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=4ed65aef68864d3ea9353bfdd638800d]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 08:08:43.930145 30775 tablet_service.cc:1467] Processing CreateTablet for tablet a189dd91a7c64dd78a540c5b4d1cd5e7 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=4ed65aef68864d3ea9353bfdd638800d]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 08:08:43.930361 31235 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a189dd91a7c64dd78a540c5b4d1cd5e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:08:43.930364 30775 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a189dd91a7c64dd78a540c5b4d1cd5e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:08:43.930653 31014 tablet_service.cc:1467] Processing CreateTablet for tablet a189dd91a7c64dd78a540c5b4d1cd5e7 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=4ed65aef68864d3ea9353bfdd638800d]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 08:08:43.930784 31014 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a189dd91a7c64dd78a540c5b4d1cd5e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:08:43.931572 31408 tablet_bootstrap.cc:492] T a189dd91a7c64dd78a540c5b4d1cd5e7 P 4521d70728e642029114d612c6b34522: Bootstrap starting.
I20260811 08:08:43.931972 31408 tablet_bootstrap.cc:654] T a189dd91a7c64dd78a540c5b4d1cd5e7 P 4521d70728e642029114d612c6b34522: Neither blocks nor log segments found. Creating new log.
I20260811 08:08:43.932231 31401 tablet_bootstrap.cc:492] T a189dd91a7c64dd78a540c5b4d1cd5e7 P c54a48b5e348467385be062155f9a860: Bootstrap starting.
I20260811 08:08:43.932299 31402 tablet_bootstrap.cc:492] T a189dd91a7c64dd78a540c5b4d1cd5e7 P 6b1a549810a647dd9e4d80eed67ce8e0: Bootstrap starting.
I20260811 08:08:43.932549 31401 tablet_bootstrap.cc:654] T a189dd91a7c64dd78a540c5b4d1cd5e7 P c54a48b5e348467385be062155f9a860: Neither blocks nor log segments found. Creating new log.
I20260811 08:08:43.932639 31408 tablet_bootstrap.cc:492] T a189dd91a7c64dd78a540c5b4d1cd5e7 P 4521d70728e642029114d612c6b34522: No bootstrap required, opened a new log
I20260811 08:08:43.932660 31402 tablet_bootstrap.cc:654] T a189dd91a7c64dd78a540c5b4d1cd5e7 P 6b1a549810a647dd9e4d80eed67ce8e0: Neither blocks nor log segments found. Creating new log.
I20260811 08:08:43.932682 31408 ts_tablet_manager.cc:1397] T a189dd91a7c64dd78a540c5b4d1cd5e7 P 4521d70728e642029114d612c6b34522: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260811 08:08:43.932837 31408 raft_consensus.cc:348] T a189dd91a7c64dd78a540c5b4d1cd5e7 P 4521d70728e642029114d612c6b34522 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1a549810a647dd9e4d80eed67ce8e0" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 33111 } } peers { permanent_uuid: "c54a48b5e348467385be062155f9a860" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 40843 } } peers { permanent_uuid: "4521d70728e642029114d612c6b34522" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 37495 } }
I20260811 08:08:43.932920 31408 raft_consensus.cc:374] T a189dd91a7c64dd78a540c5b4d1cd5e7 P 4521d70728e642029114d612c6b34522 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:08:43.932940 31408 raft_consensus.cc:729] T a189dd91a7c64dd78a540c5b4d1cd5e7 P 4521d70728e642029114d612c6b34522 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4521d70728e642029114d612c6b34522, State: Initialized, Role: FOLLOWER
I20260811 08:08:43.932986 31408 consensus_queue.cc:260] T a189dd91a7c64dd78a540c5b4d1cd5e7 P 4521d70728e642029114d612c6b34522 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1a549810a647dd9e4d80eed67ce8e0" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 33111 } } peers { permanent_uuid: "c54a48b5e348467385be062155f9a860" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 40843 } } peers { permanent_uuid: "4521d70728e642029114d612c6b34522" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 37495 } }
I20260811 08:08:43.933028 31401 tablet_bootstrap.cc:492] T a189dd91a7c64dd78a540c5b4d1cd5e7 P c54a48b5e348467385be062155f9a860: No bootstrap required, opened a new log
I20260811 08:08:43.933079 31401 ts_tablet_manager.cc:1397] T a189dd91a7c64dd78a540c5b4d1cd5e7 P c54a48b5e348467385be062155f9a860: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 08:08:43.933080 31408 ts_tablet_manager.cc:1428] T a189dd91a7c64dd78a540c5b4d1cd5e7 P 4521d70728e642029114d612c6b34522: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260811 08:08:43.933204 31401 raft_consensus.cc:348] T a189dd91a7c64dd78a540c5b4d1cd5e7 P c54a48b5e348467385be062155f9a860 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1a549810a647dd9e4d80eed67ce8e0" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 33111 } } peers { permanent_uuid: "c54a48b5e348467385be062155f9a860" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 40843 } } peers { permanent_uuid: "4521d70728e642029114d612c6b34522" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 37495 } }
I20260811 08:08:43.933208 31442 tablet_replica.cc:439] T a189dd91a7c64dd78a540c5b4d1cd5e7 P 4521d70728e642029114d612c6b34522: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1a549810a647dd9e4d80eed67ce8e0" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 33111 } } peers { permanent_uuid: "c54a48b5e348467385be062155f9a860" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 40843 } } peers { permanent_uuid: "4521d70728e642029114d612c6b34522" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 37495 } } }
I20260811 08:08:43.933269 31401 raft_consensus.cc:374] T a189dd91a7c64dd78a540c5b4d1cd5e7 P c54a48b5e348467385be062155f9a860 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:08:43.933286 31401 raft_consensus.cc:729] T a189dd91a7c64dd78a540c5b4d1cd5e7 P c54a48b5e348467385be062155f9a860 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c54a48b5e348467385be062155f9a860, State: Initialized, Role: FOLLOWER
I20260811 08:08:43.933279 31442 tablet_replica.cc:442] T a189dd91a7c64dd78a540c5b4d1cd5e7 P 4521d70728e642029114d612c6b34522: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 08:08:43.933321 31401 consensus_queue.cc:260] T a189dd91a7c64dd78a540c5b4d1cd5e7 P c54a48b5e348467385be062155f9a860 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1a549810a647dd9e4d80eed67ce8e0" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 33111 } } peers { permanent_uuid: "c54a48b5e348467385be062155f9a860" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 40843 } } peers { permanent_uuid: "4521d70728e642029114d612c6b34522" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 37495 } }
I20260811 08:08:43.933418 31401 ts_tablet_manager.cc:1428] T a189dd91a7c64dd78a540c5b4d1cd5e7 P c54a48b5e348467385be062155f9a860: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 08:08:43.933485 31402 tablet_bootstrap.cc:492] T a189dd91a7c64dd78a540c5b4d1cd5e7 P 6b1a549810a647dd9e4d80eed67ce8e0: No bootstrap required, opened a new log
I20260811 08:08:43.933454 31428 tablet_replica.cc:439] T a189dd91a7c64dd78a540c5b4d1cd5e7 P c54a48b5e348467385be062155f9a860: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1a549810a647dd9e4d80eed67ce8e0" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 33111 } } peers { permanent_uuid: "c54a48b5e348467385be062155f9a860" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 40843 } } peers { permanent_uuid: "4521d70728e642029114d612c6b34522" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 37495 } } }
I20260811 08:08:43.933550 31402 ts_tablet_manager.cc:1397] T a189dd91a7c64dd78a540c5b4d1cd5e7 P 6b1a549810a647dd9e4d80eed67ce8e0: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 08:08:43.933561 31428 tablet_replica.cc:442] T a189dd91a7c64dd78a540c5b4d1cd5e7 P c54a48b5e348467385be062155f9a860: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 08:08:43.933681 31402 raft_consensus.cc:348] T a189dd91a7c64dd78a540c5b4d1cd5e7 P 6b1a549810a647dd9e4d80eed67ce8e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1a549810a647dd9e4d80eed67ce8e0" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 33111 } } peers { permanent_uuid: "c54a48b5e348467385be062155f9a860" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 40843 } } peers { permanent_uuid: "4521d70728e642029114d612c6b34522" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 37495 } }
I20260811 08:08:43.933739 31402 raft_consensus.cc:374] T a189dd91a7c64dd78a540c5b4d1cd5e7 P 6b1a549810a647dd9e4d80eed67ce8e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:08:43.933758 31402 raft_consensus.cc:729] T a189dd91a7c64dd78a540c5b4d1cd5e7 P 6b1a549810a647dd9e4d80eed67ce8e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b1a549810a647dd9e4d80eed67ce8e0, State: Initialized, Role: FOLLOWER
I20260811 08:08:43.933804 31402 consensus_queue.cc:260] T a189dd91a7c64dd78a540c5b4d1cd5e7 P 6b1a549810a647dd9e4d80eed67ce8e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1a549810a647dd9e4d80eed67ce8e0" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 33111 } } peers { permanent_uuid: "c54a48b5e348467385be062155f9a860" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 40843 } } peers { permanent_uuid: "4521d70728e642029114d612c6b34522" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 37495 } }
I20260811 08:08:43.933894 31402 ts_tablet_manager.cc:1428] T a189dd91a7c64dd78a540c5b4d1cd5e7 P 6b1a549810a647dd9e4d80eed67ce8e0: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 08:08:43.933979 31410 tablet_replica.cc:439] T a189dd91a7c64dd78a540c5b4d1cd5e7 P 6b1a549810a647dd9e4d80eed67ce8e0: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1a549810a647dd9e4d80eed67ce8e0" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 33111 } } peers { permanent_uuid: "c54a48b5e348467385be062155f9a860" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 40843 } } peers { permanent_uuid: "4521d70728e642029114d612c6b34522" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 37495 } } }
I20260811 08:08:43.934091 31410 tablet_replica.cc:442] T a189dd91a7c64dd78a540c5b4d1cd5e7 P 6b1a549810a647dd9e4d80eed67ce8e0: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 08:08:43.993885 31428 raft_consensus.cc:482] T a189dd91a7c64dd78a540c5b4d1cd5e7 P c54a48b5e348467385be062155f9a860 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:08:43.993988 31428 raft_consensus.cc:504] T a189dd91a7c64dd78a540c5b4d1cd5e7 P c54a48b5e348467385be062155f9a860 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1a549810a647dd9e4d80eed67ce8e0" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 33111 } } peers { permanent_uuid: "c54a48b5e348467385be062155f9a860" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 40843 } } peers { permanent_uuid: "4521d70728e642029114d612c6b34522" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 37495 } }
I20260811 08:08:43.994215 31428 leader_election.cc:288] T a189dd91a7c64dd78a540c5b4d1cd5e7 P c54a48b5e348467385be062155f9a860 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b1a549810a647dd9e4d80eed67ce8e0 (127.27.243.193:33111), 4521d70728e642029114d612c6b34522 (127.27.243.195:37495)
I20260811 08:08:43.994421 30815 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a189dd91a7c64dd78a540c5b4d1cd5e7" candidate_uuid: "c54a48b5e348467385be062155f9a860" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1a549810a647dd9e4d80eed67ce8e0" is_pre_election: true
I20260811 08:08:43.994452 31271 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a189dd91a7c64dd78a540c5b4d1cd5e7" candidate_uuid: "c54a48b5e348467385be062155f9a860" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4521d70728e642029114d612c6b34522" is_pre_election: true
I20260811 08:08:43.994536 30815 raft_consensus.cc:2454] T a189dd91a7c64dd78a540c5b4d1cd5e7 P 6b1a549810a647dd9e4d80eed67ce8e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c54a48b5e348467385be062155f9a860 in term 0.
I20260811 08:08:43.994544 31271 raft_consensus.cc:2454] T a189dd91a7c64dd78a540c5b4d1cd5e7 P 4521d70728e642029114d612c6b34522 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c54a48b5e348467385be062155f9a860 in term 0.
I20260811 08:08:43.994732 30939 leader_election.cc:302] T a189dd91a7c64dd78a540c5b4d1cd5e7 P c54a48b5e348467385be062155f9a860 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4521d70728e642029114d612c6b34522, c54a48b5e348467385be062155f9a860; no voters:
I20260811 08:08:43.994886 31428 raft_consensus.cc:2781] T a189dd91a7c64dd78a540c5b4d1cd5e7 P c54a48b5e348467385be062155f9a860 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 08:08:43.994946 31428 raft_consensus.cc:482] T a189dd91a7c64dd78a540c5b4d1cd5e7 P c54a48b5e348467385be062155f9a860 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 08:08:43.994967 31428 raft_consensus.cc:3037] T a189dd91a7c64dd78a540c5b4d1cd5e7 P c54a48b5e348467385be062155f9a860 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:08:43.995759 31428 raft_consensus.cc:504] T a189dd91a7c64dd78a540c5b4d1cd5e7 P c54a48b5e348467385be062155f9a860 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1a549810a647dd9e4d80eed67ce8e0" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 33111 } } peers { permanent_uuid: "c54a48b5e348467385be062155f9a860" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 40843 } } peers { permanent_uuid: "4521d70728e642029114d612c6b34522" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 37495 } }
I20260811 08:08:43.995890 31428 leader_election.cc:288] T a189dd91a7c64dd78a540c5b4d1cd5e7 P c54a48b5e348467385be062155f9a860 [CANDIDATE]: Term 1 election: Requested vote from peers 6b1a549810a647dd9e4d80eed67ce8e0 (127.27.243.193:33111), 4521d70728e642029114d612c6b34522 (127.27.243.195:37495)
I20260811 08:08:43.996061 30815 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a189dd91a7c64dd78a540c5b4d1cd5e7" candidate_uuid: "c54a48b5e348467385be062155f9a860" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1a549810a647dd9e4d80eed67ce8e0"
I20260811 08:08:43.996135 30815 raft_consensus.cc:3037] T a189dd91a7c64dd78a540c5b4d1cd5e7 P 6b1a549810a647dd9e4d80eed67ce8e0 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:08:43.996093 31271 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a189dd91a7c64dd78a540c5b4d1cd5e7" candidate_uuid: "c54a48b5e348467385be062155f9a860" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4521d70728e642029114d612c6b34522"
I20260811 08:08:43.996176 31271 raft_consensus.cc:3037] T a189dd91a7c64dd78a540c5b4d1cd5e7 P 4521d70728e642029114d612c6b34522 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:08:43.996778 30815 raft_consensus.cc:2454] T a189dd91a7c64dd78a540c5b4d1cd5e7 P 6b1a549810a647dd9e4d80eed67ce8e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c54a48b5e348467385be062155f9a860 in term 1.
I20260811 08:08:43.996925 31271 raft_consensus.cc:2454] T a189dd91a7c64dd78a540c5b4d1cd5e7 P 4521d70728e642029114d612c6b34522 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c54a48b5e348467385be062155f9a860 in term 1.
I20260811 08:08:43.996945 30938 leader_election.cc:302] T a189dd91a7c64dd78a540c5b4d1cd5e7 P c54a48b5e348467385be062155f9a860 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b1a549810a647dd9e4d80eed67ce8e0, c54a48b5e348467385be062155f9a860; no voters:
I20260811 08:08:43.997020 31428 raft_consensus.cc:2781] T a189dd91a7c64dd78a540c5b4d1cd5e7 P c54a48b5e348467385be062155f9a860 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:08:43.997064 31428 raft_consensus.cc:686] T a189dd91a7c64dd78a540c5b4d1cd5e7 P c54a48b5e348467385be062155f9a860 [term 1 LEADER]: Becoming Leader. State: Replica: c54a48b5e348467385be062155f9a860, State: Running, Role: LEADER
I20260811 08:08:43.997123 31428 consensus_queue.cc:237] T a189dd91a7c64dd78a540c5b4d1cd5e7 P c54a48b5e348467385be062155f9a860 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1a549810a647dd9e4d80eed67ce8e0" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 33111 } } peers { permanent_uuid: "c54a48b5e348467385be062155f9a860" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 40843 } } peers { permanent_uuid: "4521d70728e642029114d612c6b34522" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 37495 } }
I20260811 08:08:43.997397 31428 tablet_replica.cc:439] T a189dd91a7c64dd78a540c5b4d1cd5e7 P c54a48b5e348467385be062155f9a860: TxnStatusTablet state changed. Reason: New leader c54a48b5e348467385be062155f9a860. Latest consensus state: current_term: 1 leader_uuid: "c54a48b5e348467385be062155f9a860" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1a549810a647dd9e4d80eed67ce8e0" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 33111 } } peers { permanent_uuid: "c54a48b5e348467385be062155f9a860" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 40843 } } peers { permanent_uuid: "4521d70728e642029114d612c6b34522" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 37495 } } }
I20260811 08:08:43.997468 31428 tablet_replica.cc:442] T a189dd91a7c64dd78a540c5b4d1cd5e7 P c54a48b5e348467385be062155f9a860: This TxnStatusTablet replica's current role is: LEADER
I20260811 08:08:43.997695 31485 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260811 08:08:43.997852 31485 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260811 08:08:43.997756 30543 catalog_manager.cc:5495] T a189dd91a7c64dd78a540c5b4d1cd5e7 P c54a48b5e348467385be062155f9a860 reported cstate change: term changed from 0 to 1, leader changed from <none> to c54a48b5e348467385be062155f9a860 (127.27.243.194). New cstate: current_term: 1 leader_uuid: "c54a48b5e348467385be062155f9a860" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1a549810a647dd9e4d80eed67ce8e0" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 33111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c54a48b5e348467385be062155f9a860" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 40843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4521d70728e642029114d612c6b34522" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 37495 } health_report { overall_health: UNKNOWN } } }
I20260811 08:08:44.009615 31400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:44.007415 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38990 (local address 127.27.243.194:40843)
0811 08:08:44.007459 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:44.007461 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:44.007488 (+ 27us) server_negotiation.cc:407] Connection header received
0811 08:08:44.007567 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:44.007568 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:44.007578 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:44.007630 (+ 52us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:08:44.007736 (+ 106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:44.008243 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:44.008977 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:44.009159 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:44.009212 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:44.009376 (+ 164us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:08:44.009407 (+ 31us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:08:44.009447 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:44.009504 (+ 57us) server_negotiation.cc:299] Negotiation successful
0811 08:08:44.009546 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 08:08:44.009641 31466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:44.007358 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.194:40843 (local address 127.0.0.1:38990)
0811 08:08:44.007445 (+ 87us) negotiation.cc:107] Waiting for socket to connect
0811 08:08:44.007456 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 08:08:44.007510 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:08:44.007638 (+ 128us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:08:44.007638 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:08:44.007639 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 08:08:44.007690 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:44.007692 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:44.008327 (+ 635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:44.008328 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:44.008901 (+ 573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:44.008903 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:44.009216 (+ 313us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:44.009217 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:44.009282 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:44.009306 (+ 24us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 08:08:44.009454 (+ 148us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 08:08:44.009461 (+ 7us) client_negotiation.cc:769] Sending connection context
0811 08:08:44.009502 (+ 41us) client_negotiation.cc:240] Negotiation successful
0811 08:08:44.009576 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":51}
I20260811 08:08:44.010737 31271 raft_consensus.cc:1261] T a189dd91a7c64dd78a540c5b4d1cd5e7 P 4521d70728e642029114d612c6b34522 [term 1 FOLLOWER]: Refusing update from remote peer c54a48b5e348467385be062155f9a860: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:08:44.010735 30815 raft_consensus.cc:1261] T a189dd91a7c64dd78a540c5b4d1cd5e7 P 6b1a549810a647dd9e4d80eed67ce8e0 [term 1 FOLLOWER]: Refusing update from remote peer c54a48b5e348467385be062155f9a860: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:08:44.010934 31409 consensus_queue.cc:1035] T a189dd91a7c64dd78a540c5b4d1cd5e7 P c54a48b5e348467385be062155f9a860 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4521d70728e642029114d612c6b34522" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:08:44.011035 31428 consensus_queue.cc:1035] T a189dd91a7c64dd78a540c5b4d1cd5e7 P c54a48b5e348467385be062155f9a860 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b1a549810a647dd9e4d80eed67ce8e0" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 33111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:08:44.011662 31442 tablet_replica.cc:439] T a189dd91a7c64dd78a540c5b4d1cd5e7 P 4521d70728e642029114d612c6b34522: TxnStatusTablet state changed. Reason: New leader c54a48b5e348467385be062155f9a860. Latest consensus state: current_term: 1 leader_uuid: "c54a48b5e348467385be062155f9a860" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1a549810a647dd9e4d80eed67ce8e0" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 33111 } } peers { permanent_uuid: "c54a48b5e348467385be062155f9a860" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 40843 } } peers { permanent_uuid: "4521d70728e642029114d612c6b34522" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 37495 } } }
I20260811 08:08:44.011751 31442 tablet_replica.cc:442] T a189dd91a7c64dd78a540c5b4d1cd5e7 P 4521d70728e642029114d612c6b34522: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 08:08:44.011830 31410 tablet_replica.cc:439] T a189dd91a7c64dd78a540c5b4d1cd5e7 P 6b1a549810a647dd9e4d80eed67ce8e0: TxnStatusTablet state changed. Reason: New leader c54a48b5e348467385be062155f9a860. Latest consensus state: current_term: 1 leader_uuid: "c54a48b5e348467385be062155f9a860" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1a549810a647dd9e4d80eed67ce8e0" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 33111 } } peers { permanent_uuid: "c54a48b5e348467385be062155f9a860" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 40843 } } peers { permanent_uuid: "4521d70728e642029114d612c6b34522" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 37495 } } }
I20260811 08:08:44.011907 31410 tablet_replica.cc:442] T a189dd91a7c64dd78a540c5b4d1cd5e7 P 6b1a549810a647dd9e4d80eed67ce8e0: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 08:08:44.012447 31409 tablet_replica.cc:439] T a189dd91a7c64dd78a540c5b4d1cd5e7 P c54a48b5e348467385be062155f9a860: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c54a48b5e348467385be062155f9a860" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1a549810a647dd9e4d80eed67ce8e0" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 33111 } } peers { permanent_uuid: "c54a48b5e348467385be062155f9a860" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 40843 } } peers { permanent_uuid: "4521d70728e642029114d612c6b34522" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 37495 } } }
I20260811 08:08:44.012530 31409 tablet_replica.cc:442] T a189dd91a7c64dd78a540c5b4d1cd5e7 P c54a48b5e348467385be062155f9a860: This TxnStatusTablet replica's current role is: LEADER
I20260811 08:08:44.012765 31421 mvcc.cc:205] Tried to move back new op lower bound from 7317240725546201088 to 7317240725492535296. Current Snapshot: MvccSnapshot[applied={T|T < 7317240725546201088 or (T in {7317240725546201088})}]
I20260811 08:08:44.013130 31433 mvcc.cc:205] Tried to move back new op lower bound from 7317240725546201088 to 7317240725492535296. Current Snapshot: MvccSnapshot[applied={T|T < 7317240725546201088}]
I20260811 08:08:44.013276 31442 tablet_replica.cc:439] T a189dd91a7c64dd78a540c5b4d1cd5e7 P 4521d70728e642029114d612c6b34522: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c54a48b5e348467385be062155f9a860" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1a549810a647dd9e4d80eed67ce8e0" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 33111 } } peers { permanent_uuid: "c54a48b5e348467385be062155f9a860" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 40843 } } peers { permanent_uuid: "4521d70728e642029114d612c6b34522" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 37495 } } }
I20260811 08:08:44.013345 31442 tablet_replica.cc:442] T a189dd91a7c64dd78a540c5b4d1cd5e7 P 4521d70728e642029114d612c6b34522: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 08:08:44.013739 31409 tablet_replica.cc:439] T a189dd91a7c64dd78a540c5b4d1cd5e7 P c54a48b5e348467385be062155f9a860: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c54a48b5e348467385be062155f9a860" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1a549810a647dd9e4d80eed67ce8e0" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 33111 } } peers { permanent_uuid: "c54a48b5e348467385be062155f9a860" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 40843 } } peers { permanent_uuid: "4521d70728e642029114d612c6b34522" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 37495 } } }
I20260811 08:08:44.013814 31409 tablet_replica.cc:442] T a189dd91a7c64dd78a540c5b4d1cd5e7 P c54a48b5e348467385be062155f9a860: This TxnStatusTablet replica's current role is: LEADER
I20260811 08:08:44.014245 31410 tablet_replica.cc:439] T a189dd91a7c64dd78a540c5b4d1cd5e7 P 6b1a549810a647dd9e4d80eed67ce8e0: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c54a48b5e348467385be062155f9a860" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1a549810a647dd9e4d80eed67ce8e0" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 33111 } } peers { permanent_uuid: "c54a48b5e348467385be062155f9a860" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 40843 } } peers { permanent_uuid: "4521d70728e642029114d612c6b34522" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 37495 } } }
I20260811 08:08:44.014339 31410 tablet_replica.cc:442] T a189dd91a7c64dd78a540c5b4d1cd5e7 P 6b1a549810a647dd9e4d80eed67ce8e0: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 08:08:44.017331 31396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:44.014772 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44864 (local address 127.27.243.195:37495)
0811 08:08:44.014828 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:44.014830 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:44.014838 (+ 8us) server_negotiation.cc:407] Connection header received
0811 08:08:44.014873 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:44.014874 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:44.014893 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:44.014965 (+ 72us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:08:44.015133 (+ 168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:44.015597 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:44.016612 (+ 1015us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:44.016806 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:44.016859 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:44.017069 (+ 210us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:08:44.017161 (+ 92us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:08:44.017209 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:44.017261 (+ 52us) server_negotiation.cc:299] Negotiation successful
0811 08:08:44.017277 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260811 08:08:44.022229 31495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:44.019522 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.194:40843 (local address 127.27.243.195:39551)
0811 08:08:44.019672 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0811 08:08:44.019682 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 08:08:44.019733 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:08:44.019873 (+ 140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:08:44.019873 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:08:44.019875 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 08:08:44.019924 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:44.019925 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:44.020881 (+ 956us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:44.020882 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:44.021439 (+ 557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:44.021441 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:44.021886 (+ 445us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:44.021886 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:44.021935 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:44.021948 (+ 13us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 08:08:44.022102 (+ 154us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 08:08:44.022103 (+ 1us) client_negotiation.cc:769] Sending connection context
0811 08:08:44.022133 (+ 30us) client_negotiation.cc:240] Negotiation successful
0811 08:08:44.022167 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":79,"threads_started":1}
I20260811 08:08:44.022236 31400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:44.019592 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.195:39551 (local address 127.27.243.194:40843)
0811 08:08:44.019635 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:44.019637 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:44.019735 (+ 98us) server_negotiation.cc:407] Connection header received
0811 08:08:44.019771 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:44.019772 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:44.019782 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:44.019839 (+ 57us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:08:44.019971 (+ 132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:44.020792 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:44.021508 (+ 716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:44.021815 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:44.021886 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:44.022014 (+ 128us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:08:44.022047 (+ 33us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:08:44.022093 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:44.022146 (+ 53us) server_negotiation.cc:299] Negotiation successful
0811 08:08:44.022168 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 08:08:44.024194 30815 raft_consensus.cc:1261] T 05063ad82d4047fd838c560e8ca626fa P 6b1a549810a647dd9e4d80eed67ce8e0 [term 1 FOLLOWER]: Refusing update from remote peer 4521d70728e642029114d612c6b34522: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:08:44.024256 31046 raft_consensus.cc:1261] T 05063ad82d4047fd838c560e8ca626fa P c54a48b5e348467385be062155f9a860 [term 1 FOLLOWER]: Refusing update from remote peer 4521d70728e642029114d612c6b34522: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:08:44.024436 31412 consensus_queue.cc:1035] T 05063ad82d4047fd838c560e8ca626fa P 4521d70728e642029114d612c6b34522 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b1a549810a647dd9e4d80eed67ce8e0" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 33111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:08:44.024554 31442 consensus_queue.cc:1035] T 05063ad82d4047fd838c560e8ca626fa P 4521d70728e642029114d612c6b34522 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c54a48b5e348467385be062155f9a860" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 40843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:08:44.033722 31396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:44.031006 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.194:50373 (local address 127.27.243.195:37495)
0811 08:08:44.031047 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:44.031049 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:44.031201 (+ 152us) server_negotiation.cc:407] Connection header received
0811 08:08:44.031223 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:44.031224 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:44.031236 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:44.031290 (+ 54us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:08:44.031404 (+ 114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:44.031842 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:44.032972 (+ 1130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:44.033239 (+ 267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:44.033287 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:44.033497 (+ 210us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:08:44.033556 (+ 59us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:08:44.033603 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:44.033655 (+ 52us) server_negotiation.cc:299] Negotiation successful
0811 08:08:44.033673 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 08:08:44.033782 31502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:44.030922 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.195:37495 (local address 127.27.243.194:50373)
0811 08:08:44.031077 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0811 08:08:44.031087 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 08:08:44.031150 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:08:44.031299 (+ 149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:08:44.031300 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:08:44.031302 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 08:08:44.031354 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:44.031355 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:44.031901 (+ 546us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:44.031902 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:44.032819 (+ 917us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:44.032822 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:44.033295 (+ 473us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:44.033296 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:44.033365 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:44.033382 (+ 17us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 08:08:44.033604 (+ 222us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 08:08:44.033606 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 08:08:44.033652 (+ 46us) client_negotiation.cc:240] Negotiation successful
0811 08:08:44.033699 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":85,"threads_started":1}
I20260811 08:08:44.043872 30545 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54374:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:08:44.043987 30545 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54374:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:08:44.044605 30545 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a0d1897730f34a929944530c836f6fba: Sending DeleteTablet for 3 replicas of tablet 05063ad82d4047fd838c560e8ca626fa
I20260811 08:08:44.044867 30775 tablet_service.cc:1514] Processing DeleteTablet for tablet 05063ad82d4047fd838c560e8ca626fa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:08:44 UTC) from {username='kudu', principal='kudu/127.27.243.254@KRBTEST.COM'} at 127.0.0.1:52774
I20260811 08:08:44.044970 31448 tablet_replica.cc:330] T 05063ad82d4047fd838c560e8ca626fa P 6b1a549810a647dd9e4d80eed67ce8e0: stopping tablet replica
I20260811 08:08:44.045011 31448 raft_consensus.cc:2229] T 05063ad82d4047fd838c560e8ca626fa P 6b1a549810a647dd9e4d80eed67ce8e0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:08:44.045002 31235 tablet_service.cc:1514] Processing DeleteTablet for tablet 05063ad82d4047fd838c560e8ca626fa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:08:44 UTC) from {username='kudu', principal='kudu/127.27.243.254@KRBTEST.COM'} at 127.0.0.1:44862
I20260811 08:08:44.045044 31448 raft_consensus.cc:2258] T 05063ad82d4047fd838c560e8ca626fa P 6b1a549810a647dd9e4d80eed67ce8e0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:08:44.045087 31447 tablet_replica.cc:330] T 05063ad82d4047fd838c560e8ca626fa P 4521d70728e642029114d612c6b34522: stopping tablet replica
I20260811 08:08:44.045128 31447 raft_consensus.cc:2229] T 05063ad82d4047fd838c560e8ca626fa P 4521d70728e642029114d612c6b34522 [term 1 LEADER]: Raft consensus shutting down.
I20260811 08:08:44.045224 31447 raft_consensus.cc:2258] T 05063ad82d4047fd838c560e8ca626fa P 4521d70728e642029114d612c6b34522 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:08:44.045385 31014 tablet_service.cc:1514] Processing DeleteTablet for tablet 05063ad82d4047fd838c560e8ca626fa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:08:44 UTC) from {username='kudu', principal='kudu/127.27.243.254@KRBTEST.COM'} at 127.0.0.1:38966
I20260811 08:08:44.045473 31446 tablet_replica.cc:330] T 05063ad82d4047fd838c560e8ca626fa P c54a48b5e348467385be062155f9a860: stopping tablet replica
I20260811 08:08:44.045549 31446 raft_consensus.cc:2229] T 05063ad82d4047fd838c560e8ca626fa P c54a48b5e348467385be062155f9a860 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:08:44.045583 31446 raft_consensus.cc:2258] T 05063ad82d4047fd838c560e8ca626fa P c54a48b5e348467385be062155f9a860 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:08:44.045603 31448 ts_tablet_manager.cc:1905] T 05063ad82d4047fd838c560e8ca626fa P 6b1a549810a647dd9e4d80eed67ce8e0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:08:44.045879 31447 ts_tablet_manager.cc:1905] T 05063ad82d4047fd838c560e8ca626fa P 4521d70728e642029114d612c6b34522: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:08:44.047112 31448 ts_tablet_manager.cc:1918] T 05063ad82d4047fd838c560e8ca626fa P 6b1a549810a647dd9e4d80eed67ce8e0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 08:08:44.047171 31448 log.cc:1196] T 05063ad82d4047fd838c560e8ca626fa P 6b1a549810a647dd9e4d80eed67ce8e0: Deleting WAL directory at /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435717191469-28623-0/minicluster-data/ts-0/wal/wals/05063ad82d4047fd838c560e8ca626fa
I20260811 08:08:44.047394 31448 ts_tablet_manager.cc:1939] T 05063ad82d4047fd838c560e8ca626fa P 6b1a549810a647dd9e4d80eed67ce8e0: Deleting consensus metadata
I20260811 08:08:44.047417 31447 ts_tablet_manager.cc:1918] T 05063ad82d4047fd838c560e8ca626fa P 4521d70728e642029114d612c6b34522: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 08:08:44.047468 31447 log.cc:1196] T 05063ad82d4047fd838c560e8ca626fa P 4521d70728e642029114d612c6b34522: Deleting WAL directory at /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435717191469-28623-0/minicluster-data/ts-2/wal/wals/05063ad82d4047fd838c560e8ca626fa
I20260811 08:08:44.047669 31447 ts_tablet_manager.cc:1939] T 05063ad82d4047fd838c560e8ca626fa P 4521d70728e642029114d612c6b34522: Deleting consensus metadata
I20260811 08:08:44.047799 30515 catalog_manager.cc:4841] TS 6b1a549810a647dd9e4d80eed67ce8e0 (127.27.243.193:33111): tablet 05063ad82d4047fd838c560e8ca626fa (table test-table [id=0e5aa1184d7641ad88604f32c2a7a021]) successfully deleted
I20260811 08:08:44.048019 31446 ts_tablet_manager.cc:1905] T 05063ad82d4047fd838c560e8ca626fa P c54a48b5e348467385be062155f9a860: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:08:44.049587 31446 ts_tablet_manager.cc:1918] T 05063ad82d4047fd838c560e8ca626fa P c54a48b5e348467385be062155f9a860: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 08:08:44.049640 31446 log.cc:1196] T 05063ad82d4047fd838c560e8ca626fa P c54a48b5e348467385be062155f9a860: Deleting WAL directory at /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435717191469-28623-0/minicluster-data/ts-1/wal/wals/05063ad82d4047fd838c560e8ca626fa
I20260811 08:08:44.049850 31446 ts_tablet_manager.cc:1939] T 05063ad82d4047fd838c560e8ca626fa P c54a48b5e348467385be062155f9a860: Deleting consensus metadata
I20260811 08:08:44.050207 30516 catalog_manager.cc:4841] TS c54a48b5e348467385be062155f9a860 (127.27.243.194:40843): tablet 05063ad82d4047fd838c560e8ca626fa (table test-table [id=0e5aa1184d7641ad88604f32c2a7a021]) successfully deleted
I20260811 08:08:44.050287 30516 catalog_manager.cc:4841] TS 4521d70728e642029114d612c6b34522 (127.27.243.195:37495): tablet 05063ad82d4047fd838c560e8ca626fa (table test-table [id=0e5aa1184d7641ad88604f32c2a7a021]) successfully deleted
Aug 11 08:08:44 dist-test-slave-7lbf krb5kdc[30468](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435723, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.27.243.193@KRBTEST.COM
I20260811 08:08:44.063504 31399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:44.049980 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52788 (local address 127.27.243.193:33111)
0811 08:08:44.050032 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:44.050034 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:44.053711 (+ 3677us) server_negotiation.cc:407] Connection header received
0811 08:08:44.053766 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:44.053768 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:44.053783 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:44.053856 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:44.054520 (+ 664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:44.055286 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:44.056349 (+ 1063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:44.056654 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:44.056720 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:44.060269 (+ 3549us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:08:44.060281 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:08:44.060282 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:08:44.060289 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:08:44.062278 (+ 1989us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:44.062666 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:44.062670 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:44.062670 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:44.062747 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:44.062946 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:44.062947 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:44.062948 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:44.063112 (+ 164us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:08:44.063243 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:44.063327 (+ 84us) server_negotiation.cc:299] Negotiation successful
0811 08:08:44.063408 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
W20260811 08:08:44.063970 30877 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52788
I20260811 08:08:44.072050 30640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:44.064926 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54390 (local address 127.27.243.254:36047)
0811 08:08:44.064968 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:44.064970 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:44.065177 (+ 207us) server_negotiation.cc:407] Connection header received
0811 08:08:44.065227 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:44.065227 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:44.065239 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:44.065298 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:44.065888 (+ 590us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:44.066656 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:44.067640 (+ 984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:44.067959 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:44.068024 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:44.069259 (+ 1235us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:08:44.069260 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:08:44.069260 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:08:44.069268 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:08:44.070874 (+ 1606us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:44.071259 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:44.071260 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:44.071260 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:44.071318 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:44.071518 (+ 200us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:44.071518 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:44.071519 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:44.071645 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:08:44.071740 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:44.071879 (+ 139us) server_negotiation.cc:299] Negotiation successful
0811 08:08:44.071953 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
W20260811 08:08:44.072345 30545 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54390
I20260811 08:08:44.073180 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 30666
I20260811 08:08:44.087090 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 30901
I20260811 08:08:44.101974 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 31137
I20260811 08:08:44.112890 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 30488
2026-08-11T08:08:44Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (2593 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435717191469-28623-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:08:44 dist-test-slave-7lbf krb5kdc[31515](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:08:44 dist-test-slave-7lbf krb5kdc[31515](info): set up 2 sockets
Aug 11 08:08:44 dist-test-slave-7lbf krb5kdc[31515](info): commencing operation
krb5kdc: starting...
W20260811 08:08:45.287868 28623 mini_kdc.cc:121] Time spent starting KDC: real 1.149s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435717191469-28623-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435717191469-28623-0/krb5kdc/test-user.keytab.
Aug 11 08:08:45 dist-test-slave-7lbf krb5kdc[31515](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435725, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:08:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:08:45Z Disabled control of system clock
WARNING: no policy specified for kudu/127.27.243.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.243.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.243.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab.
Entry for principal kudu/127.27.243.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab.
I20260811 08:08:45.400235 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435717191469-28623-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435717191469-28623-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435717191469-28623-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.243.254:36037
--webserver_interface=127.27.243.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab
--principal=kudu/127.27.243.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:36205
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.243.254:36037
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:08:45.481041 31536 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:08:45.481237 31536 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:08:45.481268 31536 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:08:45.482427 31536 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:08:45.482468 31536 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260811 08:08:45.482486 31536 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:08:45.482502 31536 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:08:45.482520 31536 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:08:45.482543 31536 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:08:45.483975 31536 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:36205
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435717191469-28623-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435717191469-28623-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.243.254:36037
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab
--principal=kudu/127.27.243.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.243.254:36037
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.243.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31536
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435717191469-28623-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:08:45.484207 31536 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:08:45.484411 31536 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:08:45.488930 31552 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:08:45.489030 31547 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:08:45.488926 31546 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:08:45.489158 31536 server_base.cc:1034] running on GCE node
I20260811 08:08:45.489411 31536 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:08:45.489697 31536 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:08:45.490850 31536 hybrid_clock.cc:648] HybridClock initialized: now 1786435725490835 us; error 38 us; skew 500 ppm
Aug 11 08:08:45 dist-test-slave-7lbf krb5kdc[31515](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435725, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:08:45.493181 31536 init.cc:377] Logged in from keytab as kudu/127.27.243.254@KRBTEST.COM (short username kudu)
I20260811 08:08:45.493593 31536 webserver.cc:460] Webserver started at http://127.27.243.254:39397/ using document root <none> and password file <none>
I20260811 08:08:45.493772 31536 fs_manager.cc:359] Metadata directory not provided
I20260811 08:08:45.493810 31536 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:08:45.493903 31536 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:08:45.494900 31536 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435717191469-28623-0/minicluster-data/master-0/data/instance:
uuid: "485920145a134f15ae7f4bcdf5db2398"
format_stamp: "Formatted at 2026-08-11 08:08:45 on dist-test-slave-7lbf"
server_key: "2a28f4a4af712e38c8d91a73dfa4e137"
server_key_iv: "9408256e403f8910fa8f3611a6fa3a70"
server_key_version: "encryptionkey@0"
I20260811 08:08:45.495196 31536 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435717191469-28623-0/minicluster-data/master-0/wal/instance:
uuid: "485920145a134f15ae7f4bcdf5db2398"
format_stamp: "Formatted at 2026-08-11 08:08:45 on dist-test-slave-7lbf"
server_key: "2a28f4a4af712e38c8d91a73dfa4e137"
server_key_iv: "9408256e403f8910fa8f3611a6fa3a70"
server_key_version: "encryptionkey@0"
I20260811 08:08:45.496407 31536 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 08:08:45.497061 31560 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:08:45.497208 31536 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 08:08:45.497291 31536 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435717191469-28623-0/minicluster-data/master-0/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435717191469-28623-0/minicluster-data/master-0/wal
uuid: "485920145a134f15ae7f4bcdf5db2398"
format_stamp: "Formatted at 2026-08-11 08:08:45 on dist-test-slave-7lbf"
server_key: "2a28f4a4af712e38c8d91a73dfa4e137"
server_key_iv: "9408256e403f8910fa8f3611a6fa3a70"
server_key_version: "encryptionkey@0"
I20260811 08:08:45.497364 31536 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435717191469-28623-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435717191469-28623-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435717191469-28623-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:08:45.504105 31536 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:08:45.505693 31536 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:08:45.505807 31536 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:08:45.510102 31536 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.254:36037
I20260811 08:08:45.510183 31667 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.254:36037 every 8 connection(s)
I20260811 08:08:45.510437 31536 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
I20260811 08:08:45.511058 31668 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:08:45.513226 31668 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 485920145a134f15ae7f4bcdf5db2398: Bootstrap starting.
I20260811 08:08:45.513823 31668 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 485920145a134f15ae7f4bcdf5db2398: Neither blocks nor log segments found. Creating new log.
I20260811 08:08:45.514082 31668 log.cc:824] T 00000000000000000000000000000000 P 485920145a134f15ae7f4bcdf5db2398: Log is configured to *not* fsync() on all Append() calls
I20260811 08:08:45.514439 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 31536
I20260811 08:08:45.514528 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435717191469-28623-0/minicluster-data/master-0/wal/instance
I20260811 08:08:45.514710 28623 external_mini_cluster.cc:1428] Setting key 0002de8e855b0412e2f33059f58ecb1d
I20260811 08:08:45.514809 31668 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 485920145a134f15ae7f4bcdf5db2398: No bootstrap required, opened a new log
I20260811 08:08:45.517537 31668 raft_consensus.cc:348] T 00000000000000000000000000000000 P 485920145a134f15ae7f4bcdf5db2398 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "485920145a134f15ae7f4bcdf5db2398" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 36037 } }
I20260811 08:08:45.517704 31668 raft_consensus.cc:374] T 00000000000000000000000000000000 P 485920145a134f15ae7f4bcdf5db2398 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:08:45.517747 31668 raft_consensus.cc:729] T 00000000000000000000000000000000 P 485920145a134f15ae7f4bcdf5db2398 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 485920145a134f15ae7f4bcdf5db2398, State: Initialized, Role: FOLLOWER
I20260811 08:08:45.517868 31668 consensus_queue.cc:260] T 00000000000000000000000000000000 P 485920145a134f15ae7f4bcdf5db2398 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "485920145a134f15ae7f4bcdf5db2398" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 36037 } }
I20260811 08:08:45.517943 31668 raft_consensus.cc:388] T 00000000000000000000000000000000 P 485920145a134f15ae7f4bcdf5db2398 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:08:45.517976 31668 raft_consensus.cc:482] T 00000000000000000000000000000000 P 485920145a134f15ae7f4bcdf5db2398 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:08:45.518018 31668 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 485920145a134f15ae7f4bcdf5db2398 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:08:45.518640 31668 raft_consensus.cc:504] T 00000000000000000000000000000000 P 485920145a134f15ae7f4bcdf5db2398 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "485920145a134f15ae7f4bcdf5db2398" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 36037 } }
I20260811 08:08:45.518743 31668 leader_election.cc:302] T 00000000000000000000000000000000 P 485920145a134f15ae7f4bcdf5db2398 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 485920145a134f15ae7f4bcdf5db2398; no voters:
I20260811 08:08:45.518888 31668 leader_election.cc:288] T 00000000000000000000000000000000 P 485920145a134f15ae7f4bcdf5db2398 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:08:45.518919 31684 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 485920145a134f15ae7f4bcdf5db2398 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:08:45.519037 31684 raft_consensus.cc:686] T 00000000000000000000000000000000 P 485920145a134f15ae7f4bcdf5db2398 [term 1 LEADER]: Becoming Leader. State: Replica: 485920145a134f15ae7f4bcdf5db2398, State: Running, Role: LEADER
I20260811 08:08:45.519151 31668 sys_catalog.cc:564] T 00000000000000000000000000000000 P 485920145a134f15ae7f4bcdf5db2398 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:08:45.519191 31684 consensus_queue.cc:237] T 00000000000000000000000000000000 P 485920145a134f15ae7f4bcdf5db2398 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "485920145a134f15ae7f4bcdf5db2398" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 36037 } }
I20260811 08:08:45.519550 31684 sys_catalog.cc:455] T 00000000000000000000000000000000 P 485920145a134f15ae7f4bcdf5db2398 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 485920145a134f15ae7f4bcdf5db2398. Latest consensus state: current_term: 1 leader_uuid: "485920145a134f15ae7f4bcdf5db2398" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "485920145a134f15ae7f4bcdf5db2398" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 36037 } } }
I20260811 08:08:45.519742 31684 sys_catalog.cc:458] T 00000000000000000000000000000000 P 485920145a134f15ae7f4bcdf5db2398 [sys.catalog]: This master's current role is: LEADER
I20260811 08:08:45.519675 31688 sys_catalog.cc:455] T 00000000000000000000000000000000 P 485920145a134f15ae7f4bcdf5db2398 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "485920145a134f15ae7f4bcdf5db2398" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "485920145a134f15ae7f4bcdf5db2398" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 36037 } } }
I20260811 08:08:45.520151 31688 sys_catalog.cc:458] T 00000000000000000000000000000000 P 485920145a134f15ae7f4bcdf5db2398 [sys.catalog]: This master's current role is: LEADER
I20260811 08:08:45.520648 31701 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:08:45.521140 31701 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 11 08:08:45 dist-test-slave-7lbf krb5kdc[31515](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435725, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.243.254@KRBTEST.COM
I20260811 08:08:45.523170 31701 catalog_manager.cc:1347] Generated new cluster ID: ea9c2f3b049740d2a70bc592d69a52af
I20260811 08:08:45.523223 31701 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:08:45.525619 31682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:45.515211 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49246 (local address 127.27.243.254:36037)
0811 08:08:45.515386 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:45.515395 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:45.515429 (+ 34us) server_negotiation.cc:407] Connection header received
0811 08:08:45.516161 (+ 732us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:45.516171 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:45.516235 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:45.516383 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:45.516950 (+ 567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:45.518344 (+ 1394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:45.519258 (+ 914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:45.519823 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:45.519925 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:45.522575 (+ 2650us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:08:45.522579 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:08:45.522580 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:08:45.522591 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:08:45.524211 (+ 1620us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:45.524527 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:45.524530 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:45.524530 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:45.524610 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:45.524781 (+ 171us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:45.524781 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:45.524782 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:45.525006 (+ 224us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:08:45.525157 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:45.525252 (+ 95us) server_negotiation.cc:299] Negotiation successful
0811 08:08:45.525381 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":61,"threads_started":1}
I20260811 08:08:45.536275 31701 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:08:45.536763 31701 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:08:45.542387 31701 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 485920145a134f15ae7f4bcdf5db2398: Generated new TSK 0
I20260811 08:08:45.542558 31701 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.27.243.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.243.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.243.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.193.keytab.
Entry for principal kudu/127.27.243.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.193.keytab.
I20260811 08:08:45.568521 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435717191469-28623-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435717191469-28623-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435717191469-28623-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435717191469-28623-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.243.193:0
--local_ip_for_outbound_sockets=127.27.243.193
--webserver_interface=127.27.243.193
--webserver_port=0
--tserver_master_addrs=127.27.243.254:36037
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.193.keytab
--principal=kudu/127.27.243.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:36205
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:08:45.648902 31721 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:08:45.649102 31721 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:08:45.649137 31721 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:08:45.650295 31721 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:08:45.650336 31721 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:08:45.650362 31721 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260811 08:08:45.650377 31721 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 08:08:45.650408 31721 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.243.193
I20260811 08:08:45.651856 31721 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:36205
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435717191469-28623-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435717191469-28623-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.193.keytab
--principal=kudu/127.27.243.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.243.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435717191469-28623-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.243.193
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.27.243.254:36037
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31721
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.243.193
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435717191469-28623-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:08:45.652110 31721 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:08:45.652313 31721 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:08:45.656934 31735 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:08:45.656910 31728 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:08:45.656910 31732 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:08:45.657140 31721 server_base.cc:1034] running on GCE node
I20260811 08:08:45.657310 31721 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:08:45.657500 31721 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:08:45.658660 31721 hybrid_clock.cc:648] HybridClock initialized: now 1786435725658651 us; error 28 us; skew 500 ppm
Aug 11 08:08:45 dist-test-slave-7lbf krb5kdc[31515](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435725, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:08:45.660990 31721 init.cc:377] Logged in from keytab as kudu/127.27.243.193@KRBTEST.COM (short username kudu)
I20260811 08:08:45.661378 31721 webserver.cc:460] Webserver started at http://127.27.243.193:35125/ using document root <none> and password file <none>
I20260811 08:08:45.661621 31721 fs_manager.cc:359] Metadata directory not provided
I20260811 08:08:45.661674 31721 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:08:45.661803 31721 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:08:45.662806 31721 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435717191469-28623-0/minicluster-data/ts-0/data/instance:
uuid: "11913dd40ada4fd4b0b51f22d4106c73"
format_stamp: "Formatted at 2026-08-11 08:08:45 on dist-test-slave-7lbf"
server_key: "2babcdfdee69f7d9b34b642dca51bd61"
server_key_iv: "a89f33478787531424b41d08910740de"
server_key_version: "encryptionkey@0"
I20260811 08:08:45.663142 31721 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435717191469-28623-0/minicluster-data/ts-0/wal/instance:
uuid: "11913dd40ada4fd4b0b51f22d4106c73"
format_stamp: "Formatted at 2026-08-11 08:08:45 on dist-test-slave-7lbf"
server_key: "2babcdfdee69f7d9b34b642dca51bd61"
server_key_iv: "a89f33478787531424b41d08910740de"
server_key_version: "encryptionkey@0"
I20260811 08:08:45.664386 31721 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 08:08:45.665033 31743 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:08:45.665187 31721 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 08:08:45.665268 31721 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435717191469-28623-0/minicluster-data/ts-0/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435717191469-28623-0/minicluster-data/ts-0/wal
uuid: "11913dd40ada4fd4b0b51f22d4106c73"
format_stamp: "Formatted at 2026-08-11 08:08:45 on dist-test-slave-7lbf"
server_key: "2babcdfdee69f7d9b34b642dca51bd61"
server_key_iv: "a89f33478787531424b41d08910740de"
server_key_version: "encryptionkey@0"
I20260811 08:08:45.665333 31721 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435717191469-28623-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435717191469-28623-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435717191469-28623-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:08:45.678236 31721 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:08:45.679919 31721 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:08:45.680059 31721 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:08:45.680532 31721 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:08:45.680574 31721 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:08:45.680603 31721 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:08:45.680619 31721 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 08:08:45 dist-test-slave-7lbf krb5kdc[31515](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435725, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.193@KRBTEST.COM for kudu/127.27.243.254@KRBTEST.COM
I20260811 08:08:45.686918 31721 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.193:40561
I20260811 08:08:45.686990 31935 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.193:40561 every 8 connection(s)
I20260811 08:08:45.687279 31721 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435717191469-28623-0/minicluster-data/ts-0/data/info.pb
I20260811 08:08:45.689602 31682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:45.680988 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.193:48857 (local address 127.27.243.254:36037)
0811 08:08:45.681029 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:45.681031 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:45.681237 (+ 206us) server_negotiation.cc:407] Connection header received
0811 08:08:45.681773 (+ 536us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:45.681774 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:45.681786 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:45.681839 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:45.682627 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:45.683397 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:45.684848 (+ 1451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:45.685149 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:45.685236 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:45.687338 (+ 2102us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:08:45.687340 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:08:45.687340 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:08:45.687348 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:08:45.688552 (+ 1204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:45.688890 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:45.688891 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:45.688891 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:45.688938 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:45.689093 (+ 155us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:45.689093 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:45.689094 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:45.689185 (+ 91us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:08:45.689228 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:45.689439 (+ 211us) server_negotiation.cc:299] Negotiation successful
0811 08:08:45.689500 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 08:08:45.689764 31762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:45.680980 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36037 (local address 127.27.243.193:48857)
0811 08:08:45.681123 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0811 08:08:45.681157 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0811 08:08:45.681676 (+ 519us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:08:45.681913 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:08:45.681917 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:08:45.682235 (+ 318us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:08:45.682510 (+ 275us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:45.682517 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:45.683505 (+ 988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:45.683506 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:45.684752 (+ 1246us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:45.684756 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:45.685237 (+ 481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:45.685237 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:45.685337 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:45.685832 (+ 495us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:08:45.685842 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:08:45.687243 (+ 1401us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:08:45.688616 (+ 1373us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:08:45.688622 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:08:45.688624 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:08:45.688829 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:08:45.688973 (+ 144us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:08:45.688973 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:08:45.688973 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:08:45.689055 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:08:45.689227 (+ 172us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:08:45.689229 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:08:45.689331 (+ 102us) client_negotiation.cc:769] Sending connection context
0811 08:08:45.689414 (+ 83us) client_negotiation.cc:240] Negotiation successful
0811 08:08:45.689560 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":81,"threads_started":1}
I20260811 08:08:45.690268 31936 heartbeater.cc:347] Connected to a master server at 127.27.243.254:36037
I20260811 08:08:45.690354 31936 heartbeater.cc:464] Registering TS with master...
I20260811 08:08:45.690549 31936 heartbeater.cc:511] Master 127.27.243.254:36037 requested a full tablet report, sending...
I20260811 08:08:45.691052 31594 ts_manager.cc:194] Registered new tserver with Master: 11913dd40ada4fd4b0b51f22d4106c73 (127.27.243.193:40561)
I20260811 08:08:45.691715 31594 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.243.193@KRBTEST.COM'} at 127.27.243.193:48857
I20260811 08:08:45.693573 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 31721
I20260811 08:08:45.693665 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435717191469-28623-0/minicluster-data/ts-0/wal/instance
I20260811 08:08:45.693861 28623 external_mini_cluster.cc:1428] Setting key 0181e7d7c443ddf399614e07e07b974b
I20260811 08:08:45.696372 31950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:45.691226 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36037 (local address 127.27.243.193:37465)
0811 08:08:45.691363 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0811 08:08:45.691373 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 08:08:45.691431 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:08:45.691545 (+ 114us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:08:45.691546 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:08:45.691702 (+ 156us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:08:45.691757 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:45.691758 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:45.692577 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:45.692578 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:45.693078 (+ 500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:45.693080 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:45.693427 (+ 347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:45.693428 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:45.693501 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:45.693931 (+ 430us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:08:45.693936 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:08:45.694215 (+ 279us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:08:45.695509 (+ 1294us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:08:45.695510 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:08:45.695510 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:08:45.695707 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:08:45.695854 (+ 147us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:08:45.695854 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:08:45.695854 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:08:45.695909 (+ 55us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:08:45.696076 (+ 167us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:08:45.696077 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:08:45.696121 (+ 44us) client_negotiation.cc:769] Sending connection context
0811 08:08:45.696182 (+ 61us) client_negotiation.cc:240] Negotiation successful
0811 08:08:45.696276 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":74,"threads_started":1}
I20260811 08:08:45.696377 31682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:45.691294 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.193:37465 (local address 127.27.243.254:36037)
0811 08:08:45.691333 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:45.691334 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:45.691427 (+ 93us) server_negotiation.cc:407] Connection header received
0811 08:08:45.691482 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:45.691483 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:45.691492 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:45.691532 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:45.691821 (+ 289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:45.692497 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:45.693150 (+ 653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:45.693357 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:45.693410 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:45.694282 (+ 872us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:08:45.694283 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:08:45.694283 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:08:45.694288 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:08:45.695431 (+ 1143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:45.695770 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:45.695770 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:45.695771 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:45.695810 (+ 39us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:45.695949 (+ 139us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:45.695949 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:45.695950 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:45.696029 (+ 79us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:08:45.696071 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:45.696220 (+ 149us) server_negotiation.cc:299] Negotiation successful
0811 08:08:45.696288 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
WARNING: no policy specified for kudu/127.27.243.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.243.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.243.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.194.keytab.
Entry for principal kudu/127.27.243.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.194.keytab.
I20260811 08:08:45.717739 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435717191469-28623-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435717191469-28623-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435717191469-28623-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435717191469-28623-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.243.194:0
--local_ip_for_outbound_sockets=127.27.243.194
--webserver_interface=127.27.243.194
--webserver_port=0
--tserver_master_addrs=127.27.243.254:36037
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.194.keytab
--principal=kudu/127.27.243.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:36205
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:08:45.798240 31959 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:08:45.798444 31959 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:08:45.798467 31959 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:08:45.799595 31959 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:08:45.799638 31959 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:08:45.799656 31959 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260811 08:08:45.799666 31959 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 08:08:45.799681 31959 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.243.194
I20260811 08:08:45.801177 31959 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:36205
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435717191469-28623-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435717191469-28623-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.194.keytab
--principal=kudu/127.27.243.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.243.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435717191469-28623-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.243.194
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.27.243.254:36037
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31959
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.243.194
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435717191469-28623-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:08:45.801370 31959 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:08:45.801575 31959 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:08:45.806207 31967 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:08:45.806255 31968 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:08:45.806192 31970 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:08:45.806437 31959 server_base.cc:1034] running on GCE node
I20260811 08:08:45.806635 31959 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:08:45.806882 31959 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:08:45.808022 31959 hybrid_clock.cc:648] HybridClock initialized: now 1786435725808007 us; error 27 us; skew 500 ppm
Aug 11 08:08:45 dist-test-slave-7lbf krb5kdc[31515](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435725, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:08:45.815572 31959 init.cc:377] Logged in from keytab as kudu/127.27.243.194@KRBTEST.COM (short username kudu)
I20260811 08:08:45.816004 31959 webserver.cc:460] Webserver started at http://127.27.243.194:45073/ using document root <none> and password file <none>
I20260811 08:08:45.816219 31959 fs_manager.cc:359] Metadata directory not provided
I20260811 08:08:45.816268 31959 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:08:45.816401 31959 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:08:45.817442 31959 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435717191469-28623-0/minicluster-data/ts-1/data/instance:
uuid: "555784c7828c4290869f94d157650afa"
format_stamp: "Formatted at 2026-08-11 08:08:45 on dist-test-slave-7lbf"
server_key: "0c97efc99220019b72fa0996b3fad3a4"
server_key_iv: "28806e0591f9e1c1e8e55237bf8ebd05"
server_key_version: "encryptionkey@0"
I20260811 08:08:45.817827 31959 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435717191469-28623-0/minicluster-data/ts-1/wal/instance:
uuid: "555784c7828c4290869f94d157650afa"
format_stamp: "Formatted at 2026-08-11 08:08:45 on dist-test-slave-7lbf"
server_key: "0c97efc99220019b72fa0996b3fad3a4"
server_key_iv: "28806e0591f9e1c1e8e55237bf8ebd05"
server_key_version: "encryptionkey@0"
I20260811 08:08:45.819120 31959 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:08:45.819820 31980 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:08:45.819983 31959 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 08:08:45.820078 31959 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435717191469-28623-0/minicluster-data/ts-1/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435717191469-28623-0/minicluster-data/ts-1/wal
uuid: "555784c7828c4290869f94d157650afa"
format_stamp: "Formatted at 2026-08-11 08:08:45 on dist-test-slave-7lbf"
server_key: "0c97efc99220019b72fa0996b3fad3a4"
server_key_iv: "28806e0591f9e1c1e8e55237bf8ebd05"
server_key_version: "encryptionkey@0"
I20260811 08:08:45.820158 31959 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435717191469-28623-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435717191469-28623-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435717191469-28623-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:08:45.842237 31959 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:08:45.844237 31959 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:08:45.844391 31959 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:08:45.844904 31959 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:08:45.844949 31959 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:08:45.844980 31959 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:08:45.844996 31959 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 08:08:45 dist-test-slave-7lbf krb5kdc[31515](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435725, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.194@KRBTEST.COM for kudu/127.27.243.254@KRBTEST.COM
I20260811 08:08:45.851374 31959 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.194:45395
I20260811 08:08:45.851454 32182 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.194:45395 every 8 connection(s)
I20260811 08:08:45.851723 31959 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435717191469-28623-0/minicluster-data/ts-1/data/info.pb
I20260811 08:08:45.852358 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 31959
I20260811 08:08:45.852442 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435717191469-28623-0/minicluster-data/ts-1/wal/instance
I20260811 08:08:45.852607 28623 external_mini_cluster.cc:1428] Setting key 26bdc5e3b80a2bb158d023bc99d0f98e
I20260811 08:08:45.854624 31682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:45.845358 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.194:43053 (local address 127.27.243.254:36037)
0811 08:08:45.845428 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:45.845431 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:45.845623 (+ 192us) server_negotiation.cc:407] Connection header received
0811 08:08:45.846104 (+ 481us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:45.846106 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:45.846120 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:45.846195 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:45.846939 (+ 744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:45.847698 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:45.849159 (+ 1461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:45.849447 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:45.849537 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:45.851850 (+ 2313us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:08:45.851851 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:08:45.851851 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:08:45.851858 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:08:45.853257 (+ 1399us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:45.853746 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:45.853748 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:45.853748 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:45.853813 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:45.854076 (+ 263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:45.854076 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:45.854077 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:45.854174 (+ 97us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:08:45.854218 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:45.854496 (+ 278us) server_negotiation.cc:299] Negotiation successful
0811 08:08:45.854562 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 08:08:45.854856 31996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:45.845308 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36037 (local address 127.27.243.194:43053)
0811 08:08:45.845476 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0811 08:08:45.845537 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0811 08:08:45.846012 (+ 475us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:08:45.846268 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:08:45.846273 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:08:45.846556 (+ 283us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:08:45.846837 (+ 281us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:45.846843 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:45.847795 (+ 952us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:45.847797 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:45.849060 (+ 1263us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:45.849064 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:45.849582 (+ 518us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:45.849583 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:45.849722 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:45.850153 (+ 431us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:08:45.850162 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:08:45.851749 (+ 1587us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:08:45.853330 (+ 1581us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:08:45.853337 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:08:45.853340 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:08:45.853670 (+ 330us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:08:45.853881 (+ 211us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:08:45.853881 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:08:45.853882 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:08:45.854019 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:08:45.854221 (+ 202us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:08:45.854226 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:08:45.854378 (+ 152us) client_negotiation.cc:769] Sending connection context
0811 08:08:45.854475 (+ 97us) client_negotiation.cc:240] Negotiation successful
0811 08:08:45.854634 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":86,"threads_started":1}
I20260811 08:08:45.855582 32186 heartbeater.cc:347] Connected to a master server at 127.27.243.254:36037
I20260811 08:08:45.855669 32186 heartbeater.cc:464] Registering TS with master...
I20260811 08:08:45.855861 32186 heartbeater.cc:511] Master 127.27.243.254:36037 requested a full tablet report, sending...
I20260811 08:08:45.856202 31591 ts_manager.cc:194] Registered new tserver with Master: 555784c7828c4290869f94d157650afa (127.27.243.194:45395)
I20260811 08:08:45.856650 31591 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.243.194@KRBTEST.COM'} at 127.27.243.194:43053
WARNING: no policy specified for kudu/127.27.243.195@KRBTEST.COM; defaulting to no policy
I20260811 08:08:45.862895 31682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:45.856656 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.194:53085 (local address 127.27.243.254:36037)
0811 08:08:45.856689 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:45.856691 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:45.857680 (+ 989us) server_negotiation.cc:407] Connection header received
0811 08:08:45.857706 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:45.857707 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:45.857718 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:45.857777 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:45.858073 (+ 296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:45.858768 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:45.859419 (+ 651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:45.859692 (+ 273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:45.859760 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:45.860520 (+ 760us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:08:45.860521 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:08:45.860521 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:08:45.860529 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:08:45.861879 (+ 1350us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:45.862189 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:45.862190 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:45.862190 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:45.862245 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:45.862405 (+ 160us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:45.862406 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:45.862407 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:45.862549 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:08:45.862608 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:45.862743 (+ 135us) server_negotiation.cc:299] Negotiation successful
0811 08:08:45.862809 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260811 08:08:45.862913 32201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:45.856595 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36037 (local address 127.27.243.194:53085)
0811 08:08:45.857606 (+ 1011us) negotiation.cc:107] Waiting for socket to connect
0811 08:08:45.857617 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 08:08:45.857674 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:08:45.857783 (+ 109us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:08:45.857784 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:08:45.857964 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:08:45.858012 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:45.858013 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:45.858872 (+ 859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:45.858872 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:45.859351 (+ 479us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:45.859353 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:45.859755 (+ 402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:45.859755 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:45.859803 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:45.860186 (+ 383us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:08:45.860190 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:08:45.860440 (+ 250us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:08:45.861955 (+ 1515us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:08:45.861956 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:08:45.861957 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:08:45.862114 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:08:45.862299 (+ 185us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:08:45.862300 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:08:45.862300 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:08:45.862354 (+ 54us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:08:45.862609 (+ 255us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:08:45.862610 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:08:45.862655 (+ 45us) client_negotiation.cc:769] Sending connection context
0811 08:08:45.862711 (+ 56us) client_negotiation.cc:240] Negotiation successful
0811 08:08:45.862810 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":985,"thread_start_us":64,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.243.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.243.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.195.keytab.
Entry for principal kudu/127.27.243.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.195.keytab.
I20260811 08:08:45.879690 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435717191469-28623-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435717191469-28623-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435717191469-28623-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435717191469-28623-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.243.195:0
--local_ip_for_outbound_sockets=127.27.243.195
--webserver_interface=127.27.243.195
--webserver_port=0
--tserver_master_addrs=127.27.243.254:36037
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.195.keytab
--principal=kudu/127.27.243.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:36205
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:08:45.963290 32206 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:08:45.963518 32206 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:08:45.963555 32206 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:08:45.964718 32206 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:08:45.964766 32206 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:08:45.964805 32206 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260811 08:08:45.964825 32206 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 08:08:45.964860 32206 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.243.195
I20260811 08:08:45.966355 32206 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:36205
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435717191469-28623-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435717191469-28623-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.195.keytab
--principal=kudu/127.27.243.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.243.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435717191469-28623-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.243.195
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.27.243.254:36037
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32206
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.243.195
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435717191469-28623-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:08:45.966600 32206 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:08:45.966814 32206 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:08:45.971751 32215 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:08:45.971776 32214 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:08:45.971797 32217 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:08:45.972143 32206 server_base.cc:1034] running on GCE node
I20260811 08:08:45.972313 32206 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:08:45.972519 32206 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:08:45.973666 32206 hybrid_clock.cc:648] HybridClock initialized: now 1786435725973640 us; error 31 us; skew 500 ppm
Aug 11 08:08:45 dist-test-slave-7lbf krb5kdc[31515](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435725, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:08:45.976135 32206 init.cc:377] Logged in from keytab as kudu/127.27.243.195@KRBTEST.COM (short username kudu)
I20260811 08:08:45.976521 32206 webserver.cc:460] Webserver started at http://127.27.243.195:38195/ using document root <none> and password file <none>
I20260811 08:08:45.976718 32206 fs_manager.cc:359] Metadata directory not provided
I20260811 08:08:45.976761 32206 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:08:45.976855 32206 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:08:45.977893 32206 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435717191469-28623-0/minicluster-data/ts-2/data/instance:
uuid: "5c466b2db9f74bfc9f58a6e38721d054"
format_stamp: "Formatted at 2026-08-11 08:08:45 on dist-test-slave-7lbf"
server_key: "f8a15e977d16713edc2c71f7f95a5152"
server_key_iv: "8a2978e1bfa808fe56623e79ae95a908"
server_key_version: "encryptionkey@0"
I20260811 08:08:45.978188 32206 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435717191469-28623-0/minicluster-data/ts-2/wal/instance:
uuid: "5c466b2db9f74bfc9f58a6e38721d054"
format_stamp: "Formatted at 2026-08-11 08:08:45 on dist-test-slave-7lbf"
server_key: "f8a15e977d16713edc2c71f7f95a5152"
server_key_iv: "8a2978e1bfa808fe56623e79ae95a908"
server_key_version: "encryptionkey@0"
I20260811 08:08:45.979374 32206 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 08:08:45.980062 32229 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:08:45.980212 32206 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 08:08:45.980310 32206 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435717191469-28623-0/minicluster-data/ts-2/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435717191469-28623-0/minicluster-data/ts-2/wal
uuid: "5c466b2db9f74bfc9f58a6e38721d054"
format_stamp: "Formatted at 2026-08-11 08:08:45 on dist-test-slave-7lbf"
server_key: "f8a15e977d16713edc2c71f7f95a5152"
server_key_iv: "8a2978e1bfa808fe56623e79ae95a908"
server_key_version: "encryptionkey@0"
I20260811 08:08:45.980372 32206 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435717191469-28623-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435717191469-28623-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435717191469-28623-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:08:46.000888 32206 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:08:46.003034 32206 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:08:46.003175 32206 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:08:46.003690 32206 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:08:46.003729 32206 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:08:46.003759 32206 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:08:46.003777 32206 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 08:08:46 dist-test-slave-7lbf krb5kdc[31515](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435725, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.195@KRBTEST.COM for kudu/127.27.243.254@KRBTEST.COM
I20260811 08:08:46.010576 32206 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.195:39831
I20260811 08:08:46.010634 32403 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.195:39831 every 8 connection(s)
I20260811 08:08:46.010977 32206 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435717191469-28623-0/minicluster-data/ts-2/data/info.pb
I20260811 08:08:46.013494 31682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:46.004180 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.195:53619 (local address 127.27.243.254:36037)
0811 08:08:46.004233 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:46.004235 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:46.004498 (+ 263us) server_negotiation.cc:407] Connection header received
0811 08:08:46.005077 (+ 579us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:46.005078 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:46.005093 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:46.005161 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:46.006081 (+ 920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:46.006836 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:46.007989 (+ 1153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:46.008281 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:46.008355 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:46.011118 (+ 2763us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:08:46.011120 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:08:46.011120 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:08:46.011127 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:08:46.012370 (+ 1243us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:46.012710 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:46.012710 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:46.012711 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:46.012755 (+ 44us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:46.012988 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:46.012988 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:46.012988 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:46.013097 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:08:46.013143 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:46.013366 (+ 223us) server_negotiation.cc:299] Negotiation successful
0811 08:08:46.013430 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 08:08:46.013708 32240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:46.004191 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36037 (local address 127.27.243.195:53619)
0811 08:08:46.004375 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0811 08:08:46.004411 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 08:08:46.004946 (+ 535us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:08:46.005268 (+ 322us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:08:46.005272 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:08:46.005639 (+ 367us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:08:46.005984 (+ 345us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:46.005991 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:46.006948 (+ 957us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:46.006950 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:46.007919 (+ 969us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:46.007921 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:46.008371 (+ 450us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:46.008372 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:46.008504 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:46.009349 (+ 845us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:08:46.009357 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:08:46.011033 (+ 1676us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:08:46.012438 (+ 1405us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:08:46.012445 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:08:46.012446 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:08:46.012654 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:08:46.012836 (+ 182us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:08:46.012836 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:08:46.012836 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:08:46.012942 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:08:46.013141 (+ 199us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:08:46.013144 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:08:46.013257 (+ 113us) client_negotiation.cc:769] Sending connection context
0811 08:08:46.013347 (+ 90us) client_negotiation.cc:240] Negotiation successful
0811 08:08:46.013466 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":102,"threads_started":1}
I20260811 08:08:46.014151 32404 heartbeater.cc:347] Connected to a master server at 127.27.243.254:36037
I20260811 08:08:46.014264 32404 heartbeater.cc:464] Registering TS with master...
I20260811 08:08:46.014484 32404 heartbeater.cc:511] Master 127.27.243.254:36037 requested a full tablet report, sending...
I20260811 08:08:46.014828 31594 ts_manager.cc:194] Registered new tserver with Master: 5c466b2db9f74bfc9f58a6e38721d054 (127.27.243.195:39831)
I20260811 08:08:46.015113 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 32206
I20260811 08:08:46.015211 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435717191469-28623-0/minicluster-data/ts-2/wal/instance
I20260811 08:08:46.015331 31594 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.243.195@KRBTEST.COM'} at 127.27.243.195:53619
I20260811 08:08:46.015409 28623 external_mini_cluster.cc:1428] Setting key d28b74bd573c5b14f6065bddd3707b78
I20260811 08:08:46.016899 28623 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 08:08:46.021382 32413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:46.015317 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36037 (local address 127.27.243.195:41363)
0811 08:08:46.015474 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0811 08:08:46.015483 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 08:08:46.015538 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:08:46.015685 (+ 147us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:08:46.015686 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:08:46.015878 (+ 192us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:08:46.015940 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:46.015942 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:46.016600 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:46.016601 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:46.017229 (+ 628us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:46.017231 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:46.017590 (+ 359us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:46.017591 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:46.017657 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:46.018169 (+ 512us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:08:46.018174 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:08:46.018462 (+ 288us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:08:46.020165 (+ 1703us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:08:46.020166 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:08:46.020166 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:08:46.020593 (+ 427us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:08:46.020803 (+ 210us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:08:46.020804 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:08:46.020804 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:08:46.020874 (+ 70us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:08:46.021135 (+ 261us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:08:46.021136 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:08:46.021182 (+ 46us) client_negotiation.cc:769] Sending connection context
0811 08:08:46.021234 (+ 52us) client_negotiation.cc:240] Negotiation successful
0811 08:08:46.021311 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":63,"threads_started":1}
I20260811 08:08:46.021452 31682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:46.015242 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.195:41363 (local address 127.27.243.254:36037)
0811 08:08:46.015278 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:46.015279 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:46.015539 (+ 260us) server_negotiation.cc:407] Connection header received
0811 08:08:46.015591 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:46.015592 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:46.015601 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:46.015646 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:46.016000 (+ 354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:46.016513 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:46.017300 (+ 787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:46.017504 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:46.017588 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:46.018557 (+ 969us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:08:46.018559 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:08:46.018559 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:08:46.018566 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:08:46.020046 (+ 1480us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:46.020664 (+ 618us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:46.020665 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:46.020665 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:46.020734 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:46.020929 (+ 195us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:46.020930 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:46.020930 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:46.021059 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:08:46.021139 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:46.021278 (+ 139us) server_negotiation.cc:299] Negotiation successful
0811 08:08:46.021364 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
Aug 11 08:08:46 dist-test-slave-7lbf krb5kdc[31515](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435726, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 08:08:46 dist-test-slave-7lbf krb5kdc[31515](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435726, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.243.254@KRBTEST.COM
I20260811 08:08:46.041201 31682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:46.034822 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49258 (local address 127.27.243.254:36037)
0811 08:08:46.034883 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:46.034885 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:46.034894 (+ 9us) server_negotiation.cc:407] Connection header received
0811 08:08:46.034919 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:46.034920 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:46.034928 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:46.034977 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:46.035485 (+ 508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:46.036000 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:46.036682 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:46.036903 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:46.036957 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:46.039110 (+ 2153us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:08:46.039112 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:08:46.039112 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:08:46.039120 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:08:46.040254 (+ 1134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:46.040553 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:46.040554 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:46.040554 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:46.040599 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:46.040725 (+ 126us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:46.040725 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:46.040725 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:46.040849 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:08:46.040924 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:46.041076 (+ 152us) server_negotiation.cc:299] Negotiation successful
0811 08:08:46.041134 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 08:08:46.042934 31594 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49258:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 08:08:46.044584 31594 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 08:08:46.050899 32451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:46.047241 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.195:39831 (local address 127.0.0.1:41816)
0811 08:08:46.047356 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0811 08:08:46.047365 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 08:08:46.047408 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:08:46.047654 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:08:46.047654 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:08:46.047656 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:08:46.047691 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:46.047692 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:46.048530 (+ 838us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:46.048532 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:46.049356 (+ 824us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:46.049359 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:46.050559 (+ 1200us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:46.050560 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:46.050639 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:46.050652 (+ 13us) client_negotiation.cc:769] Sending connection context
0811 08:08:46.050725 (+ 73us) client_negotiation.cc:240] Negotiation successful
0811 08:08:46.050780 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":64,"threads_started":1}
I20260811 08:08:46.050918 32453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:46.047342 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41816 (local address 127.27.243.195:39831)
0811 08:08:46.047498 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:46.047503 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:46.047514 (+ 11us) server_negotiation.cc:407] Connection header received
0811 08:08:46.047553 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:46.047554 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:46.047569 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:46.047646 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:08:46.047757 (+ 111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:46.048447 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:46.049510 (+ 1063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:46.050371 (+ 861us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:46.050436 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:46.050492 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:46.050758 (+ 266us) server_negotiation.cc:299] Negotiation successful
0811 08:08:46.050817 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":125,"thread_start_us":84,"threads_started":1}
I20260811 08:08:46.051084 32445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:46.046913 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49652 (local address 127.27.243.194:45395)
0811 08:08:46.047117 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:46.047122 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:46.047135 (+ 13us) server_negotiation.cc:407] Connection header received
0811 08:08:46.047177 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:46.047179 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:46.047195 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:46.047272 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:08:46.047549 (+ 277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:46.048314 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:46.049820 (+ 1506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:46.050523 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:46.050608 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:46.050663 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:46.050942 (+ 279us) server_negotiation.cc:299] Negotiation successful
0811 08:08:46.050984 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":170,"thread_start_us":94,"threads_started":1}
I20260811 08:08:46.050899 32442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:46.046787 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.194:45395 (local address 127.0.0.1:49652)
0811 08:08:46.046936 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0811 08:08:46.046975 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 08:08:46.047035 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:08:46.047377 (+ 342us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:08:46.047381 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:08:46.047383 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:08:46.047470 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:46.047472 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:46.048387 (+ 915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:46.048388 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:46.049732 (+ 1344us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:46.049735 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:46.050695 (+ 960us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:46.050696 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:46.050751 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:46.050754 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 08:08:46.050794 (+ 40us) client_negotiation.cc:240] Negotiation successful
0811 08:08:46.050826 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"mutex_wait_us":34,"thread_start_us":103,"threads_started":1}
I20260811 08:08:46.051707 32302 tablet_service.cc:1467] Processing CreateTablet for tablet 0f8a9a9084b6484c82f5513183a09e34 (DEFAULT_TABLE table=test-table [id=7bf5c8d8ff27437ca61b04bba3da2c01]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:08:46.051853 32062 tablet_service.cc:1467] Processing CreateTablet for tablet 0f8a9a9084b6484c82f5513183a09e34 (DEFAULT_TABLE table=test-table [id=7bf5c8d8ff27437ca61b04bba3da2c01]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:08:46.052076 32302 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0f8a9a9084b6484c82f5513183a09e34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:08:46.052184 32062 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0f8a9a9084b6484c82f5513183a09e34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:08:46.054666 32455 tablet_bootstrap.cc:492] T 0f8a9a9084b6484c82f5513183a09e34 P 5c466b2db9f74bfc9f58a6e38721d054: Bootstrap starting.
I20260811 08:08:46.055052 32458 tablet_bootstrap.cc:492] T 0f8a9a9084b6484c82f5513183a09e34 P 555784c7828c4290869f94d157650afa: Bootstrap starting.
I20260811 08:08:46.055434 32449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:46.046786 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.193:40561 (local address 127.0.0.1:51446)
0811 08:08:46.047175 (+ 389us) negotiation.cc:107] Waiting for socket to connect
0811 08:08:46.047183 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 08:08:46.047216 (+ 33us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:08:46.048616 (+ 1400us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:08:46.048617 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:08:46.048619 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:08:46.048654 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:46.048655 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:46.049866 (+ 1211us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:46.049867 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:46.050554 (+ 687us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:46.050556 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:46.055195 (+ 4639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:46.055197 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:46.055268 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:46.055273 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 08:08:46.055318 (+ 45us) client_negotiation.cc:240] Negotiation successful
0811 08:08:46.055365 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":370,"mutex_wait_us":17,"thread_start_us":324,"threads_started":1}
I20260811 08:08:46.055692 32455 tablet_bootstrap.cc:654] T 0f8a9a9084b6484c82f5513183a09e34 P 5c466b2db9f74bfc9f58a6e38721d054: Neither blocks nor log segments found. Creating new log.
I20260811 08:08:46.055720 32458 tablet_bootstrap.cc:654] T 0f8a9a9084b6484c82f5513183a09e34 P 555784c7828c4290869f94d157650afa: Neither blocks nor log segments found. Creating new log.
I20260811 08:08:46.055856 32447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:46.046913 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51446 (local address 127.27.243.193:40561)
0811 08:08:46.048464 (+ 1551us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:46.048468 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:46.048478 (+ 10us) server_negotiation.cc:407] Connection header received
0811 08:08:46.048515 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:46.048516 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:46.048531 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:46.048608 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:08:46.048712 (+ 104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:46.049800 (+ 1088us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:46.050634 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:46.055083 (+ 4449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:46.055606 (+ 523us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:46.055687 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:46.055715 (+ 28us) server_negotiation.cc:299] Negotiation successful
0811 08:08:46.055757 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1511,"thread_start_us":91,"threads_started":1}
I20260811 08:08:46.056044 32455 log.cc:824] T 0f8a9a9084b6484c82f5513183a09e34 P 5c466b2db9f74bfc9f58a6e38721d054: Log is configured to *not* fsync() on all Append() calls
I20260811 08:08:46.056061 32458 log.cc:824] T 0f8a9a9084b6484c82f5513183a09e34 P 555784c7828c4290869f94d157650afa: Log is configured to *not* fsync() on all Append() calls
I20260811 08:08:46.056510 31830 tablet_service.cc:1467] Processing CreateTablet for tablet 0f8a9a9084b6484c82f5513183a09e34 (DEFAULT_TABLE table=test-table [id=7bf5c8d8ff27437ca61b04bba3da2c01]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:08:46.056803 32458 tablet_bootstrap.cc:492] T 0f8a9a9084b6484c82f5513183a09e34 P 555784c7828c4290869f94d157650afa: No bootstrap required, opened a new log
I20260811 08:08:46.056813 32455 tablet_bootstrap.cc:492] T 0f8a9a9084b6484c82f5513183a09e34 P 5c466b2db9f74bfc9f58a6e38721d054: No bootstrap required, opened a new log
I20260811 08:08:46.056864 31830 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0f8a9a9084b6484c82f5513183a09e34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:08:46.056879 32455 ts_tablet_manager.cc:1397] T 0f8a9a9084b6484c82f5513183a09e34 P 5c466b2db9f74bfc9f58a6e38721d054: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 08:08:46.056879 32458 ts_tablet_manager.cc:1397] T 0f8a9a9084b6484c82f5513183a09e34 P 555784c7828c4290869f94d157650afa: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 08:08:46.058815 32458 raft_consensus.cc:348] T 0f8a9a9084b6484c82f5513183a09e34 P 555784c7828c4290869f94d157650afa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "555784c7828c4290869f94d157650afa" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 45395 } } peers { permanent_uuid: "11913dd40ada4fd4b0b51f22d4106c73" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40561 } } peers { permanent_uuid: "5c466b2db9f74bfc9f58a6e38721d054" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 39831 } }
I20260811 08:08:46.058815 32455 raft_consensus.cc:348] T 0f8a9a9084b6484c82f5513183a09e34 P 5c466b2db9f74bfc9f58a6e38721d054 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "555784c7828c4290869f94d157650afa" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 45395 } } peers { permanent_uuid: "11913dd40ada4fd4b0b51f22d4106c73" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40561 } } peers { permanent_uuid: "5c466b2db9f74bfc9f58a6e38721d054" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 39831 } }
I20260811 08:08:46.058970 32458 raft_consensus.cc:374] T 0f8a9a9084b6484c82f5513183a09e34 P 555784c7828c4290869f94d157650afa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:08:46.058970 32455 raft_consensus.cc:374] T 0f8a9a9084b6484c82f5513183a09e34 P 5c466b2db9f74bfc9f58a6e38721d054 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:08:46.059005 32458 raft_consensus.cc:729] T 0f8a9a9084b6484c82f5513183a09e34 P 555784c7828c4290869f94d157650afa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 555784c7828c4290869f94d157650afa, State: Initialized, Role: FOLLOWER
I20260811 08:08:46.059005 32455 raft_consensus.cc:729] T 0f8a9a9084b6484c82f5513183a09e34 P 5c466b2db9f74bfc9f58a6e38721d054 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c466b2db9f74bfc9f58a6e38721d054, State: Initialized, Role: FOLLOWER
I20260811 08:08:46.059121 32455 consensus_queue.cc:260] T 0f8a9a9084b6484c82f5513183a09e34 P 5c466b2db9f74bfc9f58a6e38721d054 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "555784c7828c4290869f94d157650afa" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 45395 } } peers { permanent_uuid: "11913dd40ada4fd4b0b51f22d4106c73" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40561 } } peers { permanent_uuid: "5c466b2db9f74bfc9f58a6e38721d054" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 39831 } }
I20260811 08:08:46.059121 32458 consensus_queue.cc:260] T 0f8a9a9084b6484c82f5513183a09e34 P 555784c7828c4290869f94d157650afa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "555784c7828c4290869f94d157650afa" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 45395 } } peers { permanent_uuid: "11913dd40ada4fd4b0b51f22d4106c73" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40561 } } peers { permanent_uuid: "5c466b2db9f74bfc9f58a6e38721d054" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 39831 } }
I20260811 08:08:46.059376 32458 ts_tablet_manager.cc:1428] T 0f8a9a9084b6484c82f5513183a09e34 P 555784c7828c4290869f94d157650afa: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260811 08:08:46.059376 32455 ts_tablet_manager.cc:1428] T 0f8a9a9084b6484c82f5513183a09e34 P 5c466b2db9f74bfc9f58a6e38721d054: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260811 08:08:46.059432 32404 heartbeater.cc:503] Master 127.27.243.254:36037 was elected leader, sending a full tablet report...
I20260811 08:08:46.059485 32186 heartbeater.cc:503] Master 127.27.243.254:36037 was elected leader, sending a full tablet report...
I20260811 08:08:46.059789 32464 tablet_bootstrap.cc:492] T 0f8a9a9084b6484c82f5513183a09e34 P 11913dd40ada4fd4b0b51f22d4106c73: Bootstrap starting.
I20260811 08:08:46.060425 32464 tablet_bootstrap.cc:654] T 0f8a9a9084b6484c82f5513183a09e34 P 11913dd40ada4fd4b0b51f22d4106c73: Neither blocks nor log segments found. Creating new log.
I20260811 08:08:46.060761 32464 log.cc:824] T 0f8a9a9084b6484c82f5513183a09e34 P 11913dd40ada4fd4b0b51f22d4106c73: Log is configured to *not* fsync() on all Append() calls
I20260811 08:08:46.061369 32464 tablet_bootstrap.cc:492] T 0f8a9a9084b6484c82f5513183a09e34 P 11913dd40ada4fd4b0b51f22d4106c73: No bootstrap required, opened a new log
I20260811 08:08:46.061420 32464 ts_tablet_manager.cc:1397] T 0f8a9a9084b6484c82f5513183a09e34 P 11913dd40ada4fd4b0b51f22d4106c73: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 08:08:46.062817 32464 raft_consensus.cc:348] T 0f8a9a9084b6484c82f5513183a09e34 P 11913dd40ada4fd4b0b51f22d4106c73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "555784c7828c4290869f94d157650afa" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 45395 } } peers { permanent_uuid: "11913dd40ada4fd4b0b51f22d4106c73" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40561 } } peers { permanent_uuid: "5c466b2db9f74bfc9f58a6e38721d054" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 39831 } }
I20260811 08:08:46.062966 32464 raft_consensus.cc:374] T 0f8a9a9084b6484c82f5513183a09e34 P 11913dd40ada4fd4b0b51f22d4106c73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:08:46.063011 32464 raft_consensus.cc:729] T 0f8a9a9084b6484c82f5513183a09e34 P 11913dd40ada4fd4b0b51f22d4106c73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11913dd40ada4fd4b0b51f22d4106c73, State: Initialized, Role: FOLLOWER
I20260811 08:08:46.063112 32464 consensus_queue.cc:260] T 0f8a9a9084b6484c82f5513183a09e34 P 11913dd40ada4fd4b0b51f22d4106c73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "555784c7828c4290869f94d157650afa" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 45395 } } peers { permanent_uuid: "11913dd40ada4fd4b0b51f22d4106c73" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40561 } } peers { permanent_uuid: "5c466b2db9f74bfc9f58a6e38721d054" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 39831 } }
I20260811 08:08:46.063340 32464 ts_tablet_manager.cc:1428] T 0f8a9a9084b6484c82f5513183a09e34 P 11913dd40ada4fd4b0b51f22d4106c73: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 08:08:46.063378 31936 heartbeater.cc:503] Master 127.27.243.254:36037 was elected leader, sending a full tablet report...
W20260811 08:08:46.102356 32188 tablet.cc:2369] T 0f8a9a9084b6484c82f5513183a09e34 P 555784c7828c4290869f94d157650afa: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 08:08:46.188243 31939 tablet.cc:2369] T 0f8a9a9084b6484c82f5513183a09e34 P 11913dd40ada4fd4b0b51f22d4106c73: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 08:08:46.230037 32470 raft_consensus.cc:482] T 0f8a9a9084b6484c82f5513183a09e34 P 11913dd40ada4fd4b0b51f22d4106c73 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:08:46.230180 32470 raft_consensus.cc:504] T 0f8a9a9084b6484c82f5513183a09e34 P 11913dd40ada4fd4b0b51f22d4106c73 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "555784c7828c4290869f94d157650afa" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 45395 } } peers { permanent_uuid: "11913dd40ada4fd4b0b51f22d4106c73" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40561 } } peers { permanent_uuid: "5c466b2db9f74bfc9f58a6e38721d054" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 39831 } }
I20260811 08:08:46.230613 32470 leader_election.cc:288] T 0f8a9a9084b6484c82f5513183a09e34 P 11913dd40ada4fd4b0b51f22d4106c73 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 555784c7828c4290869f94d157650afa (127.27.243.194:45395), 5c466b2db9f74bfc9f58a6e38721d054 (127.27.243.195:39831)
I20260811 08:08:46.233918 32445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:46.231000 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.193:60263 (local address 127.27.243.194:45395)
0811 08:08:46.231045 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:46.231047 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:46.231092 (+ 45us) server_negotiation.cc:407] Connection header received
0811 08:08:46.231196 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:46.231197 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:46.231206 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:46.231235 (+ 29us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:08:46.231475 (+ 240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:46.232176 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:46.233163 (+ 987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:46.233590 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:46.233649 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:46.233660 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:46.233805 (+ 145us) server_negotiation.cc:299] Negotiation successful
0811 08:08:46.233844 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 08:08:46.233946 32472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:46.230798 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.194:45395 (local address 127.27.243.193:60263)
0811 08:08:46.231021 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0811 08:08:46.231031 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 08:08:46.231120 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:08:46.231301 (+ 181us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:08:46.231302 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:08:46.231305 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:08:46.231400 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:46.231402 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:46.232280 (+ 878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:46.232281 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:46.233078 (+ 797us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:46.233080 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:46.233671 (+ 591us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:46.233672 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:46.233741 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:46.233745 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 08:08:46.233790 (+ 45us) client_negotiation.cc:240] Negotiation successful
0811 08:08:46.233832 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":209,"mutex_wait_us":33,"thread_start_us":70,"threads_started":1}
I20260811 08:08:46.233963 32453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:46.230897 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.193:58557 (local address 127.27.243.195:39831)
0811 08:08:46.230946 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:46.230948 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:46.231025 (+ 77us) server_negotiation.cc:407] Connection header received
0811 08:08:46.231132 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:46.231133 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:46.231143 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:46.231185 (+ 42us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:08:46.231399 (+ 214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:46.232161 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:46.233190 (+ 1029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:46.233626 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:46.233702 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:46.233712 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:46.233853 (+ 141us) server_negotiation.cc:299] Negotiation successful
0811 08:08:46.233894 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 08:08:46.234114 32471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:46.230798 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.195:39831 (local address 127.27.243.193:58557)
0811 08:08:46.230950 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0811 08:08:46.230960 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 08:08:46.231059 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:08:46.231239 (+ 180us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:08:46.231240 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:08:46.231243 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:08:46.231317 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:46.231320 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:46.232257 (+ 937us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:46.232258 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:46.233094 (+ 836us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:46.233097 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:46.233716 (+ 619us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:46.233717 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:46.233785 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:46.233788 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 08:08:46.233841 (+ 53us) client_negotiation.cc:240] Negotiation successful
0811 08:08:46.233882 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"mutex_wait_us":39,"thread_start_us":130,"threads_started":1}
I20260811 08:08:46.234247 32096 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f8a9a9084b6484c82f5513183a09e34" candidate_uuid: "11913dd40ada4fd4b0b51f22d4106c73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "555784c7828c4290869f94d157650afa" is_pre_election: true
I20260811 08:08:46.234416 32096 raft_consensus.cc:2454] T 0f8a9a9084b6484c82f5513183a09e34 P 555784c7828c4290869f94d157650afa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 11913dd40ada4fd4b0b51f22d4106c73 in term 0.
I20260811 08:08:46.234490 32337 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f8a9a9084b6484c82f5513183a09e34" candidate_uuid: "11913dd40ada4fd4b0b51f22d4106c73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c466b2db9f74bfc9f58a6e38721d054" is_pre_election: true
I20260811 08:08:46.234648 32337 raft_consensus.cc:2454] T 0f8a9a9084b6484c82f5513183a09e34 P 5c466b2db9f74bfc9f58a6e38721d054 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 11913dd40ada4fd4b0b51f22d4106c73 in term 0.
I20260811 08:08:46.234647 31744 leader_election.cc:302] T 0f8a9a9084b6484c82f5513183a09e34 P 11913dd40ada4fd4b0b51f22d4106c73 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11913dd40ada4fd4b0b51f22d4106c73, 555784c7828c4290869f94d157650afa; no voters:
I20260811 08:08:46.234783 32470 raft_consensus.cc:2781] T 0f8a9a9084b6484c82f5513183a09e34 P 11913dd40ada4fd4b0b51f22d4106c73 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 08:08:46.234854 32470 raft_consensus.cc:482] T 0f8a9a9084b6484c82f5513183a09e34 P 11913dd40ada4fd4b0b51f22d4106c73 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 08:08:46.234877 32470 raft_consensus.cc:3037] T 0f8a9a9084b6484c82f5513183a09e34 P 11913dd40ada4fd4b0b51f22d4106c73 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:08:46.235534 32470 raft_consensus.cc:504] T 0f8a9a9084b6484c82f5513183a09e34 P 11913dd40ada4fd4b0b51f22d4106c73 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "555784c7828c4290869f94d157650afa" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 45395 } } peers { permanent_uuid: "11913dd40ada4fd4b0b51f22d4106c73" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40561 } } peers { permanent_uuid: "5c466b2db9f74bfc9f58a6e38721d054" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 39831 } }
I20260811 08:08:46.235647 32470 leader_election.cc:288] T 0f8a9a9084b6484c82f5513183a09e34 P 11913dd40ada4fd4b0b51f22d4106c73 [CANDIDATE]: Term 1 election: Requested vote from peers 555784c7828c4290869f94d157650afa (127.27.243.194:45395), 5c466b2db9f74bfc9f58a6e38721d054 (127.27.243.195:39831)
I20260811 08:08:46.235793 32096 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f8a9a9084b6484c82f5513183a09e34" candidate_uuid: "11913dd40ada4fd4b0b51f22d4106c73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "555784c7828c4290869f94d157650afa"
I20260811 08:08:46.235816 32337 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f8a9a9084b6484c82f5513183a09e34" candidate_uuid: "11913dd40ada4fd4b0b51f22d4106c73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c466b2db9f74bfc9f58a6e38721d054"
I20260811 08:08:46.235872 32096 raft_consensus.cc:3037] T 0f8a9a9084b6484c82f5513183a09e34 P 555784c7828c4290869f94d157650afa [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:08:46.235885 32337 raft_consensus.cc:3037] T 0f8a9a9084b6484c82f5513183a09e34 P 5c466b2db9f74bfc9f58a6e38721d054 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:08:46.236537 32096 raft_consensus.cc:2454] T 0f8a9a9084b6484c82f5513183a09e34 P 555784c7828c4290869f94d157650afa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11913dd40ada4fd4b0b51f22d4106c73 in term 1.
I20260811 08:08:46.236630 32337 raft_consensus.cc:2454] T 0f8a9a9084b6484c82f5513183a09e34 P 5c466b2db9f74bfc9f58a6e38721d054 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11913dd40ada4fd4b0b51f22d4106c73 in term 1.
I20260811 08:08:46.236693 31744 leader_election.cc:302] T 0f8a9a9084b6484c82f5513183a09e34 P 11913dd40ada4fd4b0b51f22d4106c73 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11913dd40ada4fd4b0b51f22d4106c73, 555784c7828c4290869f94d157650afa; no voters:
I20260811 08:08:46.236781 32470 raft_consensus.cc:2781] T 0f8a9a9084b6484c82f5513183a09e34 P 11913dd40ada4fd4b0b51f22d4106c73 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:08:46.236896 32470 raft_consensus.cc:686] T 0f8a9a9084b6484c82f5513183a09e34 P 11913dd40ada4fd4b0b51f22d4106c73 [term 1 LEADER]: Becoming Leader. State: Replica: 11913dd40ada4fd4b0b51f22d4106c73, State: Running, Role: LEADER
I20260811 08:08:46.236989 32470 consensus_queue.cc:237] T 0f8a9a9084b6484c82f5513183a09e34 P 11913dd40ada4fd4b0b51f22d4106c73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "555784c7828c4290869f94d157650afa" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 45395 } } peers { permanent_uuid: "11913dd40ada4fd4b0b51f22d4106c73" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40561 } } peers { permanent_uuid: "5c466b2db9f74bfc9f58a6e38721d054" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 39831 } }
I20260811 08:08:46.237809 31594 catalog_manager.cc:5495] T 0f8a9a9084b6484c82f5513183a09e34 P 11913dd40ada4fd4b0b51f22d4106c73 reported cstate change: term changed from 0 to 1, leader changed from <none> to 11913dd40ada4fd4b0b51f22d4106c73 (127.27.243.193). New cstate: current_term: 1 leader_uuid: "11913dd40ada4fd4b0b51f22d4106c73" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "555784c7828c4290869f94d157650afa" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 45395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11913dd40ada4fd4b0b51f22d4106c73" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c466b2db9f74bfc9f58a6e38721d054" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 39831 } health_report { overall_health: UNKNOWN } } }
W20260811 08:08:46.261582 32405 tablet.cc:2369] T 0f8a9a9084b6484c82f5513183a09e34 P 5c466b2db9f74bfc9f58a6e38721d054: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 11 08:08:46 dist-test-slave-7lbf krb5kdc[31515](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435725, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.254@KRBTEST.COM for kudu/127.27.243.254@KRBTEST.COM
I20260811 08:08:46.301501 31682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:46.294227 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49266 (local address 127.27.243.254:36037)
0811 08:08:46.294269 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:46.294271 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:46.294405 (+ 134us) server_negotiation.cc:407] Connection header received
0811 08:08:46.294460 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:46.294460 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:46.294469 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:46.294531 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:46.294961 (+ 430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:46.295437 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:46.296246 (+ 809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:46.296537 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:46.296605 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:46.299231 (+ 2626us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:08:46.299232 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:08:46.299233 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:08:46.299239 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:08:46.300395 (+ 1156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:46.300755 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:46.300757 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:46.300757 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:46.300831 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:46.301031 (+ 200us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:46.301031 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:46.301032 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:46.301133 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:08:46.301186 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:46.301325 (+ 139us) server_negotiation.cc:299] Negotiation successful
0811 08:08:46.301408 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 08:08:46.301605 32483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:46.294165 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36037 (local address 127.0.0.1:49266)
0811 08:08:46.294334 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0811 08:08:46.294344 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 08:08:46.294411 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:08:46.294523 (+ 112us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:08:46.294523 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:08:46.294844 (+ 321us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:08:46.294898 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:46.294901 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:46.295497 (+ 596us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:46.295497 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:46.296121 (+ 624us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:46.296123 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:46.296620 (+ 497us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:46.296622 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:46.296705 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:46.297304 (+ 599us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:08:46.297311 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:08:46.299160 (+ 1849us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:08:46.300467 (+ 1307us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:08:46.300475 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:08:46.300478 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:08:46.300671 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:08:46.300921 (+ 250us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:08:46.300921 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:08:46.300922 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:08:46.300982 (+ 60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:08:46.301186 (+ 204us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:08:46.301194 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:08:46.301239 (+ 45us) client_negotiation.cc:769] Sending connection context
0811 08:08:46.301296 (+ 57us) client_negotiation.cc:240] Negotiation successful
0811 08:08:46.301480 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"mutex_wait_us":82,"thread_start_us":74,"threads_started":1}
I20260811 08:08:46.303399 31594 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.27.243.254@KRBTEST.COM'} at 127.0.0.1:49266:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260811 08:08:46.303589 31594 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 08:08:46.305063 31830 tablet_service.cc:1467] Processing CreateTablet for tablet 34754142fbea4748b28b35adba9b2fa9 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=40cd32de7c4e4656860aa601512c859d]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 08:08:46.305085 32062 tablet_service.cc:1467] Processing CreateTablet for tablet 34754142fbea4748b28b35adba9b2fa9 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=40cd32de7c4e4656860aa601512c859d]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 08:08:46.305227 32062 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 34754142fbea4748b28b35adba9b2fa9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:08:46.305238 31830 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 34754142fbea4748b28b35adba9b2fa9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:08:46.305683 32302 tablet_service.cc:1467] Processing CreateTablet for tablet 34754142fbea4748b28b35adba9b2fa9 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=40cd32de7c4e4656860aa601512c859d]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 08:08:46.305859 32302 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 34754142fbea4748b28b35adba9b2fa9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:08:46.306744 32458 tablet_bootstrap.cc:492] T 34754142fbea4748b28b35adba9b2fa9 P 555784c7828c4290869f94d157650afa: Bootstrap starting.
I20260811 08:08:46.307260 32455 tablet_bootstrap.cc:492] T 34754142fbea4748b28b35adba9b2fa9 P 5c466b2db9f74bfc9f58a6e38721d054: Bootstrap starting.
I20260811 08:08:46.307415 32458 tablet_bootstrap.cc:654] T 34754142fbea4748b28b35adba9b2fa9 P 555784c7828c4290869f94d157650afa: Neither blocks nor log segments found. Creating new log.
I20260811 08:08:46.307834 32464 tablet_bootstrap.cc:492] T 34754142fbea4748b28b35adba9b2fa9 P 11913dd40ada4fd4b0b51f22d4106c73: Bootstrap starting.
I20260811 08:08:46.307844 32455 tablet_bootstrap.cc:654] T 34754142fbea4748b28b35adba9b2fa9 P 5c466b2db9f74bfc9f58a6e38721d054: Neither blocks nor log segments found. Creating new log.
I20260811 08:08:46.308128 32458 tablet_bootstrap.cc:492] T 34754142fbea4748b28b35adba9b2fa9 P 555784c7828c4290869f94d157650afa: No bootstrap required, opened a new log
I20260811 08:08:46.308162 32458 ts_tablet_manager.cc:1397] T 34754142fbea4748b28b35adba9b2fa9 P 555784c7828c4290869f94d157650afa: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260811 08:08:46.308298 32458 raft_consensus.cc:348] T 34754142fbea4748b28b35adba9b2fa9 P 555784c7828c4290869f94d157650afa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11913dd40ada4fd4b0b51f22d4106c73" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40561 } } peers { permanent_uuid: "555784c7828c4290869f94d157650afa" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 45395 } } peers { permanent_uuid: "5c466b2db9f74bfc9f58a6e38721d054" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 39831 } }
I20260811 08:08:46.308354 32458 raft_consensus.cc:374] T 34754142fbea4748b28b35adba9b2fa9 P 555784c7828c4290869f94d157650afa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:08:46.308341 32464 tablet_bootstrap.cc:654] T 34754142fbea4748b28b35adba9b2fa9 P 11913dd40ada4fd4b0b51f22d4106c73: Neither blocks nor log segments found. Creating new log.
I20260811 08:08:46.308368 32458 raft_consensus.cc:729] T 34754142fbea4748b28b35adba9b2fa9 P 555784c7828c4290869f94d157650afa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 555784c7828c4290869f94d157650afa, State: Initialized, Role: FOLLOWER
I20260811 08:08:46.308442 32458 consensus_queue.cc:260] T 34754142fbea4748b28b35adba9b2fa9 P 555784c7828c4290869f94d157650afa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11913dd40ada4fd4b0b51f22d4106c73" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40561 } } peers { permanent_uuid: "555784c7828c4290869f94d157650afa" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 45395 } } peers { permanent_uuid: "5c466b2db9f74bfc9f58a6e38721d054" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 39831 } }
I20260811 08:08:46.308537 32458 ts_tablet_manager.cc:1428] T 34754142fbea4748b28b35adba9b2fa9 P 555784c7828c4290869f94d157650afa: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 08:08:46.308539 32455 tablet_bootstrap.cc:492] T 34754142fbea4748b28b35adba9b2fa9 P 5c466b2db9f74bfc9f58a6e38721d054: No bootstrap required, opened a new log
I20260811 08:08:46.308578 32455 ts_tablet_manager.cc:1397] T 34754142fbea4748b28b35adba9b2fa9 P 5c466b2db9f74bfc9f58a6e38721d054: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 08:08:46.308621 32461 tablet_replica.cc:439] T 34754142fbea4748b28b35adba9b2fa9 P 555784c7828c4290869f94d157650afa: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11913dd40ada4fd4b0b51f22d4106c73" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40561 } } peers { permanent_uuid: "555784c7828c4290869f94d157650afa" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 45395 } } peers { permanent_uuid: "5c466b2db9f74bfc9f58a6e38721d054" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 39831 } } }
I20260811 08:08:46.308723 32461 tablet_replica.cc:442] T 34754142fbea4748b28b35adba9b2fa9 P 555784c7828c4290869f94d157650afa: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 08:08:46.308717 32455 raft_consensus.cc:348] T 34754142fbea4748b28b35adba9b2fa9 P 5c466b2db9f74bfc9f58a6e38721d054 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11913dd40ada4fd4b0b51f22d4106c73" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40561 } } peers { permanent_uuid: "555784c7828c4290869f94d157650afa" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 45395 } } peers { permanent_uuid: "5c466b2db9f74bfc9f58a6e38721d054" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 39831 } }
I20260811 08:08:46.308789 32455 raft_consensus.cc:374] T 34754142fbea4748b28b35adba9b2fa9 P 5c466b2db9f74bfc9f58a6e38721d054 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:08:46.308815 32455 raft_consensus.cc:729] T 34754142fbea4748b28b35adba9b2fa9 P 5c466b2db9f74bfc9f58a6e38721d054 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c466b2db9f74bfc9f58a6e38721d054, State: Initialized, Role: FOLLOWER
I20260811 08:08:46.308861 32455 consensus_queue.cc:260] T 34754142fbea4748b28b35adba9b2fa9 P 5c466b2db9f74bfc9f58a6e38721d054 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11913dd40ada4fd4b0b51f22d4106c73" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40561 } } peers { permanent_uuid: "555784c7828c4290869f94d157650afa" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 45395 } } peers { permanent_uuid: "5c466b2db9f74bfc9f58a6e38721d054" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 39831 } }
I20260811 08:08:46.308960 32455 ts_tablet_manager.cc:1428] T 34754142fbea4748b28b35adba9b2fa9 P 5c466b2db9f74bfc9f58a6e38721d054: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 08:08:46.309031 32462 tablet_replica.cc:439] T 34754142fbea4748b28b35adba9b2fa9 P 5c466b2db9f74bfc9f58a6e38721d054: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11913dd40ada4fd4b0b51f22d4106c73" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40561 } } peers { permanent_uuid: "555784c7828c4290869f94d157650afa" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 45395 } } peers { permanent_uuid: "5c466b2db9f74bfc9f58a6e38721d054" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 39831 } } }
I20260811 08:08:46.309106 32462 tablet_replica.cc:442] T 34754142fbea4748b28b35adba9b2fa9 P 5c466b2db9f74bfc9f58a6e38721d054: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 08:08:46.309367 32464 tablet_bootstrap.cc:492] T 34754142fbea4748b28b35adba9b2fa9 P 11913dd40ada4fd4b0b51f22d4106c73: No bootstrap required, opened a new log
I20260811 08:08:46.309428 32464 ts_tablet_manager.cc:1397] T 34754142fbea4748b28b35adba9b2fa9 P 11913dd40ada4fd4b0b51f22d4106c73: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 08:08:46.309772 32464 raft_consensus.cc:348] T 34754142fbea4748b28b35adba9b2fa9 P 11913dd40ada4fd4b0b51f22d4106c73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11913dd40ada4fd4b0b51f22d4106c73" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40561 } } peers { permanent_uuid: "555784c7828c4290869f94d157650afa" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 45395 } } peers { permanent_uuid: "5c466b2db9f74bfc9f58a6e38721d054" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 39831 } }
I20260811 08:08:46.309844 32464 raft_consensus.cc:374] T 34754142fbea4748b28b35adba9b2fa9 P 11913dd40ada4fd4b0b51f22d4106c73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:08:46.309859 32464 raft_consensus.cc:729] T 34754142fbea4748b28b35adba9b2fa9 P 11913dd40ada4fd4b0b51f22d4106c73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11913dd40ada4fd4b0b51f22d4106c73, State: Initialized, Role: FOLLOWER
I20260811 08:08:46.309902 32464 consensus_queue.cc:260] T 34754142fbea4748b28b35adba9b2fa9 P 11913dd40ada4fd4b0b51f22d4106c73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11913dd40ada4fd4b0b51f22d4106c73" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40561 } } peers { permanent_uuid: "555784c7828c4290869f94d157650afa" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 45395 } } peers { permanent_uuid: "5c466b2db9f74bfc9f58a6e38721d054" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 39831 } }
I20260811 08:08:46.309999 32464 ts_tablet_manager.cc:1428] T 34754142fbea4748b28b35adba9b2fa9 P 11913dd40ada4fd4b0b51f22d4106c73: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260811 08:08:46.310050 32470 tablet_replica.cc:439] T 34754142fbea4748b28b35adba9b2fa9 P 11913dd40ada4fd4b0b51f22d4106c73: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11913dd40ada4fd4b0b51f22d4106c73" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40561 } } peers { permanent_uuid: "555784c7828c4290869f94d157650afa" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 45395 } } peers { permanent_uuid: "5c466b2db9f74bfc9f58a6e38721d054" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 39831 } } }
I20260811 08:08:46.310137 32470 tablet_replica.cc:442] T 34754142fbea4748b28b35adba9b2fa9 P 11913dd40ada4fd4b0b51f22d4106c73: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 08:08:46.637329 32461 raft_consensus.cc:482] T 34754142fbea4748b28b35adba9b2fa9 P 555784c7828c4290869f94d157650afa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:08:46.637440 32461 raft_consensus.cc:504] T 34754142fbea4748b28b35adba9b2fa9 P 555784c7828c4290869f94d157650afa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11913dd40ada4fd4b0b51f22d4106c73" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40561 } } peers { permanent_uuid: "555784c7828c4290869f94d157650afa" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 45395 } } peers { permanent_uuid: "5c466b2db9f74bfc9f58a6e38721d054" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 39831 } }
I20260811 08:08:46.637826 32461 leader_election.cc:288] T 34754142fbea4748b28b35adba9b2fa9 P 555784c7828c4290869f94d157650afa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 11913dd40ada4fd4b0b51f22d4106c73 (127.27.243.193:40561), 5c466b2db9f74bfc9f58a6e38721d054 (127.27.243.195:39831)
I20260811 08:08:46.642115 32493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:46.638135 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.194:41027 (local address 127.27.243.193:40561)
0811 08:08:46.638267 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:46.638269 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:46.638290 (+ 21us) server_negotiation.cc:407] Connection header received
0811 08:08:46.638327 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:46.638328 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:46.638340 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:46.638491 (+ 151us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:08:46.638668 (+ 177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:46.639479 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:46.641078 (+ 1599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:46.641724 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:46.641799 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:46.641811 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:46.641991 (+ 180us) server_negotiation.cc:299] Negotiation successful
0811 08:08:46.642035 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":103,"thread_start_us":68,"threads_started":1}
I20260811 08:08:46.642112 32453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:46.638356 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.194:41369 (local address 127.27.243.195:39831)
0811 08:08:46.638427 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:46.638429 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:46.638467 (+ 38us) server_negotiation.cc:407] Connection header received
0811 08:08:46.638528 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:46.638529 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:46.638539 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:46.638591 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:08:46.638723 (+ 132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:46.639469 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:46.641082 (+ 1613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:46.641711 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:46.641843 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:46.641852 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:46.641991 (+ 139us) server_negotiation.cc:299] Negotiation successful
0811 08:08:46.642035 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260811 08:08:46.642165 32495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:46.638231 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.195:39831 (local address 127.27.243.194:41369)
0811 08:08:46.638412 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0811 08:08:46.638421 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 08:08:46.638473 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:08:46.638600 (+ 127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:08:46.638601 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:08:46.638602 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:08:46.638659 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:46.638660 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:46.639585 (+ 925us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:46.639586 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:46.640969 (+ 1383us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:46.640973 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:46.641805 (+ 832us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:46.641807 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:46.641911 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:46.641917 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 08:08:46.641977 (+ 60us) client_negotiation.cc:240] Negotiation successful
0811 08:08:46.642040 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":166,"mutex_wait_us":113,"thread_start_us":42,"threads_started":1}
I20260811 08:08:46.642165 32492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:46.638048 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.193:40561 (local address 127.27.243.194:41027)
0811 08:08:46.638168 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0811 08:08:46.638181 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 08:08:46.638241 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:08:46.638515 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:08:46.638515 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:08:46.638519 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:08:46.638582 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:46.638584 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:46.639584 (+ 1000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:46.639585 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:46.640987 (+ 1402us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:46.640989 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:46.641807 (+ 818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:46.641807 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:46.641911 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:46.641918 (+ 7us) client_negotiation.cc:769] Sending connection context
0811 08:08:46.641977 (+ 59us) client_negotiation.cc:240] Negotiation successful
0811 08:08:46.642040 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":101,"mutex_wait_us":51,"thread_start_us":66,"threads_started":1}
I20260811 08:08:46.642416 32337 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34754142fbea4748b28b35adba9b2fa9" candidate_uuid: "555784c7828c4290869f94d157650afa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c466b2db9f74bfc9f58a6e38721d054" is_pre_election: true
I20260811 08:08:46.642517 32337 raft_consensus.cc:2454] T 34754142fbea4748b28b35adba9b2fa9 P 5c466b2db9f74bfc9f58a6e38721d054 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 555784c7828c4290869f94d157650afa in term 0.
I20260811 08:08:46.642673 31856 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34754142fbea4748b28b35adba9b2fa9" candidate_uuid: "555784c7828c4290869f94d157650afa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11913dd40ada4fd4b0b51f22d4106c73" is_pre_election: true
I20260811 08:08:46.642697 31984 leader_election.cc:302] T 34754142fbea4748b28b35adba9b2fa9 P 555784c7828c4290869f94d157650afa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 555784c7828c4290869f94d157650afa, 5c466b2db9f74bfc9f58a6e38721d054; no voters:
I20260811 08:08:46.642796 31856 raft_consensus.cc:2454] T 34754142fbea4748b28b35adba9b2fa9 P 11913dd40ada4fd4b0b51f22d4106c73 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 555784c7828c4290869f94d157650afa in term 0.
I20260811 08:08:46.642836 32461 raft_consensus.cc:2781] T 34754142fbea4748b28b35adba9b2fa9 P 555784c7828c4290869f94d157650afa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 08:08:46.642889 32461 raft_consensus.cc:482] T 34754142fbea4748b28b35adba9b2fa9 P 555784c7828c4290869f94d157650afa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 08:08:46.642910 32461 raft_consensus.cc:3037] T 34754142fbea4748b28b35adba9b2fa9 P 555784c7828c4290869f94d157650afa [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:08:46.643563 32461 raft_consensus.cc:504] T 34754142fbea4748b28b35adba9b2fa9 P 555784c7828c4290869f94d157650afa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11913dd40ada4fd4b0b51f22d4106c73" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40561 } } peers { permanent_uuid: "555784c7828c4290869f94d157650afa" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 45395 } } peers { permanent_uuid: "5c466b2db9f74bfc9f58a6e38721d054" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 39831 } }
I20260811 08:08:46.643678 32461 leader_election.cc:288] T 34754142fbea4748b28b35adba9b2fa9 P 555784c7828c4290869f94d157650afa [CANDIDATE]: Term 1 election: Requested vote from peers 11913dd40ada4fd4b0b51f22d4106c73 (127.27.243.193:40561), 5c466b2db9f74bfc9f58a6e38721d054 (127.27.243.195:39831)
I20260811 08:08:46.643888 32337 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34754142fbea4748b28b35adba9b2fa9" candidate_uuid: "555784c7828c4290869f94d157650afa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c466b2db9f74bfc9f58a6e38721d054"
I20260811 08:08:46.643884 31856 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34754142fbea4748b28b35adba9b2fa9" candidate_uuid: "555784c7828c4290869f94d157650afa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11913dd40ada4fd4b0b51f22d4106c73"
I20260811 08:08:46.643963 32337 raft_consensus.cc:3037] T 34754142fbea4748b28b35adba9b2fa9 P 5c466b2db9f74bfc9f58a6e38721d054 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:08:46.643966 31856 raft_consensus.cc:3037] T 34754142fbea4748b28b35adba9b2fa9 P 11913dd40ada4fd4b0b51f22d4106c73 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:08:46.644565 32337 raft_consensus.cc:2454] T 34754142fbea4748b28b35adba9b2fa9 P 5c466b2db9f74bfc9f58a6e38721d054 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 555784c7828c4290869f94d157650afa in term 1.
I20260811 08:08:46.644696 31856 raft_consensus.cc:2454] T 34754142fbea4748b28b35adba9b2fa9 P 11913dd40ada4fd4b0b51f22d4106c73 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 555784c7828c4290869f94d157650afa in term 1.
I20260811 08:08:46.644742 31984 leader_election.cc:302] T 34754142fbea4748b28b35adba9b2fa9 P 555784c7828c4290869f94d157650afa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 555784c7828c4290869f94d157650afa, 5c466b2db9f74bfc9f58a6e38721d054; no voters:
I20260811 08:08:46.644879 32461 raft_consensus.cc:2781] T 34754142fbea4748b28b35adba9b2fa9 P 555784c7828c4290869f94d157650afa [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:08:46.644987 32461 raft_consensus.cc:686] T 34754142fbea4748b28b35adba9b2fa9 P 555784c7828c4290869f94d157650afa [term 1 LEADER]: Becoming Leader. State: Replica: 555784c7828c4290869f94d157650afa, State: Running, Role: LEADER
I20260811 08:08:46.645088 32461 consensus_queue.cc:237] T 34754142fbea4748b28b35adba9b2fa9 P 555784c7828c4290869f94d157650afa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11913dd40ada4fd4b0b51f22d4106c73" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40561 } } peers { permanent_uuid: "555784c7828c4290869f94d157650afa" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 45395 } } peers { permanent_uuid: "5c466b2db9f74bfc9f58a6e38721d054" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 39831 } }
I20260811 08:08:46.645625 32497 tablet_replica.cc:439] T 34754142fbea4748b28b35adba9b2fa9 P 555784c7828c4290869f94d157650afa: TxnStatusTablet state changed. Reason: New leader 555784c7828c4290869f94d157650afa. Latest consensus state: current_term: 1 leader_uuid: "555784c7828c4290869f94d157650afa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11913dd40ada4fd4b0b51f22d4106c73" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40561 } } peers { permanent_uuid: "555784c7828c4290869f94d157650afa" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 45395 } } peers { permanent_uuid: "5c466b2db9f74bfc9f58a6e38721d054" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 39831 } } }
I20260811 08:08:46.645756 32497 tablet_replica.cc:442] T 34754142fbea4748b28b35adba9b2fa9 P 555784c7828c4290869f94d157650afa: This TxnStatusTablet replica's current role is: LEADER
I20260811 08:08:46.646042 31594 catalog_manager.cc:5495] T 34754142fbea4748b28b35adba9b2fa9 P 555784c7828c4290869f94d157650afa reported cstate change: term changed from 0 to 1, leader changed from <none> to 555784c7828c4290869f94d157650afa (127.27.243.194). New cstate: current_term: 1 leader_uuid: "555784c7828c4290869f94d157650afa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11913dd40ada4fd4b0b51f22d4106c73" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "555784c7828c4290869f94d157650afa" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 45395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c466b2db9f74bfc9f58a6e38721d054" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 39831 } health_report { overall_health: UNKNOWN } } }
I20260811 08:08:46.646337 32501 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260811 08:08:46.646441 32501 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260811 08:08:46.659593 32470 consensus_queue.cc:1035] T 0f8a9a9084b6484c82f5513183a09e34 P 11913dd40ada4fd4b0b51f22d4106c73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c466b2db9f74bfc9f58a6e38721d054" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 39831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:08:46.661725 32470 consensus_queue.cc:1035] T 0f8a9a9084b6484c82f5513183a09e34 P 11913dd40ada4fd4b0b51f22d4106c73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "555784c7828c4290869f94d157650afa" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 45395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:08:46.664693 32483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:46.661048 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.194:45395 (local address 127.0.0.1:49654)
0811 08:08:46.661173 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0811 08:08:46.661183 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 08:08:46.661223 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:08:46.662043 (+ 820us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:08:46.662045 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:08:46.662046 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 08:08:46.662099 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:46.662102 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:46.663034 (+ 932us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:46.663035 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:46.663739 (+ 704us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:46.663742 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:46.664179 (+ 437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:46.664180 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:46.664226 (+ 46us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:46.664242 (+ 16us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 08:08:46.664529 (+ 287us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 08:08:46.664542 (+ 13us) client_negotiation.cc:769] Sending connection context
0811 08:08:46.664590 (+ 48us) client_negotiation.cc:240] Negotiation successful
0811 08:08:46.664636 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":87}
I20260811 08:08:46.664696 32445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:46.661437 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49654 (local address 127.27.243.194:45395)
0811 08:08:46.661477 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:46.661478 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:46.661485 (+ 7us) server_negotiation.cc:407] Connection header received
0811 08:08:46.661538 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:46.661539 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:46.661557 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:46.661621 (+ 64us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:08:46.662183 (+ 562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:46.662959 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:46.663808 (+ 849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:46.664110 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:46.664181 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:46.664320 (+ 139us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:08:46.664446 (+ 126us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:08:46.664521 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:46.664606 (+ 85us) server_negotiation.cc:299] Negotiation successful
0811 08:08:46.664627 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 08:08:46.666209 32337 raft_consensus.cc:1261] T 34754142fbea4748b28b35adba9b2fa9 P 5c466b2db9f74bfc9f58a6e38721d054 [term 1 FOLLOWER]: Refusing update from remote peer 555784c7828c4290869f94d157650afa: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:08:46.666271 31856 raft_consensus.cc:1261] T 34754142fbea4748b28b35adba9b2fa9 P 11913dd40ada4fd4b0b51f22d4106c73 [term 1 FOLLOWER]: Refusing update from remote peer 555784c7828c4290869f94d157650afa: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:08:46.666440 32461 consensus_queue.cc:1035] T 34754142fbea4748b28b35adba9b2fa9 P 555784c7828c4290869f94d157650afa [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c466b2db9f74bfc9f58a6e38721d054" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 39831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:08:46.666549 32497 consensus_queue.cc:1035] T 34754142fbea4748b28b35adba9b2fa9 P 555784c7828c4290869f94d157650afa [LEADER]: Connected to new peer: Peer: permanent_uuid: "11913dd40ada4fd4b0b51f22d4106c73" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:08:46.667503 32470 tablet_replica.cc:439] T 34754142fbea4748b28b35adba9b2fa9 P 11913dd40ada4fd4b0b51f22d4106c73: TxnStatusTablet state changed. Reason: New leader 555784c7828c4290869f94d157650afa. Latest consensus state: current_term: 1 leader_uuid: "555784c7828c4290869f94d157650afa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11913dd40ada4fd4b0b51f22d4106c73" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40561 } } peers { permanent_uuid: "555784c7828c4290869f94d157650afa" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 45395 } } peers { permanent_uuid: "5c466b2db9f74bfc9f58a6e38721d054" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 39831 } } }
I20260811 08:08:46.667586 32470 tablet_replica.cc:442] T 34754142fbea4748b28b35adba9b2fa9 P 11913dd40ada4fd4b0b51f22d4106c73: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 08:08:46.667721 32462 tablet_replica.cc:439] T 34754142fbea4748b28b35adba9b2fa9 P 5c466b2db9f74bfc9f58a6e38721d054: TxnStatusTablet state changed. Reason: New leader 555784c7828c4290869f94d157650afa. Latest consensus state: current_term: 1 leader_uuid: "555784c7828c4290869f94d157650afa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11913dd40ada4fd4b0b51f22d4106c73" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40561 } } peers { permanent_uuid: "555784c7828c4290869f94d157650afa" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 45395 } } peers { permanent_uuid: "5c466b2db9f74bfc9f58a6e38721d054" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 39831 } } }
I20260811 08:08:46.667806 32462 tablet_replica.cc:442] T 34754142fbea4748b28b35adba9b2fa9 P 5c466b2db9f74bfc9f58a6e38721d054: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 08:08:46.668749 32461 tablet_replica.cc:439] T 34754142fbea4748b28b35adba9b2fa9 P 555784c7828c4290869f94d157650afa: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "555784c7828c4290869f94d157650afa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11913dd40ada4fd4b0b51f22d4106c73" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40561 } } peers { permanent_uuid: "555784c7828c4290869f94d157650afa" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 45395 } } peers { permanent_uuid: "5c466b2db9f74bfc9f58a6e38721d054" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 39831 } } }
I20260811 08:08:46.668829 32461 tablet_replica.cc:442] T 34754142fbea4748b28b35adba9b2fa9 P 555784c7828c4290869f94d157650afa: This TxnStatusTablet replica's current role is: LEADER
I20260811 08:08:46.668947 32507 mvcc.cc:205] Tried to move back new op lower bound from 7317240736422903808 to 7317240736338890752. Current Snapshot: MvccSnapshot[applied={T|T < 7317240736422903808}]
I20260811 08:08:46.669113 32462 tablet_replica.cc:439] T 34754142fbea4748b28b35adba9b2fa9 P 5c466b2db9f74bfc9f58a6e38721d054: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "555784c7828c4290869f94d157650afa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11913dd40ada4fd4b0b51f22d4106c73" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40561 } } peers { permanent_uuid: "555784c7828c4290869f94d157650afa" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 45395 } } peers { permanent_uuid: "5c466b2db9f74bfc9f58a6e38721d054" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 39831 } } }
I20260811 08:08:46.669179 32462 tablet_replica.cc:442] T 34754142fbea4748b28b35adba9b2fa9 P 5c466b2db9f74bfc9f58a6e38721d054: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 08:08:46.670107 32497 tablet_replica.cc:439] T 34754142fbea4748b28b35adba9b2fa9 P 555784c7828c4290869f94d157650afa: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "555784c7828c4290869f94d157650afa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11913dd40ada4fd4b0b51f22d4106c73" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40561 } } peers { permanent_uuid: "555784c7828c4290869f94d157650afa" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 45395 } } peers { permanent_uuid: "5c466b2db9f74bfc9f58a6e38721d054" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 39831 } } }
I20260811 08:08:46.670194 32497 tablet_replica.cc:442] T 34754142fbea4748b28b35adba9b2fa9 P 555784c7828c4290869f94d157650afa: This TxnStatusTablet replica's current role is: LEADER
I20260811 08:08:46.670740 32470 tablet_replica.cc:439] T 34754142fbea4748b28b35adba9b2fa9 P 11913dd40ada4fd4b0b51f22d4106c73: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "555784c7828c4290869f94d157650afa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11913dd40ada4fd4b0b51f22d4106c73" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40561 } } peers { permanent_uuid: "555784c7828c4290869f94d157650afa" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 45395 } } peers { permanent_uuid: "5c466b2db9f74bfc9f58a6e38721d054" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 39831 } } }
I20260811 08:08:46.670835 32470 tablet_replica.cc:442] T 34754142fbea4748b28b35adba9b2fa9 P 11913dd40ada4fd4b0b51f22d4106c73: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 08:08:46.676209 32493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:46.670890 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51458 (local address 127.27.243.193:40561)
0811 08:08:46.670929 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:46.670930 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:46.673691 (+ 2761us) server_negotiation.cc:407] Connection header received
0811 08:08:46.673760 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:46.673760 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:46.673775 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:46.673868 (+ 93us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:08:46.674005 (+ 137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:46.674439 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:46.675536 (+ 1097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:46.675719 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:46.675763 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:46.675943 (+ 180us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:08:46.676031 (+ 88us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:08:46.676096 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:46.676142 (+ 46us) server_negotiation.cc:299] Negotiation successful
0811 08:08:46.676162 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 08:08:46.681187 32445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:46.678499 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.193:41485 (local address 127.27.243.194:45395)
0811 08:08:46.678538 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:46.678540 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:46.678675 (+ 135us) server_negotiation.cc:407] Connection header received
0811 08:08:46.678755 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:46.678756 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:46.678766 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:46.678817 (+ 51us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:08:46.678950 (+ 133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:46.679380 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:46.680552 (+ 1172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:46.680767 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:46.680820 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:46.681003 (+ 183us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:08:46.681027 (+ 24us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:08:46.681060 (+ 33us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:46.681129 (+ 69us) server_negotiation.cc:299] Negotiation successful
0811 08:08:46.681144 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 08:08:46.681440 32530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:46.678425 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.194:45395 (local address 127.27.243.193:41485)
0811 08:08:46.678616 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0811 08:08:46.678626 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 08:08:46.678688 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:08:46.678822 (+ 134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:08:46.678822 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:08:46.678824 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 08:08:46.678894 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:46.678895 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:46.679446 (+ 551us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:46.679447 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:46.680470 (+ 1023us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:46.680474 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:46.680836 (+ 362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:46.680836 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:46.680902 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:46.680919 (+ 17us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 08:08:46.681079 (+ 160us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 08:08:46.681081 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 08:08:46.681127 (+ 46us) client_negotiation.cc:240] Negotiation successful
0811 08:08:46.681167 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":82,"threads_started":1}
I20260811 08:08:46.692149 32493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:46.689559 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.194:56561 (local address 127.27.243.193:40561)
0811 08:08:46.689618 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:46.689620 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:46.689692 (+ 72us) server_negotiation.cc:407] Connection header received
0811 08:08:46.689779 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:46.689780 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:46.689788 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:46.689837 (+ 49us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:08:46.689973 (+ 136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:46.690441 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:46.691578 (+ 1137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:46.691757 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:46.691847 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:46.691978 (+ 131us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:08:46.692001 (+ 23us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:08:46.692030 (+ 29us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:46.692093 (+ 63us) server_negotiation.cc:299] Negotiation successful
0811 08:08:46.692108 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 08:08:46.692222 32535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:46.689460 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.193:40561 (local address 127.27.243.194:56561)
0811 08:08:46.689637 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0811 08:08:46.689647 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 08:08:46.689706 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:08:46.689853 (+ 147us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:08:46.689853 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:08:46.689855 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 08:08:46.689919 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:46.689920 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:46.690500 (+ 580us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:46.690501 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:46.691511 (+ 1010us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:46.691514 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:46.691831 (+ 317us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:46.691832 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:46.691892 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:46.691910 (+ 18us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 08:08:46.692046 (+ 136us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 08:08:46.692047 (+ 1us) client_negotiation.cc:769] Sending connection context
0811 08:08:46.692091 (+ 44us) client_negotiation.cc:240] Negotiation successful
0811 08:08:46.692130 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":96,"threads_started":1}
I20260811 08:08:46.701352 31591 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49258:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:08:46.701449 31591 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49258:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:08:46.702241 31591 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 485920145a134f15ae7f4bcdf5db2398: Sending DeleteTablet for 3 replicas of tablet 0f8a9a9084b6484c82f5513183a09e34
I20260811 08:08:46.702545 32062 tablet_service.cc:1514] Processing DeleteTablet for tablet 0f8a9a9084b6484c82f5513183a09e34 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:08:46 UTC) from {username='kudu', principal='kudu/127.27.243.254@KRBTEST.COM'} at 127.0.0.1:49652
I20260811 08:08:46.702670 31830 tablet_service.cc:1514] Processing DeleteTablet for tablet 0f8a9a9084b6484c82f5513183a09e34 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:08:46 UTC) from {username='kudu', principal='kudu/127.27.243.254@KRBTEST.COM'} at 127.0.0.1:51446
I20260811 08:08:46.702857 32302 tablet_service.cc:1514] Processing DeleteTablet for tablet 0f8a9a9084b6484c82f5513183a09e34 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:08:46 UTC) from {username='kudu', principal='kudu/127.27.243.254@KRBTEST.COM'} at 127.0.0.1:41816
I20260811 08:08:46.703076 32549 tablet_replica.cc:330] T 0f8a9a9084b6484c82f5513183a09e34 P 5c466b2db9f74bfc9f58a6e38721d054: stopping tablet replica
I20260811 08:08:46.703222 32549 raft_consensus.cc:2229] T 0f8a9a9084b6484c82f5513183a09e34 P 5c466b2db9f74bfc9f58a6e38721d054 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:08:46.703328 32549 raft_consensus.cc:2258] T 0f8a9a9084b6484c82f5513183a09e34 P 5c466b2db9f74bfc9f58a6e38721d054 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:08:46.703320 31591 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49258:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 08:08:46.703486 31591 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 08:08:46.703948 32549 ts_tablet_manager.cc:1905] T 0f8a9a9084b6484c82f5513183a09e34 P 5c466b2db9f74bfc9f58a6e38721d054: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:08:46.704466 32062 tablet_service.cc:1467] Processing CreateTablet for tablet 123e43c486ac49479926084150d5349c (DEFAULT_TABLE table=test-table [id=764883c59e294d38b25df1dc397a62a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:08:46.704587 32062 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 123e43c486ac49479926084150d5349c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:08:46.705905 32458 tablet_bootstrap.cc:492] T 123e43c486ac49479926084150d5349c P 555784c7828c4290869f94d157650afa: Bootstrap starting.
I20260811 08:08:46.706023 32549 ts_tablet_manager.cc:1918] T 0f8a9a9084b6484c82f5513183a09e34 P 5c466b2db9f74bfc9f58a6e38721d054: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 08:08:46.706147 32549 log.cc:1196] T 0f8a9a9084b6484c82f5513183a09e34 P 5c466b2db9f74bfc9f58a6e38721d054: Deleting WAL directory at /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435717191469-28623-0/minicluster-data/ts-2/wal/wals/0f8a9a9084b6484c82f5513183a09e34
I20260811 08:08:46.706255 32458 tablet_bootstrap.cc:654] T 123e43c486ac49479926084150d5349c P 555784c7828c4290869f94d157650afa: Neither blocks nor log segments found. Creating new log.
I20260811 08:08:46.706532 32549 ts_tablet_manager.cc:1939] T 0f8a9a9084b6484c82f5513183a09e34 P 5c466b2db9f74bfc9f58a6e38721d054: Deleting consensus metadata
I20260811 08:08:46.706868 31830 tablet_service.cc:1467] Processing CreateTablet for tablet 123e43c486ac49479926084150d5349c (DEFAULT_TABLE table=test-table [id=764883c59e294d38b25df1dc397a62a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:08:46.706984 31830 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 123e43c486ac49479926084150d5349c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:08:46.708266 32464 tablet_bootstrap.cc:492] T 123e43c486ac49479926084150d5349c P 11913dd40ada4fd4b0b51f22d4106c73: Bootstrap starting.
I20260811 08:08:46.708671 32464 tablet_bootstrap.cc:654] T 123e43c486ac49479926084150d5349c P 11913dd40ada4fd4b0b51f22d4106c73: Neither blocks nor log segments found. Creating new log.
I20260811 08:08:46.709113 32302 tablet_service.cc:1467] Processing CreateTablet for tablet 123e43c486ac49479926084150d5349c (DEFAULT_TABLE table=test-table [id=764883c59e294d38b25df1dc397a62a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:08:46.709209 32302 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 123e43c486ac49479926084150d5349c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:08:46.709278 32464 tablet_bootstrap.cc:492] T 123e43c486ac49479926084150d5349c P 11913dd40ada4fd4b0b51f22d4106c73: No bootstrap required, opened a new log
I20260811 08:08:46.709322 32464 ts_tablet_manager.cc:1397] T 123e43c486ac49479926084150d5349c P 11913dd40ada4fd4b0b51f22d4106c73: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 08:08:46.709453 32464 raft_consensus.cc:348] T 123e43c486ac49479926084150d5349c P 11913dd40ada4fd4b0b51f22d4106c73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11913dd40ada4fd4b0b51f22d4106c73" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40561 } } peers { permanent_uuid: "555784c7828c4290869f94d157650afa" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 45395 } } peers { permanent_uuid: "5c466b2db9f74bfc9f58a6e38721d054" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 39831 } }
I20260811 08:08:46.709537 32464 raft_consensus.cc:374] T 123e43c486ac49479926084150d5349c P 11913dd40ada4fd4b0b51f22d4106c73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:08:46.709558 32464 raft_consensus.cc:729] T 123e43c486ac49479926084150d5349c P 11913dd40ada4fd4b0b51f22d4106c73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11913dd40ada4fd4b0b51f22d4106c73, State: Initialized, Role: FOLLOWER
I20260811 08:08:46.709596 32464 consensus_queue.cc:260] T 123e43c486ac49479926084150d5349c P 11913dd40ada4fd4b0b51f22d4106c73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11913dd40ada4fd4b0b51f22d4106c73" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40561 } } peers { permanent_uuid: "555784c7828c4290869f94d157650afa" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 45395 } } peers { permanent_uuid: "5c466b2db9f74bfc9f58a6e38721d054" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 39831 } }
I20260811 08:08:46.709679 32464 ts_tablet_manager.cc:1428] T 123e43c486ac49479926084150d5349c P 11913dd40ada4fd4b0b51f22d4106c73: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 08:08:46.710330 32455 tablet_bootstrap.cc:492] T 123e43c486ac49479926084150d5349c P 5c466b2db9f74bfc9f58a6e38721d054: Bootstrap starting.
I20260811 08:08:46.710731 32455 tablet_bootstrap.cc:654] T 123e43c486ac49479926084150d5349c P 5c466b2db9f74bfc9f58a6e38721d054: Neither blocks nor log segments found. Creating new log.
I20260811 08:08:46.711232 31566 catalog_manager.cc:4841] TS 5c466b2db9f74bfc9f58a6e38721d054 (127.27.243.195:39831): tablet 0f8a9a9084b6484c82f5513183a09e34 (table test-table [id=7bf5c8d8ff27437ca61b04bba3da2c01]) successfully deleted
I20260811 08:08:46.711319 32455 tablet_bootstrap.cc:492] T 123e43c486ac49479926084150d5349c P 5c466b2db9f74bfc9f58a6e38721d054: No bootstrap required, opened a new log
I20260811 08:08:46.711359 32455 ts_tablet_manager.cc:1397] T 123e43c486ac49479926084150d5349c P 5c466b2db9f74bfc9f58a6e38721d054: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 08:08:46.711488 32455 raft_consensus.cc:348] T 123e43c486ac49479926084150d5349c P 5c466b2db9f74bfc9f58a6e38721d054 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11913dd40ada4fd4b0b51f22d4106c73" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40561 } } peers { permanent_uuid: "555784c7828c4290869f94d157650afa" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 45395 } } peers { permanent_uuid: "5c466b2db9f74bfc9f58a6e38721d054" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 39831 } }
I20260811 08:08:46.711544 32455 raft_consensus.cc:374] T 123e43c486ac49479926084150d5349c P 5c466b2db9f74bfc9f58a6e38721d054 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:08:46.711563 32455 raft_consensus.cc:729] T 123e43c486ac49479926084150d5349c P 5c466b2db9f74bfc9f58a6e38721d054 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c466b2db9f74bfc9f58a6e38721d054, State: Initialized, Role: FOLLOWER
I20260811 08:08:46.711606 32455 consensus_queue.cc:260] T 123e43c486ac49479926084150d5349c P 5c466b2db9f74bfc9f58a6e38721d054 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11913dd40ada4fd4b0b51f22d4106c73" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40561 } } peers { permanent_uuid: "555784c7828c4290869f94d157650afa" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 45395 } } peers { permanent_uuid: "5c466b2db9f74bfc9f58a6e38721d054" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 39831 } }
I20260811 08:08:46.711678 32455 ts_tablet_manager.cc:1428] T 123e43c486ac49479926084150d5349c P 5c466b2db9f74bfc9f58a6e38721d054: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 08:08:46.712598 32458 tablet_bootstrap.cc:492] T 123e43c486ac49479926084150d5349c P 555784c7828c4290869f94d157650afa: No bootstrap required, opened a new log
I20260811 08:08:46.712652 32458 ts_tablet_manager.cc:1397] T 123e43c486ac49479926084150d5349c P 555784c7828c4290869f94d157650afa: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.001s
I20260811 08:08:46.712780 32458 raft_consensus.cc:348] T 123e43c486ac49479926084150d5349c P 555784c7828c4290869f94d157650afa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11913dd40ada4fd4b0b51f22d4106c73" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40561 } } peers { permanent_uuid: "555784c7828c4290869f94d157650afa" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 45395 } } peers { permanent_uuid: "5c466b2db9f74bfc9f58a6e38721d054" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 39831 } }
I20260811 08:08:46.712847 32458 raft_consensus.cc:374] T 123e43c486ac49479926084150d5349c P 555784c7828c4290869f94d157650afa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:08:46.712867 32458 raft_consensus.cc:729] T 123e43c486ac49479926084150d5349c P 555784c7828c4290869f94d157650afa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 555784c7828c4290869f94d157650afa, State: Initialized, Role: FOLLOWER
I20260811 08:08:46.712908 32458 consensus_queue.cc:260] T 123e43c486ac49479926084150d5349c P 555784c7828c4290869f94d157650afa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11913dd40ada4fd4b0b51f22d4106c73" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40561 } } peers { permanent_uuid: "555784c7828c4290869f94d157650afa" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 45395 } } peers { permanent_uuid: "5c466b2db9f74bfc9f58a6e38721d054" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 39831 } }
I20260811 08:08:46.712992 32458 ts_tablet_manager.cc:1428] T 123e43c486ac49479926084150d5349c P 555784c7828c4290869f94d157650afa: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 08:08:46.713617 32546 tablet_replica.cc:330] T 0f8a9a9084b6484c82f5513183a09e34 P 555784c7828c4290869f94d157650afa: stopping tablet replica
I20260811 08:08:46.713721 32547 tablet_replica.cc:330] T 0f8a9a9084b6484c82f5513183a09e34 P 11913dd40ada4fd4b0b51f22d4106c73: stopping tablet replica
I20260811 08:08:46.713762 32546 raft_consensus.cc:2229] T 0f8a9a9084b6484c82f5513183a09e34 P 555784c7828c4290869f94d157650afa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:08:46.713826 32547 raft_consensus.cc:2229] T 0f8a9a9084b6484c82f5513183a09e34 P 11913dd40ada4fd4b0b51f22d4106c73 [term 1 LEADER]: Raft consensus shutting down.
I20260811 08:08:46.713922 32546 raft_consensus.cc:2258] T 0f8a9a9084b6484c82f5513183a09e34 P 555784c7828c4290869f94d157650afa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:08:46.713924 32547 raft_consensus.cc:2258] T 0f8a9a9084b6484c82f5513183a09e34 P 11913dd40ada4fd4b0b51f22d4106c73 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:08:46.714344 32546 ts_tablet_manager.cc:1905] T 0f8a9a9084b6484c82f5513183a09e34 P 555784c7828c4290869f94d157650afa: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:08:46.714356 32547 ts_tablet_manager.cc:1905] T 0f8a9a9084b6484c82f5513183a09e34 P 11913dd40ada4fd4b0b51f22d4106c73: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:08:46.715922 32546 ts_tablet_manager.cc:1918] T 0f8a9a9084b6484c82f5513183a09e34 P 555784c7828c4290869f94d157650afa: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 08:08:46.716050 32546 log.cc:1196] T 0f8a9a9084b6484c82f5513183a09e34 P 555784c7828c4290869f94d157650afa: Deleting WAL directory at /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435717191469-28623-0/minicluster-data/ts-1/wal/wals/0f8a9a9084b6484c82f5513183a09e34
I20260811 08:08:46.716229 32547 ts_tablet_manager.cc:1918] T 0f8a9a9084b6484c82f5513183a09e34 P 11913dd40ada4fd4b0b51f22d4106c73: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 08:08:46.716323 32547 log.cc:1196] T 0f8a9a9084b6484c82f5513183a09e34 P 11913dd40ada4fd4b0b51f22d4106c73: Deleting WAL directory at /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435717191469-28623-0/minicluster-data/ts-0/wal/wals/0f8a9a9084b6484c82f5513183a09e34
I20260811 08:08:46.716427 32546 ts_tablet_manager.cc:1939] T 0f8a9a9084b6484c82f5513183a09e34 P 555784c7828c4290869f94d157650afa: Deleting consensus metadata
I20260811 08:08:46.716591 32547 ts_tablet_manager.cc:1939] T 0f8a9a9084b6484c82f5513183a09e34 P 11913dd40ada4fd4b0b51f22d4106c73: Deleting consensus metadata
I20260811 08:08:46.716885 31565 catalog_manager.cc:4841] TS 555784c7828c4290869f94d157650afa (127.27.243.194:45395): tablet 0f8a9a9084b6484c82f5513183a09e34 (table test-table [id=7bf5c8d8ff27437ca61b04bba3da2c01]) successfully deleted
I20260811 08:08:46.716982 31566 catalog_manager.cc:4841] TS 11913dd40ada4fd4b0b51f22d4106c73 (127.27.243.193:40561): tablet 0f8a9a9084b6484c82f5513183a09e34 (table test-table [id=7bf5c8d8ff27437ca61b04bba3da2c01]) successfully deleted
I20260811 08:08:46.844285 32536 raft_consensus.cc:482] T 123e43c486ac49479926084150d5349c P 11913dd40ada4fd4b0b51f22d4106c73 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:08:46.844415 32536 raft_consensus.cc:504] T 123e43c486ac49479926084150d5349c P 11913dd40ada4fd4b0b51f22d4106c73 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11913dd40ada4fd4b0b51f22d4106c73" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40561 } } peers { permanent_uuid: "555784c7828c4290869f94d157650afa" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 45395 } } peers { permanent_uuid: "5c466b2db9f74bfc9f58a6e38721d054" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 39831 } }
I20260811 08:08:46.844614 32536 leader_election.cc:288] T 123e43c486ac49479926084150d5349c P 11913dd40ada4fd4b0b51f22d4106c73 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 555784c7828c4290869f94d157650afa (127.27.243.194:45395), 5c466b2db9f74bfc9f58a6e38721d054 (127.27.243.195:39831)
I20260811 08:08:46.844916 32096 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "123e43c486ac49479926084150d5349c" candidate_uuid: "11913dd40ada4fd4b0b51f22d4106c73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "555784c7828c4290869f94d157650afa" is_pre_election: true
I20260811 08:08:46.844916 32337 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "123e43c486ac49479926084150d5349c" candidate_uuid: "11913dd40ada4fd4b0b51f22d4106c73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c466b2db9f74bfc9f58a6e38721d054" is_pre_election: true
I20260811 08:08:46.845034 32096 raft_consensus.cc:2454] T 123e43c486ac49479926084150d5349c P 555784c7828c4290869f94d157650afa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 11913dd40ada4fd4b0b51f22d4106c73 in term 0.
I20260811 08:08:46.845034 32337 raft_consensus.cc:2454] T 123e43c486ac49479926084150d5349c P 5c466b2db9f74bfc9f58a6e38721d054 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 11913dd40ada4fd4b0b51f22d4106c73 in term 0.
I20260811 08:08:46.845214 31744 leader_election.cc:302] T 123e43c486ac49479926084150d5349c P 11913dd40ada4fd4b0b51f22d4106c73 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11913dd40ada4fd4b0b51f22d4106c73, 555784c7828c4290869f94d157650afa; no voters:
I20260811 08:08:46.845352 32536 raft_consensus.cc:2781] T 123e43c486ac49479926084150d5349c P 11913dd40ada4fd4b0b51f22d4106c73 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 08:08:46.845408 32536 raft_consensus.cc:482] T 123e43c486ac49479926084150d5349c P 11913dd40ada4fd4b0b51f22d4106c73 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 08:08:46.845429 32536 raft_consensus.cc:3037] T 123e43c486ac49479926084150d5349c P 11913dd40ada4fd4b0b51f22d4106c73 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:08:46.846221 32536 raft_consensus.cc:504] T 123e43c486ac49479926084150d5349c P 11913dd40ada4fd4b0b51f22d4106c73 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11913dd40ada4fd4b0b51f22d4106c73" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40561 } } peers { permanent_uuid: "555784c7828c4290869f94d157650afa" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 45395 } } peers { permanent_uuid: "5c466b2db9f74bfc9f58a6e38721d054" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 39831 } }
I20260811 08:08:46.846349 32536 leader_election.cc:288] T 123e43c486ac49479926084150d5349c P 11913dd40ada4fd4b0b51f22d4106c73 [CANDIDATE]: Term 1 election: Requested vote from peers 555784c7828c4290869f94d157650afa (127.27.243.194:45395), 5c466b2db9f74bfc9f58a6e38721d054 (127.27.243.195:39831)
I20260811 08:08:46.846540 32096 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "123e43c486ac49479926084150d5349c" candidate_uuid: "11913dd40ada4fd4b0b51f22d4106c73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "555784c7828c4290869f94d157650afa"
I20260811 08:08:46.846550 32337 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "123e43c486ac49479926084150d5349c" candidate_uuid: "11913dd40ada4fd4b0b51f22d4106c73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c466b2db9f74bfc9f58a6e38721d054"
I20260811 08:08:46.846627 32096 raft_consensus.cc:3037] T 123e43c486ac49479926084150d5349c P 555784c7828c4290869f94d157650afa [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:08:46.846627 32337 raft_consensus.cc:3037] T 123e43c486ac49479926084150d5349c P 5c466b2db9f74bfc9f58a6e38721d054 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:08:46.847398 32096 raft_consensus.cc:2454] T 123e43c486ac49479926084150d5349c P 555784c7828c4290869f94d157650afa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11913dd40ada4fd4b0b51f22d4106c73 in term 1.
I20260811 08:08:46.847398 32337 raft_consensus.cc:2454] T 123e43c486ac49479926084150d5349c P 5c466b2db9f74bfc9f58a6e38721d054 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11913dd40ada4fd4b0b51f22d4106c73 in term 1.
I20260811 08:08:46.847646 31748 leader_election.cc:302] T 123e43c486ac49479926084150d5349c P 11913dd40ada4fd4b0b51f22d4106c73 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11913dd40ada4fd4b0b51f22d4106c73, 5c466b2db9f74bfc9f58a6e38721d054; no voters:
I20260811 08:08:46.847744 32536 raft_consensus.cc:2781] T 123e43c486ac49479926084150d5349c P 11913dd40ada4fd4b0b51f22d4106c73 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:08:46.847795 32536 raft_consensus.cc:686] T 123e43c486ac49479926084150d5349c P 11913dd40ada4fd4b0b51f22d4106c73 [term 1 LEADER]: Becoming Leader. State: Replica: 11913dd40ada4fd4b0b51f22d4106c73, State: Running, Role: LEADER
I20260811 08:08:46.847849 32536 consensus_queue.cc:237] T 123e43c486ac49479926084150d5349c P 11913dd40ada4fd4b0b51f22d4106c73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11913dd40ada4fd4b0b51f22d4106c73" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40561 } } peers { permanent_uuid: "555784c7828c4290869f94d157650afa" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 45395 } } peers { permanent_uuid: "5c466b2db9f74bfc9f58a6e38721d054" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 39831 } }
I20260811 08:08:46.848479 31591 catalog_manager.cc:5495] T 123e43c486ac49479926084150d5349c P 11913dd40ada4fd4b0b51f22d4106c73 reported cstate change: term changed from 0 to 1, leader changed from <none> to 11913dd40ada4fd4b0b51f22d4106c73 (127.27.243.193). New cstate: current_term: 1 leader_uuid: "11913dd40ada4fd4b0b51f22d4106c73" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11913dd40ada4fd4b0b51f22d4106c73" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "555784c7828c4290869f94d157650afa" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 45395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c466b2db9f74bfc9f58a6e38721d054" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 39831 } health_report { overall_health: UNKNOWN } } }
I20260811 08:08:46.861301 32337 raft_consensus.cc:1261] T 123e43c486ac49479926084150d5349c P 5c466b2db9f74bfc9f58a6e38721d054 [term 1 FOLLOWER]: Refusing update from remote peer 11913dd40ada4fd4b0b51f22d4106c73: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:08:46.861320 32096 raft_consensus.cc:1261] T 123e43c486ac49479926084150d5349c P 555784c7828c4290869f94d157650afa [term 1 FOLLOWER]: Refusing update from remote peer 11913dd40ada4fd4b0b51f22d4106c73: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:08:46.861501 32536 consensus_queue.cc:1035] T 123e43c486ac49479926084150d5349c P 11913dd40ada4fd4b0b51f22d4106c73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "555784c7828c4290869f94d157650afa" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 45395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:08:46.861624 32470 consensus_queue.cc:1035] T 123e43c486ac49479926084150d5349c P 11913dd40ada4fd4b0b51f22d4106c73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c466b2db9f74bfc9f58a6e38721d054" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 39831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:08:46.862604 32505 mvcc.cc:205] Tried to move back new op lower bound from 7317240737222807552 to 7317240737169272832. Current Snapshot: MvccSnapshot[applied={T|T < 7317240737222807552}]
I20260811 08:08:46.862970 32510 mvcc.cc:205] Tried to move back new op lower bound from 7317240737222807552 to 7317240737169272832. Current Snapshot: MvccSnapshot[applied={T|T < 7317240737222807552}]
W20260811 08:08:46.866082 32505 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260811 08:08:48.383447 31591 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49258:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:08:48.383559 31591 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49258:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:08:48.384404 31591 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 485920145a134f15ae7f4bcdf5db2398: Sending DeleteTablet for 3 replicas of tablet 123e43c486ac49479926084150d5349c
I20260811 08:08:48.384634 31830 tablet_service.cc:1514] Processing DeleteTablet for tablet 123e43c486ac49479926084150d5349c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:08:48 UTC) from {username='kudu', principal='kudu/127.27.243.254@KRBTEST.COM'} at 127.0.0.1:51446
I20260811 08:08:48.384655 32061 tablet_service.cc:1514] Processing DeleteTablet for tablet 123e43c486ac49479926084150d5349c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:08:48 UTC) from {username='kudu', principal='kudu/127.27.243.254@KRBTEST.COM'} at 127.0.0.1:49652
I20260811 08:08:48.384859 32606 tablet_replica.cc:330] T 123e43c486ac49479926084150d5349c P 555784c7828c4290869f94d157650afa: stopping tablet replica
I20260811 08:08:48.384850 32302 tablet_service.cc:1514] Processing DeleteTablet for tablet 123e43c486ac49479926084150d5349c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:08:48 UTC) from {username='kudu', principal='kudu/127.27.243.254@KRBTEST.COM'} at 127.0.0.1:41816
I20260811 08:08:48.384920 32606 raft_consensus.cc:2229] T 123e43c486ac49479926084150d5349c P 555784c7828c4290869f94d157650afa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:08:48.384956 32606 raft_consensus.cc:2258] T 123e43c486ac49479926084150d5349c P 555784c7828c4290869f94d157650afa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:08:48.385161 32608 tablet_replica.cc:330] T 123e43c486ac49479926084150d5349c P 5c466b2db9f74bfc9f58a6e38721d054: stopping tablet replica
I20260811 08:08:48.385201 32606 ts_tablet_manager.cc:1905] T 123e43c486ac49479926084150d5349c P 555784c7828c4290869f94d157650afa: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:08:48.385267 32608 raft_consensus.cc:2229] T 123e43c486ac49479926084150d5349c P 5c466b2db9f74bfc9f58a6e38721d054 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:08:48.385329 32608 raft_consensus.cc:2258] T 123e43c486ac49479926084150d5349c P 5c466b2db9f74bfc9f58a6e38721d054 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:08:48.386822 32606 ts_tablet_manager.cc:1918] T 123e43c486ac49479926084150d5349c P 555784c7828c4290869f94d157650afa: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 08:08:48.386919 32606 log.cc:1196] T 123e43c486ac49479926084150d5349c P 555784c7828c4290869f94d157650afa: Deleting WAL directory at /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435717191469-28623-0/minicluster-data/ts-1/wal/wals/123e43c486ac49479926084150d5349c
I20260811 08:08:48.387172 32606 ts_tablet_manager.cc:1939] T 123e43c486ac49479926084150d5349c P 555784c7828c4290869f94d157650afa: Deleting consensus metadata
I20260811 08:08:48.387523 31565 catalog_manager.cc:4841] TS 555784c7828c4290869f94d157650afa (127.27.243.194:45395): tablet 123e43c486ac49479926084150d5349c (table test-table [id=764883c59e294d38b25df1dc397a62a7]) successfully deleted
I20260811 08:08:48.387898 32608 ts_tablet_manager.cc:1905] T 123e43c486ac49479926084150d5349c P 5c466b2db9f74bfc9f58a6e38721d054: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:08:48.389017 32605 tablet_replica.cc:330] T 123e43c486ac49479926084150d5349c P 11913dd40ada4fd4b0b51f22d4106c73: stopping tablet replica
I20260811 08:08:48.389082 32605 raft_consensus.cc:2229] T 123e43c486ac49479926084150d5349c P 11913dd40ada4fd4b0b51f22d4106c73 [term 1 LEADER]: Raft consensus shutting down.
I20260811 08:08:48.389142 32605 raft_consensus.cc:2258] T 123e43c486ac49479926084150d5349c P 11913dd40ada4fd4b0b51f22d4106c73 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:08:48.389138 32608 ts_tablet_manager.cc:1918] T 123e43c486ac49479926084150d5349c P 5c466b2db9f74bfc9f58a6e38721d054: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 08:08:48.389192 32608 log.cc:1196] T 123e43c486ac49479926084150d5349c P 5c466b2db9f74bfc9f58a6e38721d054: Deleting WAL directory at /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435717191469-28623-0/minicluster-data/ts-2/wal/wals/123e43c486ac49479926084150d5349c
I20260811 08:08:48.389454 32608 ts_tablet_manager.cc:1939] T 123e43c486ac49479926084150d5349c P 5c466b2db9f74bfc9f58a6e38721d054: Deleting consensus metadata
I20260811 08:08:48.389923 31566 catalog_manager.cc:4841] TS 5c466b2db9f74bfc9f58a6e38721d054 (127.27.243.195:39831): tablet 123e43c486ac49479926084150d5349c (table test-table [id=764883c59e294d38b25df1dc397a62a7]) successfully deleted
I20260811 08:08:48.389976 32605 ts_tablet_manager.cc:1905] T 123e43c486ac49479926084150d5349c P 11913dd40ada4fd4b0b51f22d4106c73: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:08:48.391364 32605 ts_tablet_manager.cc:1918] T 123e43c486ac49479926084150d5349c P 11913dd40ada4fd4b0b51f22d4106c73: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 08:08:48.391417 32605 log.cc:1196] T 123e43c486ac49479926084150d5349c P 11913dd40ada4fd4b0b51f22d4106c73: Deleting WAL directory at /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435717191469-28623-0/minicluster-data/ts-0/wal/wals/123e43c486ac49479926084150d5349c
I20260811 08:08:48.391618 32605 ts_tablet_manager.cc:1939] T 123e43c486ac49479926084150d5349c P 11913dd40ada4fd4b0b51f22d4106c73: Deleting consensus metadata
I20260811 08:08:48.391937 31566 catalog_manager.cc:4841] TS 11913dd40ada4fd4b0b51f22d4106c73 (127.27.243.193:40561): tablet 123e43c486ac49479926084150d5349c (table test-table [id=764883c59e294d38b25df1dc397a62a7]) successfully deleted
Aug 11 08:08:48 dist-test-slave-7lbf krb5kdc[31515](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435728, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 08:08:48 dist-test-slave-7lbf krb5kdc[31515](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435728, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.27.243.254@KRBTEST.COM
I20260811 08:08:48.408097 32621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:48.401474 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44722 (local address 127.27.243.254:36037)
0811 08:08:48.401630 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:48.401632 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:48.401654 (+ 22us) server_negotiation.cc:407] Connection header received
0811 08:08:48.401717 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:48.401717 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:48.401727 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:48.401788 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:48.402296 (+ 508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:48.402818 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:48.403568 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:48.403778 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:48.403885 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:48.406007 (+ 2122us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:08:48.406009 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:08:48.406009 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:08:48.406016 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:08:48.407221 (+ 1205us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:48.407512 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:48.407512 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:48.407513 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:48.407558 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:48.407705 (+ 147us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:48.407706 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:48.407706 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:48.407799 (+ 93us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:08:48.407895 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:48.407961 (+ 66us) server_negotiation.cc:299] Negotiation successful
0811 08:08:48.408027 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129,"thread_start_us":96,"threads_started":1}
I20260811 08:08:48.409430 31591 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44722:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 08:08:48.409669 31591 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 08:08:48.410887 31830 tablet_service.cc:1467] Processing CreateTablet for tablet cf8d1631542e4705bf04b83d20f2e08e (DEFAULT_TABLE table=test-table [id=0b3ec0a0418341a4afc9ab993704bb48]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:08:48.410962 32061 tablet_service.cc:1467] Processing CreateTablet for tablet cf8d1631542e4705bf04b83d20f2e08e (DEFAULT_TABLE table=test-table [id=0b3ec0a0418341a4afc9ab993704bb48]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:08:48.411029 31830 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cf8d1631542e4705bf04b83d20f2e08e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:08:48.411103 32061 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cf8d1631542e4705bf04b83d20f2e08e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:08:48.412051 32622 tablet_bootstrap.cc:492] T cf8d1631542e4705bf04b83d20f2e08e P 11913dd40ada4fd4b0b51f22d4106c73: Bootstrap starting.
I20260811 08:08:48.412236 32624 tablet_bootstrap.cc:492] T cf8d1631542e4705bf04b83d20f2e08e P 555784c7828c4290869f94d157650afa: Bootstrap starting.
I20260811 08:08:48.412292 32302 tablet_service.cc:1467] Processing CreateTablet for tablet cf8d1631542e4705bf04b83d20f2e08e (DEFAULT_TABLE table=test-table [id=0b3ec0a0418341a4afc9ab993704bb48]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:08:48.412431 32302 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cf8d1631542e4705bf04b83d20f2e08e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:08:48.412580 32622 tablet_bootstrap.cc:654] T cf8d1631542e4705bf04b83d20f2e08e P 11913dd40ada4fd4b0b51f22d4106c73: Neither blocks nor log segments found. Creating new log.
I20260811 08:08:48.412740 32624 tablet_bootstrap.cc:654] T cf8d1631542e4705bf04b83d20f2e08e P 555784c7828c4290869f94d157650afa: Neither blocks nor log segments found. Creating new log.
I20260811 08:08:48.413118 32622 tablet_bootstrap.cc:492] T cf8d1631542e4705bf04b83d20f2e08e P 11913dd40ada4fd4b0b51f22d4106c73: No bootstrap required, opened a new log
I20260811 08:08:48.413170 32622 ts_tablet_manager.cc:1397] T cf8d1631542e4705bf04b83d20f2e08e P 11913dd40ada4fd4b0b51f22d4106c73: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 08:08:48.413291 32624 tablet_bootstrap.cc:492] T cf8d1631542e4705bf04b83d20f2e08e P 555784c7828c4290869f94d157650afa: No bootstrap required, opened a new log
I20260811 08:08:48.413280 32622 raft_consensus.cc:348] T cf8d1631542e4705bf04b83d20f2e08e P 11913dd40ada4fd4b0b51f22d4106c73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11913dd40ada4fd4b0b51f22d4106c73" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40561 } } peers { permanent_uuid: "555784c7828c4290869f94d157650afa" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 45395 } } peers { permanent_uuid: "5c466b2db9f74bfc9f58a6e38721d054" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 39831 } }
I20260811 08:08:48.413345 32622 raft_consensus.cc:374] T cf8d1631542e4705bf04b83d20f2e08e P 11913dd40ada4fd4b0b51f22d4106c73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:08:48.413347 32624 ts_tablet_manager.cc:1397] T cf8d1631542e4705bf04b83d20f2e08e P 555784c7828c4290869f94d157650afa: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 08:08:48.413365 32622 raft_consensus.cc:729] T cf8d1631542e4705bf04b83d20f2e08e P 11913dd40ada4fd4b0b51f22d4106c73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11913dd40ada4fd4b0b51f22d4106c73, State: Initialized, Role: FOLLOWER
I20260811 08:08:48.413414 32622 consensus_queue.cc:260] T cf8d1631542e4705bf04b83d20f2e08e P 11913dd40ada4fd4b0b51f22d4106c73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11913dd40ada4fd4b0b51f22d4106c73" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40561 } } peers { permanent_uuid: "555784c7828c4290869f94d157650afa" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 45395 } } peers { permanent_uuid: "5c466b2db9f74bfc9f58a6e38721d054" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 39831 } }
I20260811 08:08:48.413457 32624 raft_consensus.cc:348] T cf8d1631542e4705bf04b83d20f2e08e P 555784c7828c4290869f94d157650afa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11913dd40ada4fd4b0b51f22d4106c73" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40561 } } peers { permanent_uuid: "555784c7828c4290869f94d157650afa" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 45395 } } peers { permanent_uuid: "5c466b2db9f74bfc9f58a6e38721d054" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 39831 } }
I20260811 08:08:48.413498 32622 ts_tablet_manager.cc:1428] T cf8d1631542e4705bf04b83d20f2e08e P 11913dd40ada4fd4b0b51f22d4106c73: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 08:08:48.413550 32624 raft_consensus.cc:374] T cf8d1631542e4705bf04b83d20f2e08e P 555784c7828c4290869f94d157650afa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:08:48.413573 32624 raft_consensus.cc:729] T cf8d1631542e4705bf04b83d20f2e08e P 555784c7828c4290869f94d157650afa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 555784c7828c4290869f94d157650afa, State: Initialized, Role: FOLLOWER
I20260811 08:08:48.413635 32624 consensus_queue.cc:260] T cf8d1631542e4705bf04b83d20f2e08e P 555784c7828c4290869f94d157650afa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11913dd40ada4fd4b0b51f22d4106c73" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40561 } } peers { permanent_uuid: "555784c7828c4290869f94d157650afa" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 45395 } } peers { permanent_uuid: "5c466b2db9f74bfc9f58a6e38721d054" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 39831 } }
I20260811 08:08:48.413733 32624 ts_tablet_manager.cc:1428] T cf8d1631542e4705bf04b83d20f2e08e P 555784c7828c4290869f94d157650afa: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 08:08:48.413951 32629 tablet_bootstrap.cc:492] T cf8d1631542e4705bf04b83d20f2e08e P 5c466b2db9f74bfc9f58a6e38721d054: Bootstrap starting.
I20260811 08:08:48.414338 32629 tablet_bootstrap.cc:654] T cf8d1631542e4705bf04b83d20f2e08e P 5c466b2db9f74bfc9f58a6e38721d054: Neither blocks nor log segments found. Creating new log.
I20260811 08:08:48.414880 32629 tablet_bootstrap.cc:492] T cf8d1631542e4705bf04b83d20f2e08e P 5c466b2db9f74bfc9f58a6e38721d054: No bootstrap required, opened a new log
I20260811 08:08:48.414933 32629 ts_tablet_manager.cc:1397] T cf8d1631542e4705bf04b83d20f2e08e P 5c466b2db9f74bfc9f58a6e38721d054: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 08:08:48.415057 32629 raft_consensus.cc:348] T cf8d1631542e4705bf04b83d20f2e08e P 5c466b2db9f74bfc9f58a6e38721d054 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11913dd40ada4fd4b0b51f22d4106c73" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40561 } } peers { permanent_uuid: "555784c7828c4290869f94d157650afa" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 45395 } } peers { permanent_uuid: "5c466b2db9f74bfc9f58a6e38721d054" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 39831 } }
I20260811 08:08:48.415114 32629 raft_consensus.cc:374] T cf8d1631542e4705bf04b83d20f2e08e P 5c466b2db9f74bfc9f58a6e38721d054 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:08:48.415132 32629 raft_consensus.cc:729] T cf8d1631542e4705bf04b83d20f2e08e P 5c466b2db9f74bfc9f58a6e38721d054 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c466b2db9f74bfc9f58a6e38721d054, State: Initialized, Role: FOLLOWER
I20260811 08:08:48.415179 32629 consensus_queue.cc:260] T cf8d1631542e4705bf04b83d20f2e08e P 5c466b2db9f74bfc9f58a6e38721d054 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11913dd40ada4fd4b0b51f22d4106c73" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40561 } } peers { permanent_uuid: "555784c7828c4290869f94d157650afa" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 45395 } } peers { permanent_uuid: "5c466b2db9f74bfc9f58a6e38721d054" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 39831 } }
I20260811 08:08:48.415319 32629 ts_tablet_manager.cc:1428] T cf8d1631542e4705bf04b83d20f2e08e P 5c466b2db9f74bfc9f58a6e38721d054: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 08:08:48.514873 32536 raft_consensus.cc:482] T cf8d1631542e4705bf04b83d20f2e08e P 11913dd40ada4fd4b0b51f22d4106c73 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:08:48.514966 32536 raft_consensus.cc:504] T cf8d1631542e4705bf04b83d20f2e08e P 11913dd40ada4fd4b0b51f22d4106c73 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11913dd40ada4fd4b0b51f22d4106c73" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40561 } } peers { permanent_uuid: "555784c7828c4290869f94d157650afa" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 45395 } } peers { permanent_uuid: "5c466b2db9f74bfc9f58a6e38721d054" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 39831 } }
I20260811 08:08:48.515127 32536 leader_election.cc:288] T cf8d1631542e4705bf04b83d20f2e08e P 11913dd40ada4fd4b0b51f22d4106c73 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 555784c7828c4290869f94d157650afa (127.27.243.194:45395), 5c466b2db9f74bfc9f58a6e38721d054 (127.27.243.195:39831)
I20260811 08:08:48.515331 32337 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf8d1631542e4705bf04b83d20f2e08e" candidate_uuid: "11913dd40ada4fd4b0b51f22d4106c73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c466b2db9f74bfc9f58a6e38721d054" is_pre_election: true
I20260811 08:08:48.515435 32337 raft_consensus.cc:2454] T cf8d1631542e4705bf04b83d20f2e08e P 5c466b2db9f74bfc9f58a6e38721d054 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 11913dd40ada4fd4b0b51f22d4106c73 in term 0.
I20260811 08:08:48.515376 32096 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf8d1631542e4705bf04b83d20f2e08e" candidate_uuid: "11913dd40ada4fd4b0b51f22d4106c73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "555784c7828c4290869f94d157650afa" is_pre_election: true
I20260811 08:08:48.515486 32096 raft_consensus.cc:2454] T cf8d1631542e4705bf04b83d20f2e08e P 555784c7828c4290869f94d157650afa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 11913dd40ada4fd4b0b51f22d4106c73 in term 0.
I20260811 08:08:48.515630 31748 leader_election.cc:302] T cf8d1631542e4705bf04b83d20f2e08e P 11913dd40ada4fd4b0b51f22d4106c73 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11913dd40ada4fd4b0b51f22d4106c73, 5c466b2db9f74bfc9f58a6e38721d054; no voters:
I20260811 08:08:48.515760 32536 raft_consensus.cc:2781] T cf8d1631542e4705bf04b83d20f2e08e P 11913dd40ada4fd4b0b51f22d4106c73 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 08:08:48.515811 32536 raft_consensus.cc:482] T cf8d1631542e4705bf04b83d20f2e08e P 11913dd40ada4fd4b0b51f22d4106c73 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 08:08:48.515836 32536 raft_consensus.cc:3037] T cf8d1631542e4705bf04b83d20f2e08e P 11913dd40ada4fd4b0b51f22d4106c73 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:08:48.516546 32536 raft_consensus.cc:504] T cf8d1631542e4705bf04b83d20f2e08e P 11913dd40ada4fd4b0b51f22d4106c73 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11913dd40ada4fd4b0b51f22d4106c73" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40561 } } peers { permanent_uuid: "555784c7828c4290869f94d157650afa" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 45395 } } peers { permanent_uuid: "5c466b2db9f74bfc9f58a6e38721d054" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 39831 } }
I20260811 08:08:48.516692 32536 leader_election.cc:288] T cf8d1631542e4705bf04b83d20f2e08e P 11913dd40ada4fd4b0b51f22d4106c73 [CANDIDATE]: Term 1 election: Requested vote from peers 555784c7828c4290869f94d157650afa (127.27.243.194:45395), 5c466b2db9f74bfc9f58a6e38721d054 (127.27.243.195:39831)
I20260811 08:08:48.516861 32096 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf8d1631542e4705bf04b83d20f2e08e" candidate_uuid: "11913dd40ada4fd4b0b51f22d4106c73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "555784c7828c4290869f94d157650afa"
I20260811 08:08:48.516963 32096 raft_consensus.cc:3037] T cf8d1631542e4705bf04b83d20f2e08e P 555784c7828c4290869f94d157650afa [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:08:48.516968 32337 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf8d1631542e4705bf04b83d20f2e08e" candidate_uuid: "11913dd40ada4fd4b0b51f22d4106c73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c466b2db9f74bfc9f58a6e38721d054"
I20260811 08:08:48.517109 32337 raft_consensus.cc:3037] T cf8d1631542e4705bf04b83d20f2e08e P 5c466b2db9f74bfc9f58a6e38721d054 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:08:48.517803 32096 raft_consensus.cc:2454] T cf8d1631542e4705bf04b83d20f2e08e P 555784c7828c4290869f94d157650afa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11913dd40ada4fd4b0b51f22d4106c73 in term 1.
I20260811 08:08:48.517903 32337 raft_consensus.cc:2454] T cf8d1631542e4705bf04b83d20f2e08e P 5c466b2db9f74bfc9f58a6e38721d054 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11913dd40ada4fd4b0b51f22d4106c73 in term 1.
I20260811 08:08:48.518010 31744 leader_election.cc:302] T cf8d1631542e4705bf04b83d20f2e08e P 11913dd40ada4fd4b0b51f22d4106c73 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11913dd40ada4fd4b0b51f22d4106c73, 555784c7828c4290869f94d157650afa; no voters:
I20260811 08:08:48.518112 32536 raft_consensus.cc:2781] T cf8d1631542e4705bf04b83d20f2e08e P 11913dd40ada4fd4b0b51f22d4106c73 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:08:48.518174 32536 raft_consensus.cc:686] T cf8d1631542e4705bf04b83d20f2e08e P 11913dd40ada4fd4b0b51f22d4106c73 [term 1 LEADER]: Becoming Leader. State: Replica: 11913dd40ada4fd4b0b51f22d4106c73, State: Running, Role: LEADER
I20260811 08:08:48.518229 32536 consensus_queue.cc:237] T cf8d1631542e4705bf04b83d20f2e08e P 11913dd40ada4fd4b0b51f22d4106c73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11913dd40ada4fd4b0b51f22d4106c73" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40561 } } peers { permanent_uuid: "555784c7828c4290869f94d157650afa" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 45395 } } peers { permanent_uuid: "5c466b2db9f74bfc9f58a6e38721d054" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 39831 } }
I20260811 08:08:48.518859 31591 catalog_manager.cc:5495] T cf8d1631542e4705bf04b83d20f2e08e P 11913dd40ada4fd4b0b51f22d4106c73 reported cstate change: term changed from 0 to 1, leader changed from <none> to 11913dd40ada4fd4b0b51f22d4106c73 (127.27.243.193). New cstate: current_term: 1 leader_uuid: "11913dd40ada4fd4b0b51f22d4106c73" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11913dd40ada4fd4b0b51f22d4106c73" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "555784c7828c4290869f94d157650afa" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 45395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c466b2db9f74bfc9f58a6e38721d054" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 39831 } health_report { overall_health: UNKNOWN } } }
I20260811 08:08:48.532169 32642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:48.529588 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53648 (local address 127.27.243.193:40561)
0811 08:08:48.529747 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:48.529748 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:48.529755 (+ 7us) server_negotiation.cc:407] Connection header received
0811 08:08:48.529775 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:48.529775 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:48.529785 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:48.529840 (+ 55us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:08:48.529970 (+ 130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:48.530453 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:48.531589 (+ 1136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:48.531785 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:48.531836 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:48.531976 (+ 140us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:08:48.532002 (+ 26us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:08:48.532029 (+ 27us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:48.532079 (+ 50us) server_negotiation.cc:299] Negotiation successful
0811 08:08:48.532097 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":102,"threads_started":1}
I20260811 08:08:48.534276 32337 raft_consensus.cc:1261] T cf8d1631542e4705bf04b83d20f2e08e P 5c466b2db9f74bfc9f58a6e38721d054 [term 1 FOLLOWER]: Refusing update from remote peer 11913dd40ada4fd4b0b51f22d4106c73: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:08:48.534387 32096 raft_consensus.cc:1261] T cf8d1631542e4705bf04b83d20f2e08e P 555784c7828c4290869f94d157650afa [term 1 FOLLOWER]: Refusing update from remote peer 11913dd40ada4fd4b0b51f22d4106c73: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:08:48.534478 32597 consensus_queue.cc:1035] T cf8d1631542e4705bf04b83d20f2e08e P 11913dd40ada4fd4b0b51f22d4106c73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c466b2db9f74bfc9f58a6e38721d054" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 39831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:08:48.534577 32536 consensus_queue.cc:1035] T cf8d1631542e4705bf04b83d20f2e08e P 11913dd40ada4fd4b0b51f22d4106c73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "555784c7828c4290869f94d157650afa" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 45395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:08:48.543963 31591 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44722:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:08:48.544049 31591 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44722:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:08:48.544579 31591 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 485920145a134f15ae7f4bcdf5db2398: Sending DeleteTablet for 3 replicas of tablet cf8d1631542e4705bf04b83d20f2e08e
I20260811 08:08:48.544785 32061 tablet_service.cc:1514] Processing DeleteTablet for tablet cf8d1631542e4705bf04b83d20f2e08e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:08:48 UTC) from {username='kudu', principal='kudu/127.27.243.254@KRBTEST.COM'} at 127.0.0.1:49652
I20260811 08:08:48.544785 31830 tablet_service.cc:1514] Processing DeleteTablet for tablet cf8d1631542e4705bf04b83d20f2e08e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:08:48 UTC) from {username='kudu', principal='kudu/127.27.243.254@KRBTEST.COM'} at 127.0.0.1:51446
I20260811 08:08:48.544852 32302 tablet_service.cc:1514] Processing DeleteTablet for tablet cf8d1631542e4705bf04b83d20f2e08e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:08:48 UTC) from {username='kudu', principal='kudu/127.27.243.254@KRBTEST.COM'} at 127.0.0.1:41816
I20260811 08:08:48.544881 32606 tablet_replica.cc:330] T cf8d1631542e4705bf04b83d20f2e08e P 555784c7828c4290869f94d157650afa: stopping tablet replica
I20260811 08:08:48.544935 32606 raft_consensus.cc:2229] T cf8d1631542e4705bf04b83d20f2e08e P 555784c7828c4290869f94d157650afa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:08:48.544937 32608 tablet_replica.cc:330] T cf8d1631542e4705bf04b83d20f2e08e P 5c466b2db9f74bfc9f58a6e38721d054: stopping tablet replica
I20260811 08:08:48.544970 32606 raft_consensus.cc:2258] T cf8d1631542e4705bf04b83d20f2e08e P 555784c7828c4290869f94d157650afa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:08:48.544989 32608 raft_consensus.cc:2229] T cf8d1631542e4705bf04b83d20f2e08e P 5c466b2db9f74bfc9f58a6e38721d054 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:08:48.545025 32608 raft_consensus.cc:2258] T cf8d1631542e4705bf04b83d20f2e08e P 5c466b2db9f74bfc9f58a6e38721d054 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:08:48.545035 32605 tablet_replica.cc:330] T cf8d1631542e4705bf04b83d20f2e08e P 11913dd40ada4fd4b0b51f22d4106c73: stopping tablet replica
I20260811 08:08:48.545079 32605 raft_consensus.cc:2229] T cf8d1631542e4705bf04b83d20f2e08e P 11913dd40ada4fd4b0b51f22d4106c73 [term 1 LEADER]: Raft consensus shutting down.
I20260811 08:08:48.545121 32605 raft_consensus.cc:2258] T cf8d1631542e4705bf04b83d20f2e08e P 11913dd40ada4fd4b0b51f22d4106c73 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:08:48.545387 32608 ts_tablet_manager.cc:1905] T cf8d1631542e4705bf04b83d20f2e08e P 5c466b2db9f74bfc9f58a6e38721d054: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:08:48.545457 32605 ts_tablet_manager.cc:1905] T cf8d1631542e4705bf04b83d20f2e08e P 11913dd40ada4fd4b0b51f22d4106c73: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:08:48.545701 31591 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44722:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 08:08:48.545780 32606 ts_tablet_manager.cc:1905] T cf8d1631542e4705bf04b83d20f2e08e P 555784c7828c4290869f94d157650afa: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260811 08:08:48.545830 31591 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 08:08:48.546945 32608 ts_tablet_manager.cc:1918] T cf8d1631542e4705bf04b83d20f2e08e P 5c466b2db9f74bfc9f58a6e38721d054: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 08:08:48.546996 32608 log.cc:1196] T cf8d1631542e4705bf04b83d20f2e08e P 5c466b2db9f74bfc9f58a6e38721d054: Deleting WAL directory at /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435717191469-28623-0/minicluster-data/ts-2/wal/wals/cf8d1631542e4705bf04b83d20f2e08e
I20260811 08:08:48.547075 32605 ts_tablet_manager.cc:1918] T cf8d1631542e4705bf04b83d20f2e08e P 11913dd40ada4fd4b0b51f22d4106c73: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 08:08:48.547127 32605 log.cc:1196] T cf8d1631542e4705bf04b83d20f2e08e P 11913dd40ada4fd4b0b51f22d4106c73: Deleting WAL directory at /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435717191469-28623-0/minicluster-data/ts-0/wal/wals/cf8d1631542e4705bf04b83d20f2e08e
I20260811 08:08:48.547180 32608 ts_tablet_manager.cc:1939] T cf8d1631542e4705bf04b83d20f2e08e P 5c466b2db9f74bfc9f58a6e38721d054: Deleting consensus metadata
I20260811 08:08:48.547185 32606 ts_tablet_manager.cc:1918] T cf8d1631542e4705bf04b83d20f2e08e P 555784c7828c4290869f94d157650afa: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 08:08:48.547230 32606 log.cc:1196] T cf8d1631542e4705bf04b83d20f2e08e P 555784c7828c4290869f94d157650afa: Deleting WAL directory at /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435717191469-28623-0/minicluster-data/ts-1/wal/wals/cf8d1631542e4705bf04b83d20f2e08e
I20260811 08:08:48.547333 32605 ts_tablet_manager.cc:1939] T cf8d1631542e4705bf04b83d20f2e08e P 11913dd40ada4fd4b0b51f22d4106c73: Deleting consensus metadata
I20260811 08:08:48.547420 32606 ts_tablet_manager.cc:1939] T cf8d1631542e4705bf04b83d20f2e08e P 555784c7828c4290869f94d157650afa: Deleting consensus metadata
I20260811 08:08:48.547429 31566 catalog_manager.cc:4841] TS 5c466b2db9f74bfc9f58a6e38721d054 (127.27.243.195:39831): tablet cf8d1631542e4705bf04b83d20f2e08e (table test-table [id=0b3ec0a0418341a4afc9ab993704bb48]) successfully deleted
I20260811 08:08:48.547765 31565 catalog_manager.cc:4841] TS 555784c7828c4290869f94d157650afa (127.27.243.194:45395): tablet cf8d1631542e4705bf04b83d20f2e08e (table test-table [id=0b3ec0a0418341a4afc9ab993704bb48]) successfully deleted
I20260811 08:08:48.547765 31566 catalog_manager.cc:4841] TS 11913dd40ada4fd4b0b51f22d4106c73 (127.27.243.193:40561): tablet cf8d1631542e4705bf04b83d20f2e08e (table test-table [id=0b3ec0a0418341a4afc9ab993704bb48]) successfully deleted
I20260811 08:08:48.548823 32302 tablet_service.cc:1467] Processing CreateTablet for tablet b29248fabe474bd985da555354507d0a (DEFAULT_TABLE table=test-table [id=55ef148cf41643f087214fb6332070df]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:08:48.548862 31830 tablet_service.cc:1467] Processing CreateTablet for tablet b29248fabe474bd985da555354507d0a (DEFAULT_TABLE table=test-table [id=55ef148cf41643f087214fb6332070df]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:08:48.548834 32061 tablet_service.cc:1467] Processing CreateTablet for tablet b29248fabe474bd985da555354507d0a (DEFAULT_TABLE table=test-table [id=55ef148cf41643f087214fb6332070df]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:08:48.548935 32302 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b29248fabe474bd985da555354507d0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:08:48.548943 31830 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b29248fabe474bd985da555354507d0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:08:48.548952 32061 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b29248fabe474bd985da555354507d0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:08:48.550071 32629 tablet_bootstrap.cc:492] T b29248fabe474bd985da555354507d0a P 5c466b2db9f74bfc9f58a6e38721d054: Bootstrap starting.
I20260811 08:08:48.550096 32624 tablet_bootstrap.cc:492] T b29248fabe474bd985da555354507d0a P 555784c7828c4290869f94d157650afa: Bootstrap starting.
I20260811 08:08:48.550431 32624 tablet_bootstrap.cc:654] T b29248fabe474bd985da555354507d0a P 555784c7828c4290869f94d157650afa: Neither blocks nor log segments found. Creating new log.
I20260811 08:08:48.550521 32629 tablet_bootstrap.cc:654] T b29248fabe474bd985da555354507d0a P 5c466b2db9f74bfc9f58a6e38721d054: Neither blocks nor log segments found. Creating new log.
I20260811 08:08:48.550796 32622 tablet_bootstrap.cc:492] T b29248fabe474bd985da555354507d0a P 11913dd40ada4fd4b0b51f22d4106c73: Bootstrap starting.
I20260811 08:08:48.550948 32624 tablet_bootstrap.cc:492] T b29248fabe474bd985da555354507d0a P 555784c7828c4290869f94d157650afa: No bootstrap required, opened a new log
I20260811 08:08:48.550992 32624 ts_tablet_manager.cc:1397] T b29248fabe474bd985da555354507d0a P 555784c7828c4290869f94d157650afa: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260811 08:08:48.551082 32622 tablet_bootstrap.cc:654] T b29248fabe474bd985da555354507d0a P 11913dd40ada4fd4b0b51f22d4106c73: Neither blocks nor log segments found. Creating new log.
I20260811 08:08:48.551093 32624 raft_consensus.cc:348] T b29248fabe474bd985da555354507d0a P 555784c7828c4290869f94d157650afa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11913dd40ada4fd4b0b51f22d4106c73" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40561 } } peers { permanent_uuid: "555784c7828c4290869f94d157650afa" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 45395 } } peers { permanent_uuid: "5c466b2db9f74bfc9f58a6e38721d054" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 39831 } }
I20260811 08:08:48.551162 32624 raft_consensus.cc:374] T b29248fabe474bd985da555354507d0a P 555784c7828c4290869f94d157650afa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:08:48.551183 32624 raft_consensus.cc:729] T b29248fabe474bd985da555354507d0a P 555784c7828c4290869f94d157650afa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 555784c7828c4290869f94d157650afa, State: Initialized, Role: FOLLOWER
I20260811 08:08:48.551223 32624 consensus_queue.cc:260] T b29248fabe474bd985da555354507d0a P 555784c7828c4290869f94d157650afa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11913dd40ada4fd4b0b51f22d4106c73" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40561 } } peers { permanent_uuid: "555784c7828c4290869f94d157650afa" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 45395 } } peers { permanent_uuid: "5c466b2db9f74bfc9f58a6e38721d054" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 39831 } }
I20260811 08:08:48.551318 32624 ts_tablet_manager.cc:1428] T b29248fabe474bd985da555354507d0a P 555784c7828c4290869f94d157650afa: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 08:08:48.551386 32629 tablet_bootstrap.cc:492] T b29248fabe474bd985da555354507d0a P 5c466b2db9f74bfc9f58a6e38721d054: No bootstrap required, opened a new log
I20260811 08:08:48.551435 32629 ts_tablet_manager.cc:1397] T b29248fabe474bd985da555354507d0a P 5c466b2db9f74bfc9f58a6e38721d054: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 08:08:48.551563 32622 tablet_bootstrap.cc:492] T b29248fabe474bd985da555354507d0a P 11913dd40ada4fd4b0b51f22d4106c73: No bootstrap required, opened a new log
I20260811 08:08:48.551602 32622 ts_tablet_manager.cc:1397] T b29248fabe474bd985da555354507d0a P 11913dd40ada4fd4b0b51f22d4106c73: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20260811 08:08:48.551575 32629 raft_consensus.cc:348] T b29248fabe474bd985da555354507d0a P 5c466b2db9f74bfc9f58a6e38721d054 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11913dd40ada4fd4b0b51f22d4106c73" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40561 } } peers { permanent_uuid: "555784c7828c4290869f94d157650afa" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 45395 } } peers { permanent_uuid: "5c466b2db9f74bfc9f58a6e38721d054" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 39831 } }
I20260811 08:08:48.551635 32629 raft_consensus.cc:374] T b29248fabe474bd985da555354507d0a P 5c466b2db9f74bfc9f58a6e38721d054 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:08:48.551654 32629 raft_consensus.cc:729] T b29248fabe474bd985da555354507d0a P 5c466b2db9f74bfc9f58a6e38721d054 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c466b2db9f74bfc9f58a6e38721d054, State: Initialized, Role: FOLLOWER
I20260811 08:08:48.551695 32629 consensus_queue.cc:260] T b29248fabe474bd985da555354507d0a P 5c466b2db9f74bfc9f58a6e38721d054 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11913dd40ada4fd4b0b51f22d4106c73" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40561 } } peers { permanent_uuid: "555784c7828c4290869f94d157650afa" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 45395 } } peers { permanent_uuid: "5c466b2db9f74bfc9f58a6e38721d054" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 39831 } }
I20260811 08:08:48.551688 32622 raft_consensus.cc:348] T b29248fabe474bd985da555354507d0a P 11913dd40ada4fd4b0b51f22d4106c73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11913dd40ada4fd4b0b51f22d4106c73" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40561 } } peers { permanent_uuid: "555784c7828c4290869f94d157650afa" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 45395 } } peers { permanent_uuid: "5c466b2db9f74bfc9f58a6e38721d054" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 39831 } }
I20260811 08:08:48.551748 32622 raft_consensus.cc:374] T b29248fabe474bd985da555354507d0a P 11913dd40ada4fd4b0b51f22d4106c73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:08:48.551766 32622 raft_consensus.cc:729] T b29248fabe474bd985da555354507d0a P 11913dd40ada4fd4b0b51f22d4106c73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11913dd40ada4fd4b0b51f22d4106c73, State: Initialized, Role: FOLLOWER
I20260811 08:08:48.551775 32629 ts_tablet_manager.cc:1428] T b29248fabe474bd985da555354507d0a P 5c466b2db9f74bfc9f58a6e38721d054: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 08:08:48.551813 32622 consensus_queue.cc:260] T b29248fabe474bd985da555354507d0a P 11913dd40ada4fd4b0b51f22d4106c73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11913dd40ada4fd4b0b51f22d4106c73" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40561 } } peers { permanent_uuid: "555784c7828c4290869f94d157650afa" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 45395 } } peers { permanent_uuid: "5c466b2db9f74bfc9f58a6e38721d054" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 39831 } }
I20260811 08:08:48.551920 32622 ts_tablet_manager.cc:1428] T b29248fabe474bd985da555354507d0a P 11913dd40ada4fd4b0b51f22d4106c73: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 08:08:48.698365 32635 raft_consensus.cc:482] T b29248fabe474bd985da555354507d0a P 5c466b2db9f74bfc9f58a6e38721d054 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:08:48.698464 32635 raft_consensus.cc:504] T b29248fabe474bd985da555354507d0a P 5c466b2db9f74bfc9f58a6e38721d054 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11913dd40ada4fd4b0b51f22d4106c73" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40561 } } peers { permanent_uuid: "555784c7828c4290869f94d157650afa" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 45395 } } peers { permanent_uuid: "5c466b2db9f74bfc9f58a6e38721d054" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 39831 } }
I20260811 08:08:48.698825 32635 leader_election.cc:288] T b29248fabe474bd985da555354507d0a P 5c466b2db9f74bfc9f58a6e38721d054 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 11913dd40ada4fd4b0b51f22d4106c73 (127.27.243.193:40561), 555784c7828c4290869f94d157650afa (127.27.243.194:45395)
I20260811 08:08:48.702057 32642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:48.699036 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.195:52541 (local address 127.27.243.193:40561)
0811 08:08:48.699109 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:48.699111 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:48.699255 (+ 144us) server_negotiation.cc:407] Connection header received
0811 08:08:48.699336 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:48.699337 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:48.699346 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:48.699396 (+ 50us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:08:48.699554 (+ 158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:48.700105 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:48.701239 (+ 1134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:48.701720 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:48.701786 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:48.701795 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:48.701938 (+ 143us) server_negotiation.cc:299] Negotiation successful
0811 08:08:48.701981 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260811 08:08:48.702054 32652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:48.698981 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.193:40561 (local address 127.27.243.195:52541)
0811 08:08:48.699188 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0811 08:08:48.699199 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 08:08:48.699262 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:08:48.699404 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:08:48.699405 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:08:48.699408 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:08:48.699483 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:48.699485 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:48.700174 (+ 689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:48.700175 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:48.701139 (+ 964us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:48.701142 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:48.701797 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:48.701798 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:48.701869 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:48.701872 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 08:08:48.701923 (+ 51us) client_negotiation.cc:240] Negotiation successful
0811 08:08:48.701962 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":91,"threads_started":1}
I20260811 08:08:48.702133 32651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:48.699008 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.194:45395 (local address 127.27.243.195:58391)
0811 08:08:48.699285 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0811 08:08:48.699294 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 08:08:48.699370 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:08:48.699525 (+ 155us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:08:48.699526 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:08:48.699528 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:08:48.699601 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:48.699602 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:48.700455 (+ 853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:48.700457 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:48.701261 (+ 804us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:48.701264 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:48.701858 (+ 594us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:48.701858 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:48.701917 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:48.701923 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 08:08:48.701972 (+ 49us) client_negotiation.cc:240] Negotiation successful
0811 08:08:48.702009 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":264,"thread_start_us":104,"threads_started":1}
I20260811 08:08:48.702365 31856 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b29248fabe474bd985da555354507d0a" candidate_uuid: "5c466b2db9f74bfc9f58a6e38721d054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11913dd40ada4fd4b0b51f22d4106c73" is_pre_election: true
I20260811 08:08:48.702464 31856 raft_consensus.cc:2454] T b29248fabe474bd985da555354507d0a P 11913dd40ada4fd4b0b51f22d4106c73 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c466b2db9f74bfc9f58a6e38721d054 in term 0.
I20260811 08:08:48.702489 32654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:48.699082 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.195:58391 (local address 127.27.243.194:45395)
0811 08:08:48.699199 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:48.699201 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:48.699378 (+ 177us) server_negotiation.cc:407] Connection header received
0811 08:08:48.699432 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:48.699433 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:48.699445 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:48.699511 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:08:48.699661 (+ 150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:48.700356 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:48.701338 (+ 982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:48.701777 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:48.701862 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:48.701872 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:48.701996 (+ 124us) server_negotiation.cc:299] Negotiation successful
0811 08:08:48.702041 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":98,"thread_start_us":64,"threads_started":1}
I20260811 08:08:48.702653 32232 leader_election.cc:302] T b29248fabe474bd985da555354507d0a P 5c466b2db9f74bfc9f58a6e38721d054 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11913dd40ada4fd4b0b51f22d4106c73, 5c466b2db9f74bfc9f58a6e38721d054; no voters:
I20260811 08:08:48.702690 32096 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b29248fabe474bd985da555354507d0a" candidate_uuid: "5c466b2db9f74bfc9f58a6e38721d054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "555784c7828c4290869f94d157650afa" is_pre_election: true
I20260811 08:08:48.702770 32096 raft_consensus.cc:2454] T b29248fabe474bd985da555354507d0a P 555784c7828c4290869f94d157650afa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c466b2db9f74bfc9f58a6e38721d054 in term 0.
I20260811 08:08:48.702797 32635 raft_consensus.cc:2781] T b29248fabe474bd985da555354507d0a P 5c466b2db9f74bfc9f58a6e38721d054 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 08:08:48.702834 32635 raft_consensus.cc:482] T b29248fabe474bd985da555354507d0a P 5c466b2db9f74bfc9f58a6e38721d054 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 08:08:48.702852 32635 raft_consensus.cc:3037] T b29248fabe474bd985da555354507d0a P 5c466b2db9f74bfc9f58a6e38721d054 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:08:48.703594 32635 raft_consensus.cc:504] T b29248fabe474bd985da555354507d0a P 5c466b2db9f74bfc9f58a6e38721d054 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11913dd40ada4fd4b0b51f22d4106c73" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40561 } } peers { permanent_uuid: "555784c7828c4290869f94d157650afa" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 45395 } } peers { permanent_uuid: "5c466b2db9f74bfc9f58a6e38721d054" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 39831 } }
I20260811 08:08:48.703714 32635 leader_election.cc:288] T b29248fabe474bd985da555354507d0a P 5c466b2db9f74bfc9f58a6e38721d054 [CANDIDATE]: Term 1 election: Requested vote from peers 11913dd40ada4fd4b0b51f22d4106c73 (127.27.243.193:40561), 555784c7828c4290869f94d157650afa (127.27.243.194:45395)
I20260811 08:08:48.703887 32096 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b29248fabe474bd985da555354507d0a" candidate_uuid: "5c466b2db9f74bfc9f58a6e38721d054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "555784c7828c4290869f94d157650afa"
I20260811 08:08:48.703975 32096 raft_consensus.cc:3037] T b29248fabe474bd985da555354507d0a P 555784c7828c4290869f94d157650afa [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:08:48.704588 32096 raft_consensus.cc:2454] T b29248fabe474bd985da555354507d0a P 555784c7828c4290869f94d157650afa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c466b2db9f74bfc9f58a6e38721d054 in term 1.
I20260811 08:08:48.704710 31856 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b29248fabe474bd985da555354507d0a" candidate_uuid: "5c466b2db9f74bfc9f58a6e38721d054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11913dd40ada4fd4b0b51f22d4106c73"
I20260811 08:08:48.704802 31856 raft_consensus.cc:3037] T b29248fabe474bd985da555354507d0a P 11913dd40ada4fd4b0b51f22d4106c73 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:08:48.704769 32231 leader_election.cc:302] T b29248fabe474bd985da555354507d0a P 5c466b2db9f74bfc9f58a6e38721d054 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 555784c7828c4290869f94d157650afa, 5c466b2db9f74bfc9f58a6e38721d054; no voters:
I20260811 08:08:48.704905 32635 raft_consensus.cc:2781] T b29248fabe474bd985da555354507d0a P 5c466b2db9f74bfc9f58a6e38721d054 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:08:48.705065 32635 raft_consensus.cc:686] T b29248fabe474bd985da555354507d0a P 5c466b2db9f74bfc9f58a6e38721d054 [term 1 LEADER]: Becoming Leader. State: Replica: 5c466b2db9f74bfc9f58a6e38721d054, State: Running, Role: LEADER
I20260811 08:08:48.705150 32635 consensus_queue.cc:237] T b29248fabe474bd985da555354507d0a P 5c466b2db9f74bfc9f58a6e38721d054 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11913dd40ada4fd4b0b51f22d4106c73" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40561 } } peers { permanent_uuid: "555784c7828c4290869f94d157650afa" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 45395 } } peers { permanent_uuid: "5c466b2db9f74bfc9f58a6e38721d054" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 39831 } }
I20260811 08:08:48.705617 31856 raft_consensus.cc:2454] T b29248fabe474bd985da555354507d0a P 11913dd40ada4fd4b0b51f22d4106c73 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c466b2db9f74bfc9f58a6e38721d054 in term 1.
I20260811 08:08:48.705916 31589 catalog_manager.cc:5495] T b29248fabe474bd985da555354507d0a P 5c466b2db9f74bfc9f58a6e38721d054 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5c466b2db9f74bfc9f58a6e38721d054 (127.27.243.195). New cstate: current_term: 1 leader_uuid: "5c466b2db9f74bfc9f58a6e38721d054" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11913dd40ada4fd4b0b51f22d4106c73" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "555784c7828c4290869f94d157650afa" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 45395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c466b2db9f74bfc9f58a6e38721d054" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 39831 } health_report { overall_health: HEALTHY } } }
I20260811 08:08:48.735176 32658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:48.732741 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55798 (local address 127.27.243.195:39831)
0811 08:08:48.732925 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:48.732926 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:48.732932 (+ 6us) server_negotiation.cc:407] Connection header received
0811 08:08:48.732988 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:48.732988 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:48.733009 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:48.733083 (+ 74us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:08:48.733205 (+ 122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:48.733733 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:48.734431 (+ 698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:48.734642 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:48.734695 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:48.734843 (+ 148us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:08:48.734958 (+ 115us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:08:48.735020 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:48.735057 (+ 37us) server_negotiation.cc:299] Negotiation successful
0811 08:08:48.735077 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":165,"thread_start_us":111,"threads_started":1}
I20260811 08:08:48.739789 32654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:48.737625 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.195:56191 (local address 127.27.243.194:45395)
0811 08:08:48.737668 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:48.737670 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:48.737829 (+ 159us) server_negotiation.cc:407] Connection header received
0811 08:08:48.737860 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:48.737861 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:48.737870 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:48.737917 (+ 47us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:08:48.738048 (+ 131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:48.738499 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:48.739191 (+ 692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:48.739402 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:48.739451 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:48.739599 (+ 148us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:08:48.739625 (+ 26us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:08:48.739658 (+ 33us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:48.739719 (+ 61us) server_negotiation.cc:299] Negotiation successful
0811 08:08:48.739735 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 08:08:48.739820 32662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:48.737549 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.194:45395 (local address 127.27.243.195:56191)
0811 08:08:48.737739 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0811 08:08:48.737749 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 08:08:48.737799 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:08:48.737928 (+ 129us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:08:48.737929 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:08:48.737930 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 08:08:48.737980 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:48.737981 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:48.738556 (+ 575us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:48.738557 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:48.739125 (+ 568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:48.739127 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:48.739476 (+ 349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:48.739477 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:48.739520 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:48.739535 (+ 15us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 08:08:48.739670 (+ 135us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 08:08:48.739671 (+ 1us) client_negotiation.cc:769] Sending connection context
0811 08:08:48.739701 (+ 30us) client_negotiation.cc:240] Negotiation successful
0811 08:08:48.739735 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":104,"threads_started":1}
I20260811 08:08:48.741839 32096 raft_consensus.cc:1261] T b29248fabe474bd985da555354507d0a P 555784c7828c4290869f94d157650afa [term 1 FOLLOWER]: Refusing update from remote peer 5c466b2db9f74bfc9f58a6e38721d054: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:08:48.741840 31856 raft_consensus.cc:1261] T b29248fabe474bd985da555354507d0a P 11913dd40ada4fd4b0b51f22d4106c73 [term 1 FOLLOWER]: Refusing update from remote peer 5c466b2db9f74bfc9f58a6e38721d054: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:08:48.742105 32655 consensus_queue.cc:1035] T b29248fabe474bd985da555354507d0a P 5c466b2db9f74bfc9f58a6e38721d054 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11913dd40ada4fd4b0b51f22d4106c73" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:08:48.742238 32635 consensus_queue.cc:1035] T b29248fabe474bd985da555354507d0a P 5c466b2db9f74bfc9f58a6e38721d054 [LEADER]: Connected to new peer: Peer: permanent_uuid: "555784c7828c4290869f94d157650afa" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 45395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:08:48.749272 32658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:48.747074 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.194:60963 (local address 127.27.243.195:39831)
0811 08:08:48.747109 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:48.747111 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:48.747243 (+ 132us) server_negotiation.cc:407] Connection header received
0811 08:08:48.747293 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:48.747294 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:48.747302 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:48.747351 (+ 49us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:08:48.747444 (+ 93us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:48.747863 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:48.748592 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:48.748855 (+ 263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:48.748930 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:48.749074 (+ 144us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:08:48.749108 (+ 34us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:08:48.749149 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:48.749208 (+ 59us) server_negotiation.cc:299] Negotiation successful
0811 08:08:48.749227 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260811 08:08:48.749297 32671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:48.747039 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.195:39831 (local address 127.27.243.194:60963)
0811 08:08:48.747172 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0811 08:08:48.747183 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 08:08:48.747242 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:08:48.747359 (+ 117us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:08:48.747359 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:08:48.747361 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 08:08:48.747405 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:48.747406 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:48.747905 (+ 499us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:48.747906 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:48.748506 (+ 600us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:48.748508 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:48.748933 (+ 425us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:48.748934 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:48.748994 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:48.749000 (+ 6us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 08:08:48.749158 (+ 158us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 08:08:48.749159 (+ 1us) client_negotiation.cc:769] Sending connection context
0811 08:08:48.749203 (+ 44us) client_negotiation.cc:240] Negotiation successful
0811 08:08:48.749242 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":83,"threads_started":1}
W20260811 08:08:48.749677 32568 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260811 08:08:50.268103 31589 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44722:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:08:50.268225 31589 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44722:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:08:50.269002 31589 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 485920145a134f15ae7f4bcdf5db2398: Sending DeleteTablet for 3 replicas of tablet b29248fabe474bd985da555354507d0a
I20260811 08:08:50.269258 32302 tablet_service.cc:1514] Processing DeleteTablet for tablet b29248fabe474bd985da555354507d0a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:08:50 UTC) from {username='kudu', principal='kudu/127.27.243.254@KRBTEST.COM'} at 127.0.0.1:41816
I20260811 08:08:50.269248 32061 tablet_service.cc:1514] Processing DeleteTablet for tablet b29248fabe474bd985da555354507d0a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:08:50 UTC) from {username='kudu', principal='kudu/127.27.243.254@KRBTEST.COM'} at 127.0.0.1:49652
I20260811 08:08:50.269279 31830 tablet_service.cc:1514] Processing DeleteTablet for tablet b29248fabe474bd985da555354507d0a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:08:50 UTC) from {username='kudu', principal='kudu/127.27.243.254@KRBTEST.COM'} at 127.0.0.1:51446
I20260811 08:08:50.269409 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 31721
I20260811 08:08:50.279857 32716 tablet_replica.cc:330] T b29248fabe474bd985da555354507d0a P 5c466b2db9f74bfc9f58a6e38721d054: stopping tablet replica
I20260811 08:08:50.279942 32716 raft_consensus.cc:2229] T b29248fabe474bd985da555354507d0a P 5c466b2db9f74bfc9f58a6e38721d054 [term 1 LEADER]: Raft consensus shutting down.
I20260811 08:08:50.280041 32716 raft_consensus.cc:2258] T b29248fabe474bd985da555354507d0a P 5c466b2db9f74bfc9f58a6e38721d054 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:08:50.280301 32716 ts_tablet_manager.cc:1905] T b29248fabe474bd985da555354507d0a P 5c466b2db9f74bfc9f58a6e38721d054: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:08:50.281621 32718 tablet_replica.cc:330] T b29248fabe474bd985da555354507d0a P 555784c7828c4290869f94d157650afa: stopping tablet replica
I20260811 08:08:50.281692 32718 raft_consensus.cc:2229] T b29248fabe474bd985da555354507d0a P 555784c7828c4290869f94d157650afa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:08:50.281751 32718 raft_consensus.cc:2258] T b29248fabe474bd985da555354507d0a P 555784c7828c4290869f94d157650afa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:08:50.281984 32718 ts_tablet_manager.cc:1905] T b29248fabe474bd985da555354507d0a P 555784c7828c4290869f94d157650afa: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:08:50.282184 32716 ts_tablet_manager.cc:1918] T b29248fabe474bd985da555354507d0a P 5c466b2db9f74bfc9f58a6e38721d054: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 08:08:50.282248 32716 log.cc:1196] T b29248fabe474bd985da555354507d0a P 5c466b2db9f74bfc9f58a6e38721d054: Deleting WAL directory at /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435717191469-28623-0/minicluster-data/ts-2/wal/wals/b29248fabe474bd985da555354507d0a
I20260811 08:08:50.282519 32716 ts_tablet_manager.cc:1939] T b29248fabe474bd985da555354507d0a P 5c466b2db9f74bfc9f58a6e38721d054: Deleting consensus metadata
I20260811 08:08:50.282902 31566 catalog_manager.cc:4841] TS 5c466b2db9f74bfc9f58a6e38721d054 (127.27.243.195:39831): tablet b29248fabe474bd985da555354507d0a (table test-table [id=55ef148cf41643f087214fb6332070df]) successfully deleted
I20260811 08:08:50.283419 32718 ts_tablet_manager.cc:1918] T b29248fabe474bd985da555354507d0a P 555784c7828c4290869f94d157650afa: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 08:08:50.283504 32718 log.cc:1196] T b29248fabe474bd985da555354507d0a P 555784c7828c4290869f94d157650afa: Deleting WAL directory at /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435717191469-28623-0/minicluster-data/ts-1/wal/wals/b29248fabe474bd985da555354507d0a
I20260811 08:08:50.283691 32718 ts_tablet_manager.cc:1939] T b29248fabe474bd985da555354507d0a P 555784c7828c4290869f94d157650afa: Deleting consensus metadata
I20260811 08:08:50.284016 31565 catalog_manager.cc:4841] TS 555784c7828c4290869f94d157650afa (127.27.243.194:45395): tablet b29248fabe474bd985da555354507d0a (table test-table [id=55ef148cf41643f087214fb6332070df]) successfully deleted
W20260811 08:08:50.285957 31566 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.27.243.193:40561 (error 108)
I20260811 08:08:50.286489 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 31959
I20260811 08:08:50.286521 32723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:50.286313 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.193:40561 (local address 127.0.0.1:53650)
0811 08:08:50.286432 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0811 08:08:50.286481 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.193:40561: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97,"thread_start_us":64,"threads_started":1}
W20260811 08:08:50.301621 31566 catalog_manager.cc:4584] TS 11913dd40ada4fd4b0b51f22d4106c73 (127.27.243.193:40561): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet b29248fabe474bd985da555354507d0a: Network error: Client connection negotiation failed: client connection to 127.27.243.193:40561: connect: Connection refused (error 111)
I20260811 08:08:50.321931 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 32206
I20260811 08:08:50.331569 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 31536
2026-08-11T08:08:50Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (6220 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435717191469-28623-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:08:50 dist-test-slave-7lbf krb5kdc[32730](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:08:50 dist-test-slave-7lbf krb5kdc[32730](info): set up 2 sockets
Aug 11 08:08:50 dist-test-slave-7lbf krb5kdc[32730](info): commencing operation
krb5kdc: starting...
W20260811 08:08:51.502246 28623 mini_kdc.cc:121] Time spent starting KDC: real 1.143s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435717191469-28623-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435717191469-28623-0/krb5kdc/test-user.keytab.
Aug 11 08:08:51 dist-test-slave-7lbf krb5kdc[32730](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435731, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:08:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:08:51Z Disabled control of system clock
WARNING: no policy specified for kudu/127.27.243.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.243.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.243.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab.
Entry for principal kudu/127.27.243.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab.
I20260811 08:08:51.615504 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435717191469-28623-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435717191469-28623-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435717191469-28623-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.243.254:46783
--webserver_interface=127.27.243.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab
--principal=kudu/127.27.243.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:40051
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.243.254:46783
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:08:51.696285 32754 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:08:51.696480 32754 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:08:51.696509 32754 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:08:51.697650 32754 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:08:51.697690 32754 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:08:51.697710 32754 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:08:51.697726 32754 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:08:51.697741 32754 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:08:51.699213 32754 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:40051
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435717191469-28623-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435717191469-28623-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.243.254:46783
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab
--principal=kudu/127.27.243.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.243.254:46783
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.243.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32754
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435717191469-28623-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:08:51.699446 32754 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:08:51.699638 32754 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:08:51.704172 303 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:08:51.704293 32766 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:08:51.704157 32762 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:08:51.704428 32754 server_base.cc:1034] running on GCE node
I20260811 08:08:51.704638 32754 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:08:51.704871 32754 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:08:51.706004 32754 hybrid_clock.cc:648] HybridClock initialized: now 1786435731705994 us; error 32 us; skew 500 ppm
Aug 11 08:08:51 dist-test-slave-7lbf krb5kdc[32730](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435731, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:08:51.711313 32754 init.cc:377] Logged in from keytab as kudu/127.27.243.254@KRBTEST.COM (short username kudu)
I20260811 08:08:51.711695 32754 webserver.cc:460] Webserver started at http://127.27.243.254:36397/ using document root <none> and password file <none>
I20260811 08:08:51.711874 32754 fs_manager.cc:359] Metadata directory not provided
I20260811 08:08:51.711913 32754 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:08:51.712006 32754 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:08:51.712987 32754 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435717191469-28623-0/minicluster-data/master-0/data/instance:
uuid: "4b76ce9027c4421cb399438c4fe69b14"
format_stamp: "Formatted at 2026-08-11 08:08:51 on dist-test-slave-7lbf"
server_key: "a4c86726b376f463ff13b2c2bb630bee"
server_key_iv: "8c92f164ca328b1af791683517d2a2b4"
server_key_version: "encryptionkey@0"
I20260811 08:08:51.713291 32754 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435717191469-28623-0/minicluster-data/master-0/wal/instance:
uuid: "4b76ce9027c4421cb399438c4fe69b14"
format_stamp: "Formatted at 2026-08-11 08:08:51 on dist-test-slave-7lbf"
server_key: "a4c86726b376f463ff13b2c2bb630bee"
server_key_iv: "8c92f164ca328b1af791683517d2a2b4"
server_key_version: "encryptionkey@0"
I20260811 08:08:51.714484 32754 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 08:08:51.715137 316 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:08:51.715277 32754 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 08:08:51.715359 32754 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435717191469-28623-0/minicluster-data/master-0/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435717191469-28623-0/minicluster-data/master-0/wal
uuid: "4b76ce9027c4421cb399438c4fe69b14"
format_stamp: "Formatted at 2026-08-11 08:08:51 on dist-test-slave-7lbf"
server_key: "a4c86726b376f463ff13b2c2bb630bee"
server_key_iv: "8c92f164ca328b1af791683517d2a2b4"
server_key_version: "encryptionkey@0"
I20260811 08:08:51.715416 32754 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435717191469-28623-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435717191469-28623-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435717191469-28623-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:08:51.734118 32754 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:08:51.735903 32754 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:08:51.736012 32754 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:08:51.739744 32754 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.254:46783
I20260811 08:08:51.739789 398 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.254:46783 every 8 connection(s)
I20260811 08:08:51.740108 32754 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
I20260811 08:08:51.740943 399 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:08:51.743155 399 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4b76ce9027c4421cb399438c4fe69b14: Bootstrap starting.
I20260811 08:08:51.743717 399 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4b76ce9027c4421cb399438c4fe69b14: Neither blocks nor log segments found. Creating new log.
I20260811 08:08:51.743985 399 log.cc:824] T 00000000000000000000000000000000 P 4b76ce9027c4421cb399438c4fe69b14: Log is configured to *not* fsync() on all Append() calls
I20260811 08:08:51.744632 399 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4b76ce9027c4421cb399438c4fe69b14: No bootstrap required, opened a new log
I20260811 08:08:51.746228 399 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4b76ce9027c4421cb399438c4fe69b14 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b76ce9027c4421cb399438c4fe69b14" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 46783 } }
I20260811 08:08:51.746364 399 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4b76ce9027c4421cb399438c4fe69b14 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:08:51.746397 399 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4b76ce9027c4421cb399438c4fe69b14 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b76ce9027c4421cb399438c4fe69b14, State: Initialized, Role: FOLLOWER
I20260811 08:08:51.746533 399 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4b76ce9027c4421cb399438c4fe69b14 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b76ce9027c4421cb399438c4fe69b14" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 46783 } }
I20260811 08:08:51.746610 399 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4b76ce9027c4421cb399438c4fe69b14 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:08:51.746644 399 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4b76ce9027c4421cb399438c4fe69b14 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:08:51.746692 399 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4b76ce9027c4421cb399438c4fe69b14 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:08:51.747195 399 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4b76ce9027c4421cb399438c4fe69b14 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b76ce9027c4421cb399438c4fe69b14" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 46783 } }
I20260811 08:08:51.747289 399 leader_election.cc:302] T 00000000000000000000000000000000 P 4b76ce9027c4421cb399438c4fe69b14 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4b76ce9027c4421cb399438c4fe69b14; no voters:
I20260811 08:08:51.747442 399 leader_election.cc:288] T 00000000000000000000000000000000 P 4b76ce9027c4421cb399438c4fe69b14 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:08:51.747485 404 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4b76ce9027c4421cb399438c4fe69b14 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:08:51.747684 399 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4b76ce9027c4421cb399438c4fe69b14 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:08:51.747931 404 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4b76ce9027c4421cb399438c4fe69b14 [term 1 LEADER]: Becoming Leader. State: Replica: 4b76ce9027c4421cb399438c4fe69b14, State: Running, Role: LEADER
I20260811 08:08:51.748028 404 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4b76ce9027c4421cb399438c4fe69b14 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b76ce9027c4421cb399438c4fe69b14" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 46783 } }
I20260811 08:08:51.748399 408 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4b76ce9027c4421cb399438c4fe69b14 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4b76ce9027c4421cb399438c4fe69b14" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b76ce9027c4421cb399438c4fe69b14" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 46783 } } }
I20260811 08:08:51.748418 411 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4b76ce9027c4421cb399438c4fe69b14 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4b76ce9027c4421cb399438c4fe69b14. Latest consensus state: current_term: 1 leader_uuid: "4b76ce9027c4421cb399438c4fe69b14" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b76ce9027c4421cb399438c4fe69b14" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 46783 } } }
I20260811 08:08:51.748476 408 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4b76ce9027c4421cb399438c4fe69b14 [sys.catalog]: This master's current role is: LEADER
I20260811 08:08:51.748502 411 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4b76ce9027c4421cb399438c4fe69b14 [sys.catalog]: This master's current role is: LEADER
I20260811 08:08:51.748684 424 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:08:51.749356 424 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:08:51.749576 436 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260811 08:08:51.749666 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 32754
I20260811 08:08:51.749760 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435717191469-28623-0/minicluster-data/master-0/wal/instance
I20260811 08:08:51.749933 28623 external_mini_cluster.cc:1428] Setting key 8ee24d0c995cde49d53998e8914921c4
I20260811 08:08:51.750907 424 catalog_manager.cc:1347] Generated new cluster ID: 0939a99b5e2e4d62b1390b1afc0c3a1d
I20260811 08:08:51.750959 424 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:08:51.759196 424 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:08:51.759707 424 catalog_manager.cc:1504] Loading token signing keys...
Aug 11 08:08:51 dist-test-slave-7lbf krb5kdc[32730](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435731, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.243.254@KRBTEST.COM
I20260811 08:08:51.762221 424 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4b76ce9027c4421cb399438c4fe69b14: Generated new TSK 0
I20260811 08:08:51.762382 424 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 08:08:51.764788 438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:51.750345 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58526 (local address 127.27.243.254:46783)
0811 08:08:51.753664 (+ 3319us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:51.753675 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:51.753715 (+ 40us) server_negotiation.cc:407] Connection header received
0811 08:08:51.753869 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:51.753876 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:51.753930 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:51.754086 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:51.754735 (+ 649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:51.756746 (+ 2011us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:51.757810 (+ 1064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:51.758464 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:51.758568 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:51.761374 (+ 2806us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:08:51.761378 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:08:51.761378 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:08:51.761390 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:08:51.763348 (+ 1958us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:51.763670 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:51.763673 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:51.763673 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:51.763791 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:51.763949 (+ 158us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:51.763949 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:51.763950 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:51.764207 (+ 257us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:08:51.764341 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:51.764409 (+ 68us) server_negotiation.cc:299] Negotiation successful
0811 08:08:51.764552 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3262,"thread_start_us":66,"threads_started":1}
WARNING: no policy specified for kudu/127.27.243.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.243.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.243.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.193.keytab.
Entry for principal kudu/127.27.243.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.193.keytab.
I20260811 08:08:51.790563 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435717191469-28623-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435717191469-28623-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435717191469-28623-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435717191469-28623-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.243.193:0
--local_ip_for_outbound_sockets=127.27.243.193
--webserver_interface=127.27.243.193
--webserver_port=0
--tserver_master_addrs=127.27.243.254:46783
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.193.keytab
--principal=kudu/127.27.243.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:40051
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:08:51.874699 448 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:08:51.874925 448 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:08:51.874959 448 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:08:51.876098 448 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:08:51.876145 448 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:08:51.876183 448 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.243.193
I20260811 08:08:51.877633 448 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:40051
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435717191469-28623-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435717191469-28623-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.193.keytab
--principal=kudu/127.27.243.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.243.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435717191469-28623-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.243.193
--webserver_port=0
--tserver_master_addrs=127.27.243.254:46783
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.448
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.243.193
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435717191469-28623-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:08:51.877880 448 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:08:51.878098 448 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:08:51.883189 465 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:08:51.883234 460 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:08:51.883190 462 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:08:51.883217 448 server_base.cc:1034] running on GCE node
I20260811 08:08:51.883594 448 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:08:51.883880 448 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:08:51.885026 448 hybrid_clock.cc:648] HybridClock initialized: now 1786435731885008 us; error 35 us; skew 500 ppm
Aug 11 08:08:51 dist-test-slave-7lbf krb5kdc[32730](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435731, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:08:51.887619 448 init.cc:377] Logged in from keytab as kudu/127.27.243.193@KRBTEST.COM (short username kudu)
I20260811 08:08:51.888077 448 webserver.cc:460] Webserver started at http://127.27.243.193:41033/ using document root <none> and password file <none>
I20260811 08:08:51.888278 448 fs_manager.cc:359] Metadata directory not provided
I20260811 08:08:51.888325 448 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:08:51.888453 448 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:08:51.889470 448 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435717191469-28623-0/minicluster-data/ts-0/data/instance:
uuid: "bae7387429ef492d97a82c22b070df41"
format_stamp: "Formatted at 2026-08-11 08:08:51 on dist-test-slave-7lbf"
server_key: "08b1fdc604e605bddb52a8537a5277ec"
server_key_iv: "b461b18f7201d8f34aae7036cf07da0c"
server_key_version: "encryptionkey@0"
I20260811 08:08:51.889858 448 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435717191469-28623-0/minicluster-data/ts-0/wal/instance:
uuid: "bae7387429ef492d97a82c22b070df41"
format_stamp: "Formatted at 2026-08-11 08:08:51 on dist-test-slave-7lbf"
server_key: "08b1fdc604e605bddb52a8537a5277ec"
server_key_iv: "b461b18f7201d8f34aae7036cf07da0c"
server_key_version: "encryptionkey@0"
I20260811 08:08:51.891197 448 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:08:51.891933 474 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:08:51.892138 448 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:08:51.892228 448 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435717191469-28623-0/minicluster-data/ts-0/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435717191469-28623-0/minicluster-data/ts-0/wal
uuid: "bae7387429ef492d97a82c22b070df41"
format_stamp: "Formatted at 2026-08-11 08:08:51 on dist-test-slave-7lbf"
server_key: "08b1fdc604e605bddb52a8537a5277ec"
server_key_iv: "b461b18f7201d8f34aae7036cf07da0c"
server_key_version: "encryptionkey@0"
I20260811 08:08:51.892297 448 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435717191469-28623-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435717191469-28623-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435717191469-28623-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:08:51.905746 448 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:08:51.907635 448 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:08:51.907779 448 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:08:51.908003 448 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:08:51.908315 448 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:08:51.908349 448 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:08:51.908389 448 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:08:51.908412 448 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:08:51.914196 448 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.193:42191
I20260811 08:08:51.914255 677 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.193:42191 every 8 connection(s)
I20260811 08:08:51.914556 448 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435717191469-28623-0/minicluster-data/ts-0/data/info.pb
I20260811 08:08:51.915939 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 448
I20260811 08:08:51.916011 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435717191469-28623-0/minicluster-data/ts-0/wal/instance
I20260811 08:08:51.916159 28623 external_mini_cluster.cc:1428] Setting key 229bd7ec2ecc2f97f178827950785dc6
Aug 11 08:08:51 dist-test-slave-7lbf krb5kdc[32730](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435731, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.193@KRBTEST.COM for kudu/127.27.243.254@KRBTEST.COM
I20260811 08:08:51.924432 438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:51.915289 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.193:60327 (local address 127.27.243.254:46783)
0811 08:08:51.915386 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:51.915389 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:51.915557 (+ 168us) server_negotiation.cc:407] Connection header received
0811 08:08:51.916154 (+ 597us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:51.916155 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:51.916170 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:51.916231 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:51.917361 (+ 1130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:51.917948 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:51.919251 (+ 1303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:51.919481 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:51.919538 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:51.921838 (+ 2300us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:08:51.921839 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:08:51.921840 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:08:51.921846 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:08:51.923180 (+ 1334us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:51.923545 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:51.923546 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:51.923547 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:51.923602 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:51.923822 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:51.923823 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:51.923823 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:51.923929 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:08:51.923993 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:51.924247 (+ 254us) server_negotiation.cc:299] Negotiation successful
0811 08:08:51.924346 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260811 08:08:51.924582 682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:51.915243 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:46783 (local address 127.27.243.193:60327)
0811 08:08:51.915432 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0811 08:08:51.915469 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 08:08:51.915990 (+ 521us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:08:51.916315 (+ 325us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:08:51.916319 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:08:51.917049 (+ 730us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:08:51.917244 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:51.917250 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:51.918036 (+ 786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:51.918038 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:51.919164 (+ 1126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:51.919167 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:51.919567 (+ 400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:51.919568 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:51.919718 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:51.920173 (+ 455us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:08:51.920183 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:08:51.921747 (+ 1564us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:08:51.923256 (+ 1509us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:08:51.923263 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:08:51.923265 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:08:51.923480 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:08:51.923657 (+ 177us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:08:51.923657 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:08:51.923658 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:08:51.923760 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:08:51.923992 (+ 232us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:08:51.923999 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:08:51.924131 (+ 132us) client_negotiation.cc:769] Sending connection context
0811 08:08:51.924218 (+ 87us) client_negotiation.cc:240] Negotiation successful
0811 08:08:51.924375 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":90,"threads_started":1}
I20260811 08:08:51.925028 678 heartbeater.cc:347] Connected to a master server at 127.27.243.254:46783
I20260811 08:08:51.925114 678 heartbeater.cc:464] Registering TS with master...
I20260811 08:08:51.925295 678 heartbeater.cc:511] Master 127.27.243.254:46783 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.27.243.194@KRBTEST.COM; defaulting to no policy
I20260811 08:08:51.925838 338 ts_manager.cc:194] Registered new tserver with Master: bae7387429ef492d97a82c22b070df41 (127.27.243.193:42191)
I20260811 08:08:51.926502 338 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.243.193@KRBTEST.COM'} at 127.27.243.193:60327
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.243.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.243.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.194.keytab.
Entry for principal kudu/127.27.243.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.194.keytab.
I20260811 08:08:51.942327 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435717191469-28623-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435717191469-28623-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435717191469-28623-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435717191469-28623-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.243.194:0
--local_ip_for_outbound_sockets=127.27.243.194
--webserver_interface=127.27.243.194
--webserver_port=0
--tserver_master_addrs=127.27.243.254:46783
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.194.keytab
--principal=kudu/127.27.243.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:40051
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:08:52.024421 690 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:08:52.024618 690 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:08:52.024641 690 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:08:52.025785 690 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:08:52.025826 690 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:08:52.025851 690 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.243.194
I20260811 08:08:52.027240 690 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:40051
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435717191469-28623-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435717191469-28623-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.194.keytab
--principal=kudu/127.27.243.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.243.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435717191469-28623-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.243.194
--webserver_port=0
--tserver_master_addrs=127.27.243.254:46783
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.690
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.243.194
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435717191469-28623-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:08:52.027421 690 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:08:52.027597 690 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:08:52.032186 697 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:08:52.032191 702 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:08:52.032466 690 server_base.cc:1034] running on GCE node
W20260811 08:08:52.032203 695 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:08:52.032713 690 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:08:52.032938 690 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:08:52.034065 690 hybrid_clock.cc:648] HybridClock initialized: now 1786435732034055 us; error 27 us; skew 500 ppm
Aug 11 08:08:52 dist-test-slave-7lbf krb5kdc[32730](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435732, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:08:52.036597 690 init.cc:377] Logged in from keytab as kudu/127.27.243.194@KRBTEST.COM (short username kudu)
I20260811 08:08:52.037032 690 webserver.cc:460] Webserver started at http://127.27.243.194:40539/ using document root <none> and password file <none>
I20260811 08:08:52.037228 690 fs_manager.cc:359] Metadata directory not provided
I20260811 08:08:52.037269 690 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:08:52.037384 690 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:08:52.038473 690 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435717191469-28623-0/minicluster-data/ts-1/data/instance:
uuid: "d8afeca5fde249ee8ef8147ed4bb28b8"
format_stamp: "Formatted at 2026-08-11 08:08:52 on dist-test-slave-7lbf"
server_key: "f921655a1d0576f8ccd50837371aa2f6"
server_key_iv: "14bbe257dd18e46bb8c391f3637b5d4c"
server_key_version: "encryptionkey@0"
I20260811 08:08:52.038779 690 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435717191469-28623-0/minicluster-data/ts-1/wal/instance:
uuid: "d8afeca5fde249ee8ef8147ed4bb28b8"
format_stamp: "Formatted at 2026-08-11 08:08:52 on dist-test-slave-7lbf"
server_key: "f921655a1d0576f8ccd50837371aa2f6"
server_key_iv: "14bbe257dd18e46bb8c391f3637b5d4c"
server_key_version: "encryptionkey@0"
I20260811 08:08:52.040037 690 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 08:08:52.040758 712 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:08:52.040915 690 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 08:08:52.040990 690 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435717191469-28623-0/minicluster-data/ts-1/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435717191469-28623-0/minicluster-data/ts-1/wal
uuid: "d8afeca5fde249ee8ef8147ed4bb28b8"
format_stamp: "Formatted at 2026-08-11 08:08:52 on dist-test-slave-7lbf"
server_key: "f921655a1d0576f8ccd50837371aa2f6"
server_key_iv: "14bbe257dd18e46bb8c391f3637b5d4c"
server_key_version: "encryptionkey@0"
I20260811 08:08:52.041054 690 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435717191469-28623-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435717191469-28623-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435717191469-28623-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:08:52.057322 690 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:08:52.059298 690 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:08:52.059427 690 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:08:52.059623 690 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:08:52.059928 690 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:08:52.059968 690 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:08:52.059996 690 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:08:52.060020 690 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:08:52.065692 690 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.194:43067
I20260811 08:08:52.065752 904 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.194:43067 every 8 connection(s)
I20260811 08:08:52.066030 690 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435717191469-28623-0/minicluster-data/ts-1/data/info.pb
I20260811 08:08:52.066932 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 690
I20260811 08:08:52.067011 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435717191469-28623-0/minicluster-data/ts-1/wal/instance
I20260811 08:08:52.067191 28623 external_mini_cluster.cc:1428] Setting key d30b4f70372f5cd2e6ff221d1d3088dc
Aug 11 08:08:52 dist-test-slave-7lbf krb5kdc[32730](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435732, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.194@KRBTEST.COM for kudu/127.27.243.254@KRBTEST.COM
I20260811 08:08:52.075052 438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:52.066702 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.194:55781 (local address 127.27.243.254:46783)
0811 08:08:52.066758 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:52.066759 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:52.066937 (+ 178us) server_negotiation.cc:407] Connection header received
0811 08:08:52.067497 (+ 560us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:52.067498 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:52.067511 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:52.067561 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:52.068507 (+ 946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:52.069005 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:52.070065 (+ 1060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:52.070263 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:52.070319 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:52.072507 (+ 2188us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:08:52.072508 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:08:52.072508 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:08:52.072516 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:08:52.073811 (+ 1295us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:52.074171 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:52.074172 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:52.074173 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:52.074224 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:52.074437 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:52.074437 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:52.074438 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:52.074545 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:08:52.074602 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:52.074854 (+ 252us) server_negotiation.cc:299] Negotiation successful
0811 08:08:52.074958 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260811 08:08:52.075194 909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:52.066656 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:46783 (local address 127.27.243.194:55781)
0811 08:08:52.066807 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0811 08:08:52.066846 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 08:08:52.067413 (+ 567us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:08:52.067634 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:08:52.067639 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:08:52.068231 (+ 592us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:08:52.068419 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:52.068424 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:52.069086 (+ 662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:52.069088 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:52.069981 (+ 893us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:52.069984 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:52.070330 (+ 346us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:52.070331 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:52.070459 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:52.070935 (+ 476us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:08:52.070944 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:08:52.072413 (+ 1469us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:08:52.073891 (+ 1478us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:08:52.073899 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:08:52.073901 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:08:52.074105 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:08:52.074277 (+ 172us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:08:52.074278 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:08:52.074279 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:08:52.074382 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:08:52.074600 (+ 218us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:08:52.074606 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:08:52.074737 (+ 131us) client_negotiation.cc:769] Sending connection context
0811 08:08:52.074826 (+ 89us) client_negotiation.cc:240] Negotiation successful
0811 08:08:52.074989 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":81,"threads_started":1}
WARNING: no policy specified for kudu/127.27.243.195@KRBTEST.COM; defaulting to no policy
I20260811 08:08:52.075744 905 heartbeater.cc:347] Connected to a master server at 127.27.243.254:46783
I20260811 08:08:52.075836 905 heartbeater.cc:464] Registering TS with master...
I20260811 08:08:52.076007 905 heartbeater.cc:511] Master 127.27.243.254:46783 requested a full tablet report, sending...
I20260811 08:08:52.076349 338 ts_manager.cc:194] Registered new tserver with Master: d8afeca5fde249ee8ef8147ed4bb28b8 (127.27.243.194:43067)
I20260811 08:08:52.076684 338 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.243.194@KRBTEST.COM'} at 127.27.243.194:55781
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.243.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.243.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.195.keytab.
Entry for principal kudu/127.27.243.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.195.keytab.
I20260811 08:08:52.092224 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435717191469-28623-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435717191469-28623-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435717191469-28623-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435717191469-28623-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.243.195:0
--local_ip_for_outbound_sockets=127.27.243.195
--webserver_interface=127.27.243.195
--webserver_port=0
--tserver_master_addrs=127.27.243.254:46783
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.195.keytab
--principal=kudu/127.27.243.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:40051
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:08:52.173820 912 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:08:52.174026 912 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:08:52.174059 912 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:08:52.175189 912 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:08:52.175235 912 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:08:52.175272 912 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.243.195
I20260811 08:08:52.176671 912 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:40051
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435717191469-28623-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435717191469-28623-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.195.keytab
--principal=kudu/127.27.243.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.243.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435717191469-28623-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.243.195
--webserver_port=0
--tserver_master_addrs=127.27.243.254:46783
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.912
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.243.195
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435717191469-28623-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:08:52.176899 912 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:08:52.177115 912 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:08:52.181838 922 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:08:52.181887 923 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:08:52.181926 925 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:08:52.182159 912 server_base.cc:1034] running on GCE node
I20260811 08:08:52.182329 912 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:08:52.182518 912 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:08:52.183660 912 hybrid_clock.cc:648] HybridClock initialized: now 1786435732183647 us; error 26 us; skew 500 ppm
Aug 11 08:08:52 dist-test-slave-7lbf krb5kdc[32730](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435732, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:08:52.186172 912 init.cc:377] Logged in from keytab as kudu/127.27.243.195@KRBTEST.COM (short username kudu)
I20260811 08:08:52.186602 912 webserver.cc:460] Webserver started at http://127.27.243.195:37017/ using document root <none> and password file <none>
I20260811 08:08:52.186818 912 fs_manager.cc:359] Metadata directory not provided
I20260811 08:08:52.186867 912 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:08:52.187008 912 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:08:52.188076 912 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435717191469-28623-0/minicluster-data/ts-2/data/instance:
uuid: "b17d483dfbfe42919fc5e3e99d381e34"
format_stamp: "Formatted at 2026-08-11 08:08:52 on dist-test-slave-7lbf"
server_key: "6c6b0b4159782bea6eff278cd54e49d3"
server_key_iv: "dd0288bdb715d77060e526361e498098"
server_key_version: "encryptionkey@0"
I20260811 08:08:52.188395 912 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435717191469-28623-0/minicluster-data/ts-2/wal/instance:
uuid: "b17d483dfbfe42919fc5e3e99d381e34"
format_stamp: "Formatted at 2026-08-11 08:08:52 on dist-test-slave-7lbf"
server_key: "6c6b0b4159782bea6eff278cd54e49d3"
server_key_iv: "dd0288bdb715d77060e526361e498098"
server_key_version: "encryptionkey@0"
I20260811 08:08:52.189647 912 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 08:08:52.190313 937 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:08:52.190472 912 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 08:08:52.190575 912 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435717191469-28623-0/minicluster-data/ts-2/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435717191469-28623-0/minicluster-data/ts-2/wal
uuid: "b17d483dfbfe42919fc5e3e99d381e34"
format_stamp: "Formatted at 2026-08-11 08:08:52 on dist-test-slave-7lbf"
server_key: "6c6b0b4159782bea6eff278cd54e49d3"
server_key_iv: "dd0288bdb715d77060e526361e498098"
server_key_version: "encryptionkey@0"
I20260811 08:08:52.190630 912 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435717191469-28623-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435717191469-28623-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435717191469-28623-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:08:52.213449 912 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:08:52.215543 912 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:08:52.215654 912 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:08:52.215837 912 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:08:52.216096 912 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:08:52.216126 912 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:08:52.216146 912 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:08:52.216157 912 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:08:52.221889 912 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.195:44283
I20260811 08:08:52.221948 1134 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.195:44283 every 8 connection(s)
I20260811 08:08:52.222241 912 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435717191469-28623-0/minicluster-data/ts-2/data/info.pb
I20260811 08:08:52.227291 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 912
I20260811 08:08:52.227381 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435717191469-28623-0/minicluster-data/ts-2/wal/instance
I20260811 08:08:52.227571 28623 external_mini_cluster.cc:1428] Setting key 4641216b735201c044d50da6ff6463f9
Aug 11 08:08:52 dist-test-slave-7lbf krb5kdc[32730](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435732, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.195@KRBTEST.COM for kudu/127.27.243.254@KRBTEST.COM
I20260811 08:08:52.230754 438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:52.222926 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.195:54681 (local address 127.27.243.254:46783)
0811 08:08:52.223010 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:52.223013 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:52.223213 (+ 200us) server_negotiation.cc:407] Connection header received
0811 08:08:52.223684 (+ 471us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:52.223685 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:52.223696 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:52.223755 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:52.224626 (+ 871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:52.225131 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:52.226195 (+ 1064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:52.226409 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:52.226468 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:52.228555 (+ 2087us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:08:52.228556 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:08:52.228556 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:08:52.228563 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:08:52.229712 (+ 1149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:52.230060 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:52.230060 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:52.230061 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:52.230107 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:52.230280 (+ 173us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:52.230281 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:52.230281 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:52.230375 (+ 94us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:08:52.230418 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:52.230632 (+ 214us) server_negotiation.cc:299] Negotiation successful
0811 08:08:52.230692 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260811 08:08:52.230927 1137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:52.222917 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:46783 (local address 127.27.243.195:54681)
0811 08:08:52.223089 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0811 08:08:52.223131 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 08:08:52.223609 (+ 478us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:08:52.223810 (+ 201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:08:52.223813 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:08:52.224365 (+ 552us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:08:52.224558 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:52.224563 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:52.225214 (+ 651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:52.225215 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:52.226094 (+ 879us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:52.226097 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:52.226474 (+ 377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:52.226475 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:52.226572 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:52.226991 (+ 419us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:08:52.226999 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:08:52.228477 (+ 1478us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:08:52.229783 (+ 1306us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:08:52.229789 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:08:52.229791 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:08:52.230004 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:08:52.230149 (+ 145us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:08:52.230149 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:08:52.230149 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:08:52.230239 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:08:52.230417 (+ 178us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:08:52.230420 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:08:52.230526 (+ 106us) client_negotiation.cc:769] Sending connection context
0811 08:08:52.230614 (+ 88us) client_negotiation.cc:240] Negotiation successful
0811 08:08:52.230729 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":88,"threads_started":1}
I20260811 08:08:52.231310 1135 heartbeater.cc:347] Connected to a master server at 127.27.243.254:46783
I20260811 08:08:52.231410 1135 heartbeater.cc:464] Registering TS with master...
I20260811 08:08:52.231578 1135 heartbeater.cc:511] Master 127.27.243.254:46783 requested a full tablet report, sending...
I20260811 08:08:52.231913 338 ts_manager.cc:194] Registered new tserver with Master: b17d483dfbfe42919fc5e3e99d381e34 (127.27.243.195:44283)
I20260811 08:08:52.232262 338 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.243.195@KRBTEST.COM'} at 127.27.243.195:54681
I20260811 08:08:52.239063 28623 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260811 08:08:52.250581 438 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:08:52.249806 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58540 (local address 127.27.243.254:46783)
0811 08:08:52.249883 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:52.249885 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:52.249954 (+ 69us) server_negotiation.cc:407] Connection header received
0811 08:08:52.250010 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:52.250011 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:52.250020 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:52.250060 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:52.250523 (+ 463us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58540: BlockingRecv error: recv got EOF from 127.0.0.1:58540 (error 108)
Metrics: {"server-negotiator.queue_time_us":31}
I20260811 08:08:52.251606 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 448
I20260811 08:08:52.266177 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 690
I20260811 08:08:52.274710 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 912
I20260811 08:08:52.283869 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 32754
2026-08-11T08:08:52Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (1949 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786435717191469-28623-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:08:52 dist-test-slave-7lbf krb5kdc[1151](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:08:52 dist-test-slave-7lbf krb5kdc[1151](info): set up 2 sockets
Aug 11 08:08:52 dist-test-slave-7lbf krb5kdc[1151](info): commencing operation
krb5kdc: starting...
W20260811 08:08:53.441068 28623 mini_kdc.cc:121] Time spent starting KDC: real 1.133s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786435717191469-28623-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786435717191469-28623-0/krb5kdc/test-user.keytab.
Aug 11 08:08:53 dist-test-slave-7lbf krb5kdc[1151](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435733, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:08:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:08:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.27.243.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.243.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.243.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab.
Entry for principal kudu/127.27.243.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab.
I20260811 08:08:53.558320 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786435717191469-28623-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786435717191469-28623-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786435717191469-28623-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.243.254:37685
--webserver_interface=127.27.243.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab
--principal=kudu/127.27.243.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:36959
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.243.254:37685
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:08:53.638494 1172 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:08:53.638690 1172 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:08:53.638710 1172 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:08:53.639830 1172 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:08:53.639874 1172 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:08:53.639894 1172 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:08:53.639910 1172 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:08:53.639925 1172 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:08:53.641381 1172 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:36959
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786435717191469-28623-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786435717191469-28623-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.243.254:37685
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab
--principal=kudu/127.27.243.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.243.254:37685
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.243.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1172
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786435717191469-28623-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:08:53.641657 1172 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:08:53.641855 1172 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:08:53.646472 1182 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:08:53.646484 1187 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:08:53.646481 1181 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:08:53.646657 1172 server_base.cc:1034] running on GCE node
I20260811 08:08:53.646946 1172 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:08:53.647208 1172 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:08:53.648343 1172 hybrid_clock.cc:648] HybridClock initialized: now 1786435733648329 us; error 31 us; skew 500 ppm
Aug 11 08:08:53 dist-test-slave-7lbf krb5kdc[1151](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435733, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:08:53.650862 1172 init.cc:377] Logged in from keytab as kudu/127.27.243.254@KRBTEST.COM (short username kudu)
I20260811 08:08:53.651283 1172 webserver.cc:460] Webserver started at http://127.27.243.254:42799/ using document root <none> and password file <none>
I20260811 08:08:53.651471 1172 fs_manager.cc:359] Metadata directory not provided
I20260811 08:08:53.651520 1172 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:08:53.651648 1172 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:08:53.652648 1172 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786435717191469-28623-0/minicluster-data/master-0/data/instance:
uuid: "c115563b98534c4d890693b402de28c6"
format_stamp: "Formatted at 2026-08-11 08:08:53 on dist-test-slave-7lbf"
server_key: "0b3f027d7c35d4e99a0eae567b8d7e16"
server_key_iv: "601ea563e85372aeb65f994f3a47d171"
server_key_version: "encryptionkey@0"
I20260811 08:08:53.652987 1172 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786435717191469-28623-0/minicluster-data/master-0/wal/instance:
uuid: "c115563b98534c4d890693b402de28c6"
format_stamp: "Formatted at 2026-08-11 08:08:53 on dist-test-slave-7lbf"
server_key: "0b3f027d7c35d4e99a0eae567b8d7e16"
server_key_iv: "601ea563e85372aeb65f994f3a47d171"
server_key_version: "encryptionkey@0"
I20260811 08:08:53.654286 1172 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260811 08:08:53.654932 1209 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:08:53.655113 1172 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 08:08:53.655198 1172 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786435717191469-28623-0/minicluster-data/master-0/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786435717191469-28623-0/minicluster-data/master-0/wal
uuid: "c115563b98534c4d890693b402de28c6"
format_stamp: "Formatted at 2026-08-11 08:08:53 on dist-test-slave-7lbf"
server_key: "0b3f027d7c35d4e99a0eae567b8d7e16"
server_key_iv: "601ea563e85372aeb65f994f3a47d171"
server_key_version: "encryptionkey@0"
I20260811 08:08:53.655256 1172 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786435717191469-28623-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786435717191469-28623-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786435717191469-28623-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:08:53.672257 1172 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:08:53.674368 1172 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:08:53.674506 1172 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:08:53.678306 1172 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.254:37685
I20260811 08:08:53.678357 1288 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.254:37685 every 8 connection(s)
I20260811 08:08:53.678860 1172 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
I20260811 08:08:53.679636 1289 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:08:53.681933 1289 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c115563b98534c4d890693b402de28c6: Bootstrap starting.
I20260811 08:08:53.682482 1289 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c115563b98534c4d890693b402de28c6: Neither blocks nor log segments found. Creating new log.
I20260811 08:08:53.682715 1289 log.cc:824] T 00000000000000000000000000000000 P c115563b98534c4d890693b402de28c6: Log is configured to *not* fsync() on all Append() calls
I20260811 08:08:53.683007 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 1172
I20260811 08:08:53.683094 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786435717191469-28623-0/minicluster-data/master-0/wal/instance
I20260811 08:08:53.683256 28623 external_mini_cluster.cc:1428] Setting key 21152857561ffec3b024847c51a7543c
I20260811 08:08:53.683444 1289 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c115563b98534c4d890693b402de28c6: No bootstrap required, opened a new log
I20260811 08:08:53.685756 1289 raft_consensus.cc:348] T 00000000000000000000000000000000 P c115563b98534c4d890693b402de28c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c115563b98534c4d890693b402de28c6" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 37685 } }
I20260811 08:08:53.685891 1289 raft_consensus.cc:374] T 00000000000000000000000000000000 P c115563b98534c4d890693b402de28c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:08:53.685913 1289 raft_consensus.cc:729] T 00000000000000000000000000000000 P c115563b98534c4d890693b402de28c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c115563b98534c4d890693b402de28c6, State: Initialized, Role: FOLLOWER
I20260811 08:08:53.686021 1289 consensus_queue.cc:260] T 00000000000000000000000000000000 P c115563b98534c4d890693b402de28c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c115563b98534c4d890693b402de28c6" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 37685 } }
I20260811 08:08:53.686085 1289 raft_consensus.cc:388] T 00000000000000000000000000000000 P c115563b98534c4d890693b402de28c6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:08:53.686108 1289 raft_consensus.cc:482] T 00000000000000000000000000000000 P c115563b98534c4d890693b402de28c6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:08:53.686151 1289 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c115563b98534c4d890693b402de28c6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:08:53.686663 1289 raft_consensus.cc:504] T 00000000000000000000000000000000 P c115563b98534c4d890693b402de28c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c115563b98534c4d890693b402de28c6" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 37685 } }
I20260811 08:08:53.686759 1289 leader_election.cc:302] T 00000000000000000000000000000000 P c115563b98534c4d890693b402de28c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c115563b98534c4d890693b402de28c6; no voters:
I20260811 08:08:53.686909 1289 leader_election.cc:288] T 00000000000000000000000000000000 P c115563b98534c4d890693b402de28c6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:08:53.686946 1297 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c115563b98534c4d890693b402de28c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:08:53.687045 1297 raft_consensus.cc:686] T 00000000000000000000000000000000 P c115563b98534c4d890693b402de28c6 [term 1 LEADER]: Becoming Leader. State: Replica: c115563b98534c4d890693b402de28c6, State: Running, Role: LEADER
I20260811 08:08:53.687155 1289 sys_catalog.cc:564] T 00000000000000000000000000000000 P c115563b98534c4d890693b402de28c6 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:08:53.687135 1297 consensus_queue.cc:237] T 00000000000000000000000000000000 P c115563b98534c4d890693b402de28c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c115563b98534c4d890693b402de28c6" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 37685 } }
I20260811 08:08:53.687597 1297 sys_catalog.cc:455] T 00000000000000000000000000000000 P c115563b98534c4d890693b402de28c6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c115563b98534c4d890693b402de28c6. Latest consensus state: current_term: 1 leader_uuid: "c115563b98534c4d890693b402de28c6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c115563b98534c4d890693b402de28c6" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 37685 } } }
I20260811 08:08:53.687601 1299 sys_catalog.cc:455] T 00000000000000000000000000000000 P c115563b98534c4d890693b402de28c6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c115563b98534c4d890693b402de28c6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c115563b98534c4d890693b402de28c6" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 37685 } } }
I20260811 08:08:53.687685 1297 sys_catalog.cc:458] T 00000000000000000000000000000000 P c115563b98534c4d890693b402de28c6 [sys.catalog]: This master's current role is: LEADER
I20260811 08:08:53.687708 1299 sys_catalog.cc:458] T 00000000000000000000000000000000 P c115563b98534c4d890693b402de28c6 [sys.catalog]: This master's current role is: LEADER
I20260811 08:08:53.688400 1306 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:08:53.688905 1306 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 11 08:08:53 dist-test-slave-7lbf krb5kdc[1151](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435733, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.243.254@KRBTEST.COM
I20260811 08:08:53.690806 1306 catalog_manager.cc:1347] Generated new cluster ID: bc0091b833ef4a27bb1924e388f03b2f
I20260811 08:08:53.690852 1306 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:08:53.694618 1295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:53.683702 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48354 (local address 127.27.243.254:37685)
0811 08:08:53.683899 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:53.683908 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:53.683939 (+ 31us) server_negotiation.cc:407] Connection header received
0811 08:08:53.684619 (+ 680us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:53.684626 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:53.684673 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:53.684792 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:53.685396 (+ 604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:53.686441 (+ 1045us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:53.687304 (+ 863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:53.688011 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:53.688111 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:53.691187 (+ 3076us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:08:53.691191 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:08:53.691191 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:08:53.691202 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:08:53.692963 (+ 1761us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:53.693353 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:53.693355 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:53.693356 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:53.693476 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:53.693680 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:53.693681 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:53.693681 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:53.693952 (+ 271us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:08:53.694092 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:53.694195 (+ 103us) server_negotiation.cc:299] Negotiation successful
0811 08:08:53.694314 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142,"thread_start_us":90,"threads_started":1}
I20260811 08:08:53.695461 28623 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 08:08:53.697844 1306 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:08:53.698563 1306 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:08:53.708491 1306 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c115563b98534c4d890693b402de28c6: Generated new TSK 0
I20260811 08:08:53.708657 1306 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 08:08:53.710866 1295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:53.706809 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48370 (local address 127.27.243.254:37685)
0811 08:08:53.706854 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:53.706856 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:53.707015 (+ 159us) server_negotiation.cc:407] Connection header received
0811 08:08:53.707077 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:53.707078 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:53.707088 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:53.707136 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:53.707481 (+ 345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:53.707989 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:53.708978 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:53.709737 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:53.709809 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:53.710445 (+ 636us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:08:53.710446 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:08:53.710447 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:08:53.710620 (+ 173us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:08:53.710635 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:08:53.710641 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:08:53.710694 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:53.710763 (+ 69us) server_negotiation.cc:299] Negotiation successful
0811 08:08:53.710797 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 08:08:53.713438 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 1172
2026-08-11T08:08:53Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (1441 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435717191469-28623-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:08:53 dist-test-slave-7lbf krb5kdc[1346](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:08:53 dist-test-slave-7lbf krb5kdc[1346](info): set up 2 sockets
Aug 11 08:08:53 dist-test-slave-7lbf krb5kdc[1346](info): commencing operation
krb5kdc: starting...
W20260811 08:08:54.916795 28623 mini_kdc.cc:121] Time spent starting KDC: real 1.167s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435717191469-28623-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435717191469-28623-0/krb5kdc/test-user.keytab.
Aug 11 08:08:54 dist-test-slave-7lbf krb5kdc[1346](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435734, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:08:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:08:55Z Disabled control of system clock
WARNING: no policy specified for kudu/127.27.243.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.243.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.243.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab.
Entry for principal kudu/127.27.243.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab.
I20260811 08:08:55.032686 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435717191469-28623-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435717191469-28623-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435717191469-28623-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.243.254:38069
--webserver_interface=127.27.243.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab
--principal=kudu/127.27.243.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:41759
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.243.254:38069
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:08:55.112413 1372 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:08:55.112600 1372 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:08:55.112622 1372 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:08:55.113747 1372 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:08:55.113787 1372 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:08:55.113809 1372 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:08:55.113821 1372 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:08:55.113845 1372 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:08:55.115311 1372 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:41759
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435717191469-28623-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435717191469-28623-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.243.254:38069
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab
--principal=kudu/127.27.243.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.243.254:38069
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.243.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1372
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435717191469-28623-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:08:55.115545 1372 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:08:55.115743 1372 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:08:55.120463 1380 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:08:55.120429 1381 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:08:55.120515 1372 server_base.cc:1034] running on GCE node
W20260811 08:08:55.120471 1385 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:08:55.120939 1372 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:08:55.121227 1372 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:08:55.122363 1372 hybrid_clock.cc:648] HybridClock initialized: now 1786435735122346 us; error 35 us; skew 500 ppm
Aug 11 08:08:55 dist-test-slave-7lbf krb5kdc[1346](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435735, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:08:55.124873 1372 init.cc:377] Logged in from keytab as kudu/127.27.243.254@KRBTEST.COM (short username kudu)
I20260811 08:08:55.125270 1372 webserver.cc:460] Webserver started at http://127.27.243.254:34943/ using document root <none> and password file <none>
I20260811 08:08:55.125492 1372 fs_manager.cc:359] Metadata directory not provided
I20260811 08:08:55.125567 1372 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:08:55.125689 1372 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:08:55.126739 1372 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435717191469-28623-0/minicluster-data/master-0/data/instance:
uuid: "c78d55009b314f64b6c537ff525c904e"
format_stamp: "Formatted at 2026-08-11 08:08:55 on dist-test-slave-7lbf"
server_key: "cf0a6599504a29c8a1acdd3d75f27302"
server_key_iv: "cf9bd1fbd4a4124e7e94bacfd0757cd3"
server_key_version: "encryptionkey@0"
I20260811 08:08:55.127059 1372 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435717191469-28623-0/minicluster-data/master-0/wal/instance:
uuid: "c78d55009b314f64b6c537ff525c904e"
format_stamp: "Formatted at 2026-08-11 08:08:55 on dist-test-slave-7lbf"
server_key: "cf0a6599504a29c8a1acdd3d75f27302"
server_key_iv: "cf9bd1fbd4a4124e7e94bacfd0757cd3"
server_key_version: "encryptionkey@0"
I20260811 08:08:55.128283 1372 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 08:08:55.128924 1396 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:08:55.129088 1372 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 08:08:55.129171 1372 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435717191469-28623-0/minicluster-data/master-0/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435717191469-28623-0/minicluster-data/master-0/wal
uuid: "c78d55009b314f64b6c537ff525c904e"
format_stamp: "Formatted at 2026-08-11 08:08:55 on dist-test-slave-7lbf"
server_key: "cf0a6599504a29c8a1acdd3d75f27302"
server_key_iv: "cf9bd1fbd4a4124e7e94bacfd0757cd3"
server_key_version: "encryptionkey@0"
I20260811 08:08:55.129231 1372 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435717191469-28623-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435717191469-28623-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435717191469-28623-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:08:55.150044 1372 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:08:55.151815 1372 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:08:55.151947 1372 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:08:55.155649 1372 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.254:38069
I20260811 08:08:55.155682 1499 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.254:38069 every 8 connection(s)
I20260811 08:08:55.156018 1372 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
I20260811 08:08:55.157033 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 1372
I20260811 08:08:55.157136 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435717191469-28623-0/minicluster-data/master-0/wal/instance
I20260811 08:08:55.157209 1500 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:08:55.157323 28623 external_mini_cluster.cc:1428] Setting key e5204fb37a6003e28b86f7175fd85928
I20260811 08:08:55.160183 1500 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c78d55009b314f64b6c537ff525c904e: Bootstrap starting.
I20260811 08:08:55.160830 1500 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c78d55009b314f64b6c537ff525c904e: Neither blocks nor log segments found. Creating new log.
I20260811 08:08:55.161125 1500 log.cc:824] T 00000000000000000000000000000000 P c78d55009b314f64b6c537ff525c904e: Log is configured to *not* fsync() on all Append() calls
I20260811 08:08:55.161791 1500 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c78d55009b314f64b6c537ff525c904e: No bootstrap required, opened a new log
I20260811 08:08:55.163697 1500 raft_consensus.cc:348] T 00000000000000000000000000000000 P c78d55009b314f64b6c537ff525c904e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c78d55009b314f64b6c537ff525c904e" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 38069 } }
Aug 11 08:08:55 dist-test-slave-7lbf krb5kdc[1346](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435734, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.243.254@KRBTEST.COM
I20260811 08:08:55.163861 1500 raft_consensus.cc:374] T 00000000000000000000000000000000 P c78d55009b314f64b6c537ff525c904e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:08:55.163895 1500 raft_consensus.cc:729] T 00000000000000000000000000000000 P c78d55009b314f64b6c537ff525c904e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c78d55009b314f64b6c537ff525c904e, State: Initialized, Role: FOLLOWER
I20260811 08:08:55.164021 1500 consensus_queue.cc:260] T 00000000000000000000000000000000 P c78d55009b314f64b6c537ff525c904e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c78d55009b314f64b6c537ff525c904e" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 38069 } }
I20260811 08:08:55.164125 1500 raft_consensus.cc:388] T 00000000000000000000000000000000 P c78d55009b314f64b6c537ff525c904e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:08:55.164165 1500 raft_consensus.cc:482] T 00000000000000000000000000000000 P c78d55009b314f64b6c537ff525c904e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:08:55.164212 1500 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c78d55009b314f64b6c537ff525c904e [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:08:55.164734 1500 raft_consensus.cc:504] T 00000000000000000000000000000000 P c78d55009b314f64b6c537ff525c904e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c78d55009b314f64b6c537ff525c904e" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 38069 } }
I20260811 08:08:55.164832 1500 leader_election.cc:302] T 00000000000000000000000000000000 P c78d55009b314f64b6c537ff525c904e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c78d55009b314f64b6c537ff525c904e; no voters:
I20260811 08:08:55.164990 1500 leader_election.cc:288] T 00000000000000000000000000000000 P c78d55009b314f64b6c537ff525c904e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:08:55.165052 1510 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c78d55009b314f64b6c537ff525c904e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:08:55.165232 1500 sys_catalog.cc:564] T 00000000000000000000000000000000 P c78d55009b314f64b6c537ff525c904e [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:08:55.165484 1510 raft_consensus.cc:686] T 00000000000000000000000000000000 P c78d55009b314f64b6c537ff525c904e [term 1 LEADER]: Becoming Leader. State: Replica: c78d55009b314f64b6c537ff525c904e, State: Running, Role: LEADER
I20260811 08:08:55.165624 1510 consensus_queue.cc:237] T 00000000000000000000000000000000 P c78d55009b314f64b6c537ff525c904e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c78d55009b314f64b6c537ff525c904e" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 38069 } }
I20260811 08:08:55.166358 1513 sys_catalog.cc:455] T 00000000000000000000000000000000 P c78d55009b314f64b6c537ff525c904e [sys.catalog]: SysCatalogTable state changed. Reason: New leader c78d55009b314f64b6c537ff525c904e. Latest consensus state: current_term: 1 leader_uuid: "c78d55009b314f64b6c537ff525c904e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c78d55009b314f64b6c537ff525c904e" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 38069 } } }
I20260811 08:08:55.166445 1513 sys_catalog.cc:458] T 00000000000000000000000000000000 P c78d55009b314f64b6c537ff525c904e [sys.catalog]: This master's current role is: LEADER
I20260811 08:08:55.166715 1536 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:08:55.166749 1512 sys_catalog.cc:455] T 00000000000000000000000000000000 P c78d55009b314f64b6c537ff525c904e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c78d55009b314f64b6c537ff525c904e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c78d55009b314f64b6c537ff525c904e" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 38069 } } }
I20260811 08:08:55.166872 1512 sys_catalog.cc:458] T 00000000000000000000000000000000 P c78d55009b314f64b6c537ff525c904e [sys.catalog]: This master's current role is: LEADER
I20260811 08:08:55.167780 1505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:55.157858 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57666 (local address 127.27.243.254:38069)
0811 08:08:55.158041 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:55.158050 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:55.158079 (+ 29us) server_negotiation.cc:407] Connection header received
0811 08:08:55.158641 (+ 562us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:55.158648 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:55.158694 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:55.158811 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:55.159541 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:55.160493 (+ 952us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:55.161474 (+ 981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:55.161939 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:55.162037 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:55.164393 (+ 2356us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:08:55.164397 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:08:55.164397 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:08:55.164407 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:08:55.166163 (+ 1756us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:55.166589 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:55.166592 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:55.166593 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:55.166711 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:55.166942 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:55.166943 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:55.166943 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:55.167190 (+ 247us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:08:55.167337 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:55.167463 (+ 126us) server_negotiation.cc:299] Negotiation successful
0811 08:08:55.167593 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":135,"thread_start_us":83,"threads_started":1}
I20260811 08:08:55.167310 1536 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:08:55.169167 1536 catalog_manager.cc:1347] Generated new cluster ID: 206083560b154935a37db432998d0028
I20260811 08:08:55.169219 1536 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:08:55.185084 1536 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:08:55.185635 1536 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:08:55.195004 1536 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c78d55009b314f64b6c537ff525c904e: Generated new TSK 0
I20260811 08:08:55.195158 1536 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.27.243.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.243.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.243.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.193.keytab.
Entry for principal kudu/127.27.243.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.193.keytab.
I20260811 08:08:55.220592 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435717191469-28623-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435717191469-28623-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435717191469-28623-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435717191469-28623-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.243.193:0
--local_ip_for_outbound_sockets=127.27.243.193
--webserver_interface=127.27.243.193
--webserver_port=0
--tserver_master_addrs=127.27.243.254:38069
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.193.keytab
--principal=kudu/127.27.243.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:41759
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:08:55.301174 1546 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:08:55.301368 1546 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:08:55.301390 1546 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:08:55.302527 1546 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:08:55.302569 1546 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:08:55.302595 1546 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.243.193
I20260811 08:08:55.303997 1546 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:41759
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435717191469-28623-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435717191469-28623-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.193.keytab
--principal=kudu/127.27.243.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.243.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435717191469-28623-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.243.193
--webserver_port=0
--tserver_master_addrs=127.27.243.254:38069
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1546
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.243.193
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435717191469-28623-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:08:55.304208 1546 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:08:55.304426 1546 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:08:55.309257 1556 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:08:55.309297 1553 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:08:55.309257 1552 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:08:55.309594 1546 server_base.cc:1034] running on GCE node
I20260811 08:08:55.309762 1546 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:08:55.309993 1546 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:08:55.311133 1546 hybrid_clock.cc:648] HybridClock initialized: now 1786435735311115 us; error 35 us; skew 500 ppm
Aug 11 08:08:55 dist-test-slave-7lbf krb5kdc[1346](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435735, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:08:55.313431 1546 init.cc:377] Logged in from keytab as kudu/127.27.243.193@KRBTEST.COM (short username kudu)
I20260811 08:08:55.313860 1546 webserver.cc:460] Webserver started at http://127.27.243.193:35431/ using document root <none> and password file <none>
I20260811 08:08:55.314038 1546 fs_manager.cc:359] Metadata directory not provided
I20260811 08:08:55.314075 1546 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:08:55.314164 1546 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:08:55.315137 1546 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435717191469-28623-0/minicluster-data/ts-0/data/instance:
uuid: "aa788f3c7987428db6de21ce28e7765e"
format_stamp: "Formatted at 2026-08-11 08:08:55 on dist-test-slave-7lbf"
server_key: "9e40fa2b6cec50ad4c4157f2fdb0196b"
server_key_iv: "e6117e5a81cec0e8e52d53903b2c7507"
server_key_version: "encryptionkey@0"
I20260811 08:08:55.315443 1546 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435717191469-28623-0/minicluster-data/ts-0/wal/instance:
uuid: "aa788f3c7987428db6de21ce28e7765e"
format_stamp: "Formatted at 2026-08-11 08:08:55 on dist-test-slave-7lbf"
server_key: "9e40fa2b6cec50ad4c4157f2fdb0196b"
server_key_iv: "e6117e5a81cec0e8e52d53903b2c7507"
server_key_version: "encryptionkey@0"
I20260811 08:08:55.316656 1546 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 08:08:55.317296 1567 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:08:55.317448 1546 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 08:08:55.317546 1546 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435717191469-28623-0/minicluster-data/ts-0/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435717191469-28623-0/minicluster-data/ts-0/wal
uuid: "aa788f3c7987428db6de21ce28e7765e"
format_stamp: "Formatted at 2026-08-11 08:08:55 on dist-test-slave-7lbf"
server_key: "9e40fa2b6cec50ad4c4157f2fdb0196b"
server_key_iv: "e6117e5a81cec0e8e52d53903b2c7507"
server_key_version: "encryptionkey@0"
I20260811 08:08:55.317608 1546 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435717191469-28623-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435717191469-28623-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435717191469-28623-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:08:55.331027 1546 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:08:55.332858 1546 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:08:55.333002 1546 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:08:55.333216 1546 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:08:55.333509 1546 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:08:55.333575 1546 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:08:55.333606 1546 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:08:55.333629 1546 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:08:55.339337 1546 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.193:37159
I20260811 08:08:55.339401 1754 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.193:37159 every 8 connection(s)
I20260811 08:08:55.339679 1546 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435717191469-28623-0/minicluster-data/ts-0/data/info.pb
Aug 11 08:08:55 dist-test-slave-7lbf krb5kdc[1346](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435735, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.193@KRBTEST.COM for kudu/127.27.243.254@KRBTEST.COM
I20260811 08:08:55.345659 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 1546
I20260811 08:08:55.345762 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435717191469-28623-0/minicluster-data/ts-0/wal/instance
I20260811 08:08:55.345952 28623 external_mini_cluster.cc:1428] Setting key b46ad00146c67a87666b7dd8d79a3341
I20260811 08:08:55.348467 1505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:55.340294 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.193:50343 (local address 127.27.243.254:38069)
0811 08:08:55.340341 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:55.340342 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:55.340601 (+ 259us) server_negotiation.cc:407] Connection header received
0811 08:08:55.341083 (+ 482us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:55.341085 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:55.341098 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:55.341159 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:55.342155 (+ 996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:55.342644 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:55.343564 (+ 920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:55.343763 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:55.343821 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:55.345843 (+ 2022us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:08:55.345845 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:08:55.345845 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:08:55.345853 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:08:55.347153 (+ 1300us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:55.347584 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:55.347585 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:55.347585 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:55.347630 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:55.347853 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:55.347854 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:55.347854 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:55.347947 (+ 93us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:08:55.347991 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:55.348273 (+ 282us) server_negotiation.cc:299] Negotiation successful
0811 08:08:55.348377 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 08:08:55.348650 1761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:55.340285 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:38069 (local address 127.27.243.193:50343)
0811 08:08:55.340469 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0811 08:08:55.340504 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0811 08:08:55.340982 (+ 478us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:08:55.341267 (+ 285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:08:55.341271 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:08:55.341879 (+ 608us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:08:55.342080 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:55.342085 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:55.342705 (+ 620us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:55.342705 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:55.343498 (+ 793us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:55.343501 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:55.343821 (+ 320us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:55.343822 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:55.343915 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:55.344303 (+ 388us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:08:55.344311 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:08:55.345734 (+ 1423us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:08:55.347234 (+ 1500us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:08:55.347242 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:08:55.347244 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:08:55.347520 (+ 276us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:08:55.347680 (+ 160us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:08:55.347680 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:08:55.347681 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:08:55.347802 (+ 121us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:08:55.347993 (+ 191us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:08:55.347998 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:08:55.348145 (+ 147us) client_negotiation.cc:769] Sending connection context
0811 08:08:55.348251 (+ 106us) client_negotiation.cc:240] Negotiation successful
0811 08:08:55.348418 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":106,"threads_started":1}
I20260811 08:08:55.349205 1757 heartbeater.cc:347] Connected to a master server at 127.27.243.254:38069
I20260811 08:08:55.349287 1757 heartbeater.cc:464] Registering TS with master...
I20260811 08:08:55.349455 1757 heartbeater.cc:511] Master 127.27.243.254:38069 requested a full tablet report, sending...
I20260811 08:08:55.349999 1424 ts_manager.cc:194] Registered new tserver with Master: aa788f3c7987428db6de21ce28e7765e (127.27.243.193:37159)
I20260811 08:08:55.350615 1424 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.243.193@KRBTEST.COM'} at 127.27.243.193:50343
WARNING: no policy specified for kudu/127.27.243.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.243.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.243.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.194.keytab.
Entry for principal kudu/127.27.243.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.194.keytab.
I20260811 08:08:55.371620 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435717191469-28623-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435717191469-28623-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435717191469-28623-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435717191469-28623-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.243.194:0
--local_ip_for_outbound_sockets=127.27.243.194
--webserver_interface=127.27.243.194
--webserver_port=0
--tserver_master_addrs=127.27.243.254:38069
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.194.keytab
--principal=kudu/127.27.243.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:41759
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:08:55.452973 1765 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:08:55.453162 1765 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:08:55.453184 1765 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:08:55.454268 1765 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:08:55.454303 1765 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:08:55.454329 1765 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.243.194
I20260811 08:08:55.455688 1765 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:41759
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435717191469-28623-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435717191469-28623-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.194.keytab
--principal=kudu/127.27.243.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.243.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435717191469-28623-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.243.194
--webserver_port=0
--tserver_master_addrs=127.27.243.254:38069
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1765
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.243.194
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435717191469-28623-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:08:55.455885 1765 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:08:55.456100 1765 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:08:55.460760 1776 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:08:55.460948 1765 server_base.cc:1034] running on GCE node
W20260811 08:08:55.460769 1780 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:08:55.460769 1774 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:08:55.461229 1765 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:08:55.461457 1765 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:08:55.462594 1765 hybrid_clock.cc:648] HybridClock initialized: now 1786435735462574 us; error 36 us; skew 500 ppm
Aug 11 08:08:55 dist-test-slave-7lbf krb5kdc[1346](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435735, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:08:55.465010 1765 init.cc:377] Logged in from keytab as kudu/127.27.243.194@KRBTEST.COM (short username kudu)
I20260811 08:08:55.465408 1765 webserver.cc:460] Webserver started at http://127.27.243.194:36415/ using document root <none> and password file <none>
I20260811 08:08:55.465673 1765 fs_manager.cc:359] Metadata directory not provided
I20260811 08:08:55.465721 1765 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:08:55.465860 1765 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:08:55.466938 1765 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435717191469-28623-0/minicluster-data/ts-1/data/instance:
uuid: "8206c8d8f42d47adb55289ddab694b00"
format_stamp: "Formatted at 2026-08-11 08:08:55 on dist-test-slave-7lbf"
server_key: "84afd5ac8732c68ab0df0b04a2da51ce"
server_key_iv: "31950fcd6e4bbabad349588b56d87aef"
server_key_version: "encryptionkey@0"
I20260811 08:08:55.467229 1765 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435717191469-28623-0/minicluster-data/ts-1/wal/instance:
uuid: "8206c8d8f42d47adb55289ddab694b00"
format_stamp: "Formatted at 2026-08-11 08:08:55 on dist-test-slave-7lbf"
server_key: "84afd5ac8732c68ab0df0b04a2da51ce"
server_key_iv: "31950fcd6e4bbabad349588b56d87aef"
server_key_version: "encryptionkey@0"
I20260811 08:08:55.468380 1765 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 08:08:55.469056 1793 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:08:55.469206 1765 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 08:08:55.469285 1765 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435717191469-28623-0/minicluster-data/ts-1/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435717191469-28623-0/minicluster-data/ts-1/wal
uuid: "8206c8d8f42d47adb55289ddab694b00"
format_stamp: "Formatted at 2026-08-11 08:08:55 on dist-test-slave-7lbf"
server_key: "84afd5ac8732c68ab0df0b04a2da51ce"
server_key_iv: "31950fcd6e4bbabad349588b56d87aef"
server_key_version: "encryptionkey@0"
I20260811 08:08:55.469350 1765 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435717191469-28623-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435717191469-28623-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435717191469-28623-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:08:55.485864 1765 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:08:55.487838 1765 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:08:55.487960 1765 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:08:55.488152 1765 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:08:55.488430 1765 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:08:55.488462 1765 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:08:55.488482 1765 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:08:55.488505 1765 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:08:55.494163 1765 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.194:33991
I20260811 08:08:55.494220 1984 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.194:33991 every 8 connection(s)
I20260811 08:08:55.494508 1765 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435717191469-28623-0/minicluster-data/ts-1/data/info.pb
I20260811 08:08:55.496574 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 1765
I20260811 08:08:55.496667 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435717191469-28623-0/minicluster-data/ts-1/wal/instance
I20260811 08:08:55.496829 28623 external_mini_cluster.cc:1428] Setting key ae85ff86ad18eca09af5212e88f07be4
Aug 11 08:08:55 dist-test-slave-7lbf krb5kdc[1346](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435735, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.194@KRBTEST.COM for kudu/127.27.243.254@KRBTEST.COM
I20260811 08:08:55.503401 1505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:55.495098 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.194:53163 (local address 127.27.243.254:38069)
0811 08:08:55.495172 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:55.495174 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:55.495378 (+ 204us) server_negotiation.cc:407] Connection header received
0811 08:08:55.495881 (+ 503us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:55.495883 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:55.495892 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:55.495950 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:55.496922 (+ 972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:55.497630 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:55.498597 (+ 967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:55.498809 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:55.498866 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:55.500871 (+ 2005us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:08:55.500873 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:08:55.500873 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:08:55.500881 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:08:55.502166 (+ 1285us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:55.502530 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:55.502532 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:55.502532 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:55.502588 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:55.502808 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:55.502809 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:55.502810 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:55.502919 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:08:55.502975 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:55.503223 (+ 248us) server_negotiation.cc:299] Negotiation successful
0811 08:08:55.503306 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 08:08:55.503602 1987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:55.495078 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:38069 (local address 127.27.243.194:53163)
0811 08:08:55.495235 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0811 08:08:55.495276 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 08:08:55.495775 (+ 499us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:08:55.496012 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:08:55.496015 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:08:55.496622 (+ 607us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:08:55.496837 (+ 215us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:55.496842 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:55.497720 (+ 878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:55.497721 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:55.498517 (+ 796us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:55.498519 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:55.498878 (+ 359us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:55.498879 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:55.499004 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:55.499422 (+ 418us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:08:55.499431 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:08:55.500781 (+ 1350us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:08:55.502239 (+ 1458us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:08:55.502246 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:08:55.502249 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:08:55.502464 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:08:55.502641 (+ 177us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:08:55.502642 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:08:55.502642 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:08:55.502744 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:08:55.502975 (+ 231us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:08:55.502981 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:08:55.503110 (+ 129us) client_negotiation.cc:769] Sending connection context
0811 08:08:55.503195 (+ 85us) client_negotiation.cc:240] Negotiation successful
0811 08:08:55.503353 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":87,"threads_started":1}
I20260811 08:08:55.504040 1985 heartbeater.cc:347] Connected to a master server at 127.27.243.254:38069
I20260811 08:08:55.504148 1985 heartbeater.cc:464] Registering TS with master...
I20260811 08:08:55.504334 1985 heartbeater.cc:511] Master 127.27.243.254:38069 requested a full tablet report, sending...
I20260811 08:08:55.504715 1424 ts_manager.cc:194] Registered new tserver with Master: 8206c8d8f42d47adb55289ddab694b00 (127.27.243.194:33991)
I20260811 08:08:55.505076 1424 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.243.194@KRBTEST.COM'} at 127.27.243.194:53163
WARNING: no policy specified for kudu/127.27.243.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.243.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.243.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.195.keytab.
Entry for principal kudu/127.27.243.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.195.keytab.
I20260811 08:08:55.521181 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435717191469-28623-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435717191469-28623-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435717191469-28623-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435717191469-28623-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.243.195:0
--local_ip_for_outbound_sockets=127.27.243.195
--webserver_interface=127.27.243.195
--webserver_port=0
--tserver_master_addrs=127.27.243.254:38069
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.195.keytab
--principal=kudu/127.27.243.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:41759
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:08:55.604027 1990 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:08:55.604230 1990 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:08:55.604254 1990 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:08:55.605333 1990 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:08:55.605372 1990 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:08:55.605398 1990 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.243.195
I20260811 08:08:55.606783 1990 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:41759
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435717191469-28623-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435717191469-28623-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.195.keytab
--principal=kudu/127.27.243.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.243.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435717191469-28623-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.243.195
--webserver_port=0
--tserver_master_addrs=127.27.243.254:38069
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1990
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.243.195
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435717191469-28623-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:08:55.606963 1990 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:08:55.607148 1990 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:08:55.611930 2000 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:08:55.611938 2002 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:08:55.612046 1990 server_base.cc:1034] running on GCE node
W20260811 08:08:55.611956 1997 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:08:55.612316 1990 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:08:55.612550 1990 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:08:55.613694 1990 hybrid_clock.cc:648] HybridClock initialized: now 1786435735613674 us; error 36 us; skew 500 ppm
Aug 11 08:08:55 dist-test-slave-7lbf krb5kdc[1346](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435735, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:08:55.616209 1990 init.cc:377] Logged in from keytab as kudu/127.27.243.195@KRBTEST.COM (short username kudu)
I20260811 08:08:55.616608 1990 webserver.cc:460] Webserver started at http://127.27.243.195:38725/ using document root <none> and password file <none>
I20260811 08:08:55.616792 1990 fs_manager.cc:359] Metadata directory not provided
I20260811 08:08:55.616840 1990 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:08:55.616959 1990 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:08:55.617975 1990 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435717191469-28623-0/minicluster-data/ts-2/data/instance:
uuid: "59426b7ea6024b049834ad25a27b82e0"
format_stamp: "Formatted at 2026-08-11 08:08:55 on dist-test-slave-7lbf"
server_key: "bb54b66cec4b184b207ab92c296bf80d"
server_key_iv: "5cea3b72a0225fe171c59f0c1f1c24d2"
server_key_version: "encryptionkey@0"
I20260811 08:08:55.618287 1990 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435717191469-28623-0/minicluster-data/ts-2/wal/instance:
uuid: "59426b7ea6024b049834ad25a27b82e0"
format_stamp: "Formatted at 2026-08-11 08:08:55 on dist-test-slave-7lbf"
server_key: "bb54b66cec4b184b207ab92c296bf80d"
server_key_iv: "5cea3b72a0225fe171c59f0c1f1c24d2"
server_key_version: "encryptionkey@0"
I20260811 08:08:55.619468 1990 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 08:08:55.620123 2014 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:08:55.620281 1990 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 08:08:55.620370 1990 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435717191469-28623-0/minicluster-data/ts-2/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435717191469-28623-0/minicluster-data/ts-2/wal
uuid: "59426b7ea6024b049834ad25a27b82e0"
format_stamp: "Formatted at 2026-08-11 08:08:55 on dist-test-slave-7lbf"
server_key: "bb54b66cec4b184b207ab92c296bf80d"
server_key_iv: "5cea3b72a0225fe171c59f0c1f1c24d2"
server_key_version: "encryptionkey@0"
I20260811 08:08:55.620428 1990 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435717191469-28623-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435717191469-28623-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435717191469-28623-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:08:55.628305 1990 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:08:55.630007 1990 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:08:55.630128 1990 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:08:55.630313 1990 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:08:55.630594 1990 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:08:55.630628 1990 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:08:55.630653 1990 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:08:55.630679 1990 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:08:55.636375 1990 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.195:41073
I20260811 08:08:55.636435 2206 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.195:41073 every 8 connection(s)
I20260811 08:08:55.636703 1990 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435717191469-28623-0/minicluster-data/ts-2/data/info.pb
Aug 11 08:08:55 dist-test-slave-7lbf krb5kdc[1346](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435735, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.195@KRBTEST.COM for kudu/127.27.243.254@KRBTEST.COM
I20260811 08:08:55.644822 1505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:55.637317 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.195:57481 (local address 127.27.243.254:38069)
0811 08:08:55.637375 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:55.637377 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:55.637584 (+ 207us) server_negotiation.cc:407] Connection header received
0811 08:08:55.638059 (+ 475us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:55.638061 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:55.638070 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:55.638119 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:55.638958 (+ 839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:55.639442 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:55.640371 (+ 929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:55.640562 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:55.640625 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:55.642607 (+ 1982us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:08:55.642608 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:08:55.642609 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:08:55.642616 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:08:55.643650 (+ 1034us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:55.644009 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:55.644010 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:55.644011 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:55.644078 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:55.644281 (+ 203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:55.644282 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:55.644282 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:55.644401 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:08:55.644456 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:55.644655 (+ 199us) server_negotiation.cc:299] Negotiation successful
0811 08:08:55.644723 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260811 08:08:55.644892 2209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:55.637298 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:38069 (local address 127.27.243.195:57481)
0811 08:08:55.637456 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0811 08:08:55.637488 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0811 08:08:55.637964 (+ 476us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:08:55.638172 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:08:55.638175 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:08:55.638707 (+ 532us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:08:55.638885 (+ 178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:55.638889 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:55.639501 (+ 612us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:55.639502 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:55.640279 (+ 777us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:55.640282 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:55.640635 (+ 353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:55.640635 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:55.640734 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:55.641162 (+ 428us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:08:55.641170 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:08:55.642526 (+ 1356us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:08:55.643713 (+ 1187us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:08:55.643720 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:08:55.643722 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:08:55.643922 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:08:55.644142 (+ 220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:08:55.644143 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:08:55.644143 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:08:55.644233 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:08:55.644448 (+ 215us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:08:55.644451 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:08:55.644559 (+ 108us) client_negotiation.cc:769] Sending connection context
0811 08:08:55.644634 (+ 75us) client_negotiation.cc:240] Negotiation successful
0811 08:08:55.644743 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":91,"threads_started":1}
I20260811 08:08:55.645316 2207 heartbeater.cc:347] Connected to a master server at 127.27.243.254:38069
I20260811 08:08:55.645401 2207 heartbeater.cc:464] Registering TS with master...
I20260811 08:08:55.645586 2207 heartbeater.cc:511] Master 127.27.243.254:38069 requested a full tablet report, sending...
I20260811 08:08:55.645828 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 1990
I20260811 08:08:55.645929 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435717191469-28623-0/minicluster-data/ts-2/wal/instance
I20260811 08:08:55.645970 1424 ts_manager.cc:194] Registered new tserver with Master: 59426b7ea6024b049834ad25a27b82e0 (127.27.243.195:41073)
I20260811 08:08:55.646140 28623 external_mini_cluster.cc:1428] Setting key 917e9c46c66132610a5093060341d227
I20260811 08:08:55.646386 1424 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.243.195@KRBTEST.COM'} at 127.27.243.195:57481
I20260811 08:08:55.647153 28623 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 08:08:55 dist-test-slave-7lbf krb5kdc[1346](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435735, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 11 08:08:55 dist-test-slave-7lbf krb5kdc[1346](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435735, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.27.243.254@KRBTEST.COM
I20260811 08:08:55.669972 1505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:55.663254 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57674 (local address 127.27.243.254:38069)
0811 08:08:55.663303 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:55.663305 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:55.663393 (+ 88us) server_negotiation.cc:407] Connection header received
0811 08:08:55.663418 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:55.663419 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:55.663429 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:55.663483 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:55.663985 (+ 502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:55.664470 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:55.665223 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:55.665431 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:55.665481 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:55.667878 (+ 2397us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:08:55.667879 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:08:55.667880 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:08:55.667886 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:08:55.669016 (+ 1130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:55.669323 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:55.669323 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:55.669323 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:55.669367 (+ 44us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:55.669504 (+ 137us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:55.669504 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:55.669505 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:55.669674 (+ 169us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:08:55.669748 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:55.669849 (+ 101us) server_negotiation.cc:299] Negotiation successful
0811 08:08:55.669909 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
W20260811 08:08:55.670188 1421 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:57674
I20260811 08:08:55.670620 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 1546
I20260811 08:08:55.682993 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 1765
I20260811 08:08:55.695071 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 1990
I20260811 08:08:55.702492 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 1372
2026-08-11T08:08:55Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (1976 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435717191469-28623-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:08:55 dist-test-slave-7lbf krb5kdc[2228](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:08:55 dist-test-slave-7lbf krb5kdc[2228](info): set up 2 sockets
Aug 11 08:08:55 dist-test-slave-7lbf krb5kdc[2228](info): commencing operation
krb5kdc: starting...
W20260811 08:08:56.863080 28623 mini_kdc.cc:121] Time spent starting KDC: real 1.137s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435717191469-28623-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435717191469-28623-0/krb5kdc/test-user.keytab.
Aug 11 08:08:56 dist-test-slave-7lbf krb5kdc[2228](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435736, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:08:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:08:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.27.243.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.243.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.243.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab.
Entry for principal kudu/127.27.243.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab.
I20260811 08:08:56.977882 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435717191469-28623-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435717191469-28623-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435717191469-28623-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.243.254:35961
--webserver_interface=127.27.243.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab
--principal=kudu/127.27.243.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:39557
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.243.254:35961
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:08:57.058336 2249 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:08:57.058540 2249 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:08:57.058569 2249 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:08:57.059685 2249 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:08:57.059727 2249 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:08:57.059746 2249 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:08:57.059762 2249 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:08:57.059777 2249 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:08:57.061256 2249 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:39557
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435717191469-28623-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435717191469-28623-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.243.254:35961
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab
--principal=kudu/127.27.243.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.243.254:35961
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.243.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2249
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435717191469-28623-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:08:57.061496 2249 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:08:57.061731 2249 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:08:57.066334 2259 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:08:57.066352 2257 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:08:57.066331 2255 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:08:57.066598 2249 server_base.cc:1034] running on GCE node
I20260811 08:08:57.066851 2249 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:08:57.067135 2249 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:08:57.068288 2249 hybrid_clock.cc:648] HybridClock initialized: now 1786435737068269 us; error 30 us; skew 500 ppm
Aug 11 08:08:57 dist-test-slave-7lbf krb5kdc[2228](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435737, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:08:57.073788 2249 init.cc:377] Logged in from keytab as kudu/127.27.243.254@KRBTEST.COM (short username kudu)
I20260811 08:08:57.074250 2249 webserver.cc:460] Webserver started at http://127.27.243.254:43533/ using document root <none> and password file <none>
I20260811 08:08:57.074477 2249 fs_manager.cc:359] Metadata directory not provided
I20260811 08:08:57.074527 2249 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:08:57.074652 2249 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:08:57.075701 2249 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435717191469-28623-0/minicluster-data/master-0/data/instance:
uuid: "9822a278fd394f2dacc110d2f75484bb"
format_stamp: "Formatted at 2026-08-11 08:08:57 on dist-test-slave-7lbf"
server_key: "5f1e0e7cc16f17d8781be4bdf3dc1983"
server_key_iv: "c8a6fee7300e4d1be940de571ea327e5"
server_key_version: "encryptionkey@0"
I20260811 08:08:57.076038 2249 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435717191469-28623-0/minicluster-data/master-0/wal/instance:
uuid: "9822a278fd394f2dacc110d2f75484bb"
format_stamp: "Formatted at 2026-08-11 08:08:57 on dist-test-slave-7lbf"
server_key: "5f1e0e7cc16f17d8781be4bdf3dc1983"
server_key_iv: "c8a6fee7300e4d1be940de571ea327e5"
server_key_version: "encryptionkey@0"
I20260811 08:08:57.077291 2249 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 08:08:57.078050 2271 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:08:57.078222 2249 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 08:08:57.078310 2249 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435717191469-28623-0/minicluster-data/master-0/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435717191469-28623-0/minicluster-data/master-0/wal
uuid: "9822a278fd394f2dacc110d2f75484bb"
format_stamp: "Formatted at 2026-08-11 08:08:57 on dist-test-slave-7lbf"
server_key: "5f1e0e7cc16f17d8781be4bdf3dc1983"
server_key_iv: "c8a6fee7300e4d1be940de571ea327e5"
server_key_version: "encryptionkey@0"
I20260811 08:08:57.078377 2249 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435717191469-28623-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435717191469-28623-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435717191469-28623-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:08:57.097849 2249 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:08:57.099844 2249 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:08:57.100000 2249 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:08:57.103863 2249 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.254:35961
I20260811 08:08:57.103901 2352 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.254:35961 every 8 connection(s)
I20260811 08:08:57.104398 2249 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
I20260811 08:08:57.105104 2353 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:08:57.107373 2353 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9822a278fd394f2dacc110d2f75484bb: Bootstrap starting.
I20260811 08:08:57.107944 2353 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9822a278fd394f2dacc110d2f75484bb: Neither blocks nor log segments found. Creating new log.
I20260811 08:08:57.108206 2353 log.cc:824] T 00000000000000000000000000000000 P 9822a278fd394f2dacc110d2f75484bb: Log is configured to *not* fsync() on all Append() calls
I20260811 08:08:57.108866 2353 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9822a278fd394f2dacc110d2f75484bb: No bootstrap required, opened a new log
I20260811 08:08:57.110577 2353 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9822a278fd394f2dacc110d2f75484bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9822a278fd394f2dacc110d2f75484bb" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 35961 } }
I20260811 08:08:57.110718 2353 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9822a278fd394f2dacc110d2f75484bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:08:57.110739 2353 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9822a278fd394f2dacc110d2f75484bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9822a278fd394f2dacc110d2f75484bb, State: Initialized, Role: FOLLOWER
I20260811 08:08:57.110878 2353 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9822a278fd394f2dacc110d2f75484bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9822a278fd394f2dacc110d2f75484bb" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 35961 } }
I20260811 08:08:57.110945 2353 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9822a278fd394f2dacc110d2f75484bb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:08:57.110968 2353 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9822a278fd394f2dacc110d2f75484bb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:08:57.111014 2353 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9822a278fd394f2dacc110d2f75484bb [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:08:57.111861 2353 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9822a278fd394f2dacc110d2f75484bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9822a278fd394f2dacc110d2f75484bb" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 35961 } }
I20260811 08:08:57.111949 2353 leader_election.cc:302] T 00000000000000000000000000000000 P 9822a278fd394f2dacc110d2f75484bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9822a278fd394f2dacc110d2f75484bb; no voters:
I20260811 08:08:57.112097 2353 leader_election.cc:288] T 00000000000000000000000000000000 P 9822a278fd394f2dacc110d2f75484bb [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:08:57.112167 2357 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9822a278fd394f2dacc110d2f75484bb [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:08:57.112341 2353 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9822a278fd394f2dacc110d2f75484bb [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:08:57.112345 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 2249
I20260811 08:08:57.112458 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435717191469-28623-0/minicluster-data/master-0/wal/instance
I20260811 08:08:57.112470 2357 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9822a278fd394f2dacc110d2f75484bb [term 1 LEADER]: Becoming Leader. State: Replica: 9822a278fd394f2dacc110d2f75484bb, State: Running, Role: LEADER
I20260811 08:08:57.112555 2357 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9822a278fd394f2dacc110d2f75484bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9822a278fd394f2dacc110d2f75484bb" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 35961 } }
I20260811 08:08:57.112637 28623 external_mini_cluster.cc:1428] Setting key 75342456eb453df25231ce97d9f633a9
I20260811 08:08:57.113427 2359 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9822a278fd394f2dacc110d2f75484bb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9822a278fd394f2dacc110d2f75484bb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9822a278fd394f2dacc110d2f75484bb" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 35961 } } }
I20260811 08:08:57.113404 2361 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9822a278fd394f2dacc110d2f75484bb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9822a278fd394f2dacc110d2f75484bb. Latest consensus state: current_term: 1 leader_uuid: "9822a278fd394f2dacc110d2f75484bb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9822a278fd394f2dacc110d2f75484bb" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 35961 } } }
I20260811 08:08:57.113576 2361 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9822a278fd394f2dacc110d2f75484bb [sys.catalog]: This master's current role is: LEADER
I20260811 08:08:57.113497 2359 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9822a278fd394f2dacc110d2f75484bb [sys.catalog]: This master's current role is: LEADER
W20260811 08:08:57.114192 2383 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 9822a278fd394f2dacc110d2f75484bb: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 08:08:57.114248 2383 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 08:08:57.114334 2386 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:08:57.114534 2386 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:08:57.116047 2386 catalog_manager.cc:1347] Generated new cluster ID: 55a9eb20463c4c7e928d073382bd4e9e
I20260811 08:08:57.116101 2386 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 08:08:57 dist-test-slave-7lbf krb5kdc[2228](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435736, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.243.254@KRBTEST.COM
I20260811 08:08:57.122316 2372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:57.113128 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50030 (local address 127.27.243.254:35961)
0811 08:08:57.113309 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:57.113319 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:57.113358 (+ 39us) server_negotiation.cc:407] Connection header received
0811 08:08:57.113487 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:57.113496 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:57.113579 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:57.114534 (+ 955us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:57.114634 (+ 100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:57.115820 (+ 1186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:57.116615 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:57.117052 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:57.117146 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:57.119271 (+ 2125us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:08:57.119275 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:08:57.119276 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:08:57.119287 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:08:57.120735 (+ 1448us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:57.121045 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:57.121048 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:57.121049 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:57.121135 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:57.121306 (+ 171us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:57.121306 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:57.121307 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:57.121576 (+ 269us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:08:57.122009 (+ 433us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:57.122065 (+ 56us) server_negotiation.cc:299] Negotiation successful
0811 08:08:57.122162 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":121,"thread_start_us":76,"threads_started":1}
I20260811 08:08:57.152833 2386 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:08:57.153375 2386 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:08:57.157723 2386 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9822a278fd394f2dacc110d2f75484bb: Generated new TSK 0
I20260811 08:08:57.157914 2386 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.27.243.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.243.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.243.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.193.keytab.
Entry for principal kudu/127.27.243.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.193.keytab.
I20260811 08:08:57.195688 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435717191469-28623-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435717191469-28623-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435717191469-28623-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435717191469-28623-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.243.193:0
--local_ip_for_outbound_sockets=127.27.243.193
--webserver_interface=127.27.243.193
--webserver_port=0
--tserver_master_addrs=127.27.243.254:35961
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.193.keytab
--principal=kudu/127.27.243.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:39557
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:08:57.303849 2396 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:08:57.304050 2396 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:08:57.304075 2396 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:08:57.305151 2396 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:08:57.305190 2396 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:08:57.305217 2396 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.243.193
I20260811 08:08:57.306704 2396 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:39557
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435717191469-28623-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435717191469-28623-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.193.keytab
--principal=kudu/127.27.243.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.243.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435717191469-28623-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.243.193
--webserver_port=0
--tserver_master_addrs=127.27.243.254:35961
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2396
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.243.193
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435717191469-28623-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:08:57.306905 2396 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:08:57.307097 2396 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:08:57.311887 2405 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:08:57.311972 2407 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:08:57.312083 2396 server_base.cc:1034] running on GCE node
W20260811 08:08:57.311983 2404 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:08:57.312390 2396 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:08:57.312597 2396 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:08:57.313736 2396 hybrid_clock.cc:648] HybridClock initialized: now 1786435737313709 us; error 36 us; skew 500 ppm
Aug 11 08:08:57 dist-test-slave-7lbf krb5kdc[2228](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435737, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:08:57.316111 2396 init.cc:377] Logged in from keytab as kudu/127.27.243.193@KRBTEST.COM (short username kudu)
I20260811 08:08:57.316579 2396 webserver.cc:460] Webserver started at http://127.27.243.193:38035/ using document root <none> and password file <none>
I20260811 08:08:57.316789 2396 fs_manager.cc:359] Metadata directory not provided
I20260811 08:08:57.316841 2396 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:08:57.316975 2396 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:08:57.318054 2396 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435717191469-28623-0/minicluster-data/ts-0/data/instance:
uuid: "a15e38f0694346b8812f926da32efe93"
format_stamp: "Formatted at 2026-08-11 08:08:57 on dist-test-slave-7lbf"
server_key: "78f78e2162af4809e7ac6b1bf7d9189b"
server_key_iv: "a67d18abb637f6dc55977d66bd81aad0"
server_key_version: "encryptionkey@0"
I20260811 08:08:57.318408 2396 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435717191469-28623-0/minicluster-data/ts-0/wal/instance:
uuid: "a15e38f0694346b8812f926da32efe93"
format_stamp: "Formatted at 2026-08-11 08:08:57 on dist-test-slave-7lbf"
server_key: "78f78e2162af4809e7ac6b1bf7d9189b"
server_key_iv: "a67d18abb637f6dc55977d66bd81aad0"
server_key_version: "encryptionkey@0"
I20260811 08:08:57.319682 2396 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 08:08:57.320396 2419 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:08:57.320560 2396 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 08:08:57.320648 2396 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435717191469-28623-0/minicluster-data/ts-0/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435717191469-28623-0/minicluster-data/ts-0/wal
uuid: "a15e38f0694346b8812f926da32efe93"
format_stamp: "Formatted at 2026-08-11 08:08:57 on dist-test-slave-7lbf"
server_key: "78f78e2162af4809e7ac6b1bf7d9189b"
server_key_iv: "a67d18abb637f6dc55977d66bd81aad0"
server_key_version: "encryptionkey@0"
I20260811 08:08:57.320712 2396 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435717191469-28623-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435717191469-28623-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435717191469-28623-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:08:57.327966 2396 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:08:57.329824 2396 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:08:57.329967 2396 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:08:57.330178 2396 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:08:57.330495 2396 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:08:57.330554 2396 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:08:57.330588 2396 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:08:57.330615 2396 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:08:57.337643 2396 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.193:41407
I20260811 08:08:57.337703 2614 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.193:41407 every 8 connection(s)
I20260811 08:08:57.338016 2396 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435717191469-28623-0/minicluster-data/ts-0/data/info.pb
I20260811 08:08:57.341347 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 2396
I20260811 08:08:57.341456 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435717191469-28623-0/minicluster-data/ts-0/wal/instance
I20260811 08:08:57.341656 28623 external_mini_cluster.cc:1428] Setting key 52dda40b48856223cd864131ddf332b1
Aug 11 08:08:57 dist-test-slave-7lbf krb5kdc[2228](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435737, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.193@KRBTEST.COM for kudu/127.27.243.254@KRBTEST.COM
I20260811 08:08:57.347668 2372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:57.338704 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.193:41741 (local address 127.27.243.254:35961)
0811 08:08:57.338750 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:57.338752 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:57.338949 (+ 197us) server_negotiation.cc:407] Connection header received
0811 08:08:57.339873 (+ 924us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:57.339874 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:57.339890 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:57.339955 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:57.340602 (+ 647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:57.341126 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:57.342408 (+ 1282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:57.342619 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:57.342676 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:57.344888 (+ 2212us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:08:57.344889 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:08:57.344890 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:08:57.344897 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:08:57.346331 (+ 1434us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:57.346746 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:57.346747 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:57.346748 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:57.346818 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:57.347050 (+ 232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:57.347050 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:57.347051 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:57.347183 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:08:57.347252 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:57.347477 (+ 225us) server_negotiation.cc:299] Negotiation successful
0811 08:08:57.347571 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 08:08:57.347712 2621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:57.338661 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:35961 (local address 127.27.243.193:41741)
0811 08:08:57.338817 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0811 08:08:57.338867 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0811 08:08:57.339759 (+ 892us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:08:57.340029 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:08:57.340033 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:08:57.340299 (+ 266us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:08:57.340487 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:57.340491 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:57.341200 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:57.341201 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:57.342339 (+ 1138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:57.342342 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:57.342691 (+ 349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:57.342692 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:57.342835 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:57.343333 (+ 498us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:08:57.343342 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:08:57.344790 (+ 1448us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:08:57.346440 (+ 1650us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:08:57.346447 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:08:57.346449 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:08:57.346666 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:08:57.346887 (+ 221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:08:57.346888 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:08:57.346888 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:08:57.346991 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:08:57.347239 (+ 248us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:08:57.347242 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:08:57.347358 (+ 116us) client_negotiation.cc:769] Sending connection context
0811 08:08:57.347435 (+ 77us) client_negotiation.cc:240] Negotiation successful
0811 08:08:57.347552 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":84,"threads_started":1}
I20260811 08:08:57.348177 2618 heartbeater.cc:347] Connected to a master server at 127.27.243.254:35961
I20260811 08:08:57.348289 2618 heartbeater.cc:464] Registering TS with master...
I20260811 08:08:57.348503 2618 heartbeater.cc:511] Master 127.27.243.254:35961 requested a full tablet report, sending...
I20260811 08:08:57.349135 2299 ts_manager.cc:194] Registered new tserver with Master: a15e38f0694346b8812f926da32efe93 (127.27.243.193:41407)
I20260811 08:08:57.350049 2299 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.243.193@KRBTEST.COM'} at 127.27.243.193:41741
WARNING: no policy specified for kudu/127.27.243.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.243.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.243.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.194.keytab.
Entry for principal kudu/127.27.243.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.194.keytab.
I20260811 08:08:57.368726 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435717191469-28623-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435717191469-28623-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435717191469-28623-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435717191469-28623-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.243.194:0
--local_ip_for_outbound_sockets=127.27.243.194
--webserver_interface=127.27.243.194
--webserver_port=0
--tserver_master_addrs=127.27.243.254:35961
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.194.keytab
--principal=kudu/127.27.243.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:39557
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:08:57.450856 2624 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:08:57.451049 2624 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:08:57.451071 2624 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:08:57.452152 2624 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:08:57.452185 2624 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:08:57.452209 2624 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.243.194
I20260811 08:08:57.453651 2624 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:39557
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435717191469-28623-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435717191469-28623-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.194.keytab
--principal=kudu/127.27.243.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.243.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435717191469-28623-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.243.194
--webserver_port=0
--tserver_master_addrs=127.27.243.254:35961
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2624
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.243.194
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435717191469-28623-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:08:57.453847 2624 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:08:57.454012 2624 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:08:57.458698 2631 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:08:57.458689 2642 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:08:57.458756 2624 server_base.cc:1034] running on GCE node
W20260811 08:08:57.458688 2635 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:08:57.459095 2624 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:08:57.459295 2624 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:08:57.460434 2624 hybrid_clock.cc:648] HybridClock initialized: now 1786435737460415 us; error 36 us; skew 500 ppm
Aug 11 08:08:57 dist-test-slave-7lbf krb5kdc[2228](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435737, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:08:57.463011 2624 init.cc:377] Logged in from keytab as kudu/127.27.243.194@KRBTEST.COM (short username kudu)
I20260811 08:08:57.463413 2624 webserver.cc:460] Webserver started at http://127.27.243.194:35417/ using document root <none> and password file <none>
I20260811 08:08:57.463646 2624 fs_manager.cc:359] Metadata directory not provided
I20260811 08:08:57.463696 2624 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:08:57.463829 2624 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:08:57.464814 2624 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435717191469-28623-0/minicluster-data/ts-1/data/instance:
uuid: "154835e3040a44e68e1c12aa62ad4e8f"
format_stamp: "Formatted at 2026-08-11 08:08:57 on dist-test-slave-7lbf"
server_key: "3c11acb904607424c864e8b43ce88ffb"
server_key_iv: "1f1b17a94ee2922265a0d378728a57bf"
server_key_version: "encryptionkey@0"
I20260811 08:08:57.465145 2624 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435717191469-28623-0/minicluster-data/ts-1/wal/instance:
uuid: "154835e3040a44e68e1c12aa62ad4e8f"
format_stamp: "Formatted at 2026-08-11 08:08:57 on dist-test-slave-7lbf"
server_key: "3c11acb904607424c864e8b43ce88ffb"
server_key_iv: "1f1b17a94ee2922265a0d378728a57bf"
server_key_version: "encryptionkey@0"
I20260811 08:08:57.466449 2624 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 08:08:57.467154 2655 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:08:57.467296 2624 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 08:08:57.467378 2624 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435717191469-28623-0/minicluster-data/ts-1/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435717191469-28623-0/minicluster-data/ts-1/wal
uuid: "154835e3040a44e68e1c12aa62ad4e8f"
format_stamp: "Formatted at 2026-08-11 08:08:57 on dist-test-slave-7lbf"
server_key: "3c11acb904607424c864e8b43ce88ffb"
server_key_iv: "1f1b17a94ee2922265a0d378728a57bf"
server_key_version: "encryptionkey@0"
I20260811 08:08:57.467437 2624 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435717191469-28623-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435717191469-28623-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435717191469-28623-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:08:57.477424 2624 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:08:57.479470 2624 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:08:57.479598 2624 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:08:57.479799 2624 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:08:57.480075 2624 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:08:57.480108 2624 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:08:57.480136 2624 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:08:57.480160 2624 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:08:57.486014 2624 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.194:34743
I20260811 08:08:57.486073 2849 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.194:34743 every 8 connection(s)
I20260811 08:08:57.486364 2624 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435717191469-28623-0/minicluster-data/ts-1/data/info.pb
Aug 11 08:08:57 dist-test-slave-7lbf krb5kdc[2228](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435737, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.194@KRBTEST.COM for kudu/127.27.243.254@KRBTEST.COM
I20260811 08:08:57.494005 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 2624
I20260811 08:08:57.494096 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435717191469-28623-0/minicluster-data/ts-1/wal/instance
I20260811 08:08:57.494331 28623 external_mini_cluster.cc:1428] Setting key 163b86932e4a5e0ee24ec29e16c2a5d1
I20260811 08:08:57.495518 2372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:57.487036 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.194:52425 (local address 127.27.243.254:35961)
0811 08:08:57.487114 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:57.487117 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:57.487289 (+ 172us) server_negotiation.cc:407] Connection header received
0811 08:08:57.488209 (+ 920us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:57.488211 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:57.488223 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:57.488277 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:57.488922 (+ 645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:57.489442 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:57.490511 (+ 1069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:57.490728 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:57.490837 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:57.492746 (+ 1909us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:08:57.492747 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:08:57.492747 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:08:57.492754 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:08:57.494068 (+ 1314us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:57.494546 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:57.494547 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:57.494548 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:57.494618 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:57.494862 (+ 244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:57.494863 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:57.494863 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:57.495004 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:08:57.495067 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:57.495380 (+ 313us) server_negotiation.cc:299] Negotiation successful
0811 08:08:57.495454 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 08:08:57.495719 2855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:57.487018 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:35961 (local address 127.27.243.194:52425)
0811 08:08:57.487178 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0811 08:08:57.487213 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0811 08:08:57.488117 (+ 904us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:08:57.488361 (+ 244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:08:57.488365 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:08:57.488613 (+ 248us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:08:57.488809 (+ 196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:57.488813 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:57.489581 (+ 768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:57.489583 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:57.490420 (+ 837us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:57.490423 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:57.490800 (+ 377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:57.490801 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:57.490911 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:57.491349 (+ 438us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:08:57.491357 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:08:57.492657 (+ 1300us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:08:57.494153 (+ 1496us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:08:57.494162 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:08:57.494164 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:08:57.494450 (+ 286us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:08:57.494677 (+ 227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:08:57.494677 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:08:57.494678 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:08:57.494780 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:08:57.495065 (+ 285us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:08:57.495072 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:08:57.495236 (+ 164us) client_negotiation.cc:769] Sending connection context
0811 08:08:57.495348 (+ 112us) client_negotiation.cc:240] Negotiation successful
0811 08:08:57.495501 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":84,"threads_started":1}
I20260811 08:08:57.496202 2852 heartbeater.cc:347] Connected to a master server at 127.27.243.254:35961
I20260811 08:08:57.496308 2852 heartbeater.cc:464] Registering TS with master...
I20260811 08:08:57.496493 2852 heartbeater.cc:511] Master 127.27.243.254:35961 requested a full tablet report, sending...
I20260811 08:08:57.496917 2299 ts_manager.cc:194] Registered new tserver with Master: 154835e3040a44e68e1c12aa62ad4e8f (127.27.243.194:34743)
I20260811 08:08:57.497377 2299 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.243.194@KRBTEST.COM'} at 127.27.243.194:52425
WARNING: no policy specified for kudu/127.27.243.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.243.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.243.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.195.keytab.
Entry for principal kudu/127.27.243.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.195.keytab.
I20260811 08:08:57.520689 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435717191469-28623-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435717191469-28623-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435717191469-28623-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435717191469-28623-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.243.195:0
--local_ip_for_outbound_sockets=127.27.243.195
--webserver_interface=127.27.243.195
--webserver_port=0
--tserver_master_addrs=127.27.243.254:35961
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.195.keytab
--principal=kudu/127.27.243.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:39557
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:08:57.603295 2858 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:08:57.603494 2858 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:08:57.603515 2858 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:08:57.604599 2858 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:08:57.604631 2858 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:08:57.604655 2858 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.243.195
I20260811 08:08:57.606187 2858 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:39557
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435717191469-28623-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435717191469-28623-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.195.keytab
--principal=kudu/127.27.243.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.243.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435717191469-28623-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.243.195
--webserver_port=0
--tserver_master_addrs=127.27.243.254:35961
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2858
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.243.195
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435717191469-28623-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:08:57.606383 2858 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:08:57.606561 2858 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:08:57.611282 2865 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:08:57.611292 2869 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:08:57.611306 2867 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:08:57.611572 2858 server_base.cc:1034] running on GCE node
I20260811 08:08:57.611871 2858 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:08:57.612118 2858 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:08:57.613289 2858 hybrid_clock.cc:648] HybridClock initialized: now 1786435737613273 us; error 30 us; skew 500 ppm
Aug 11 08:08:57 dist-test-slave-7lbf krb5kdc[2228](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435737, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:08:57.615923 2858 init.cc:377] Logged in from keytab as kudu/127.27.243.195@KRBTEST.COM (short username kudu)
I20260811 08:08:57.616307 2858 webserver.cc:460] Webserver started at http://127.27.243.195:37095/ using document root <none> and password file <none>
I20260811 08:08:57.616487 2858 fs_manager.cc:359] Metadata directory not provided
I20260811 08:08:57.616526 2858 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:08:57.616614 2858 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:08:57.617656 2858 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435717191469-28623-0/minicluster-data/ts-2/data/instance:
uuid: "5d52f2345cfa44f4ac9524cf2ca463b5"
format_stamp: "Formatted at 2026-08-11 08:08:57 on dist-test-slave-7lbf"
server_key: "6c1addb23bba26f226a5d96e1410f3de"
server_key_iv: "3212158581acebcf7dd5c10f083e286e"
server_key_version: "encryptionkey@0"
I20260811 08:08:57.617961 2858 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435717191469-28623-0/minicluster-data/ts-2/wal/instance:
uuid: "5d52f2345cfa44f4ac9524cf2ca463b5"
format_stamp: "Formatted at 2026-08-11 08:08:57 on dist-test-slave-7lbf"
server_key: "6c1addb23bba26f226a5d96e1410f3de"
server_key_iv: "3212158581acebcf7dd5c10f083e286e"
server_key_version: "encryptionkey@0"
I20260811 08:08:57.619179 2858 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:08:57.619859 2880 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:08:57.620018 2858 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 08:08:57.620105 2858 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435717191469-28623-0/minicluster-data/ts-2/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435717191469-28623-0/minicluster-data/ts-2/wal
uuid: "5d52f2345cfa44f4ac9524cf2ca463b5"
format_stamp: "Formatted at 2026-08-11 08:08:57 on dist-test-slave-7lbf"
server_key: "6c1addb23bba26f226a5d96e1410f3de"
server_key_iv: "3212158581acebcf7dd5c10f083e286e"
server_key_version: "encryptionkey@0"
I20260811 08:08:57.620167 2858 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435717191469-28623-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435717191469-28623-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435717191469-28623-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:08:57.653995 2858 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:08:57.656278 2858 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:08:57.656430 2858 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:08:57.656664 2858 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:08:57.657018 2858 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:08:57.657066 2858 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:08:57.657101 2858 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:08:57.657125 2858 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:08:57.663513 2858 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.195:38575
I20260811 08:08:57.663555 3055 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.195:38575 every 8 connection(s)
I20260811 08:08:57.663945 2858 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435717191469-28623-0/minicluster-data/ts-2/data/info.pb
I20260811 08:08:57.666671 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 2858
I20260811 08:08:57.666761 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435717191469-28623-0/minicluster-data/ts-2/wal/instance
I20260811 08:08:57.666952 28623 external_mini_cluster.cc:1428] Setting key 4630f79811900cd80c8ff3443e3ad9f4
Aug 11 08:08:57 dist-test-slave-7lbf krb5kdc[2228](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435737, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.195@KRBTEST.COM for kudu/127.27.243.254@KRBTEST.COM
I20260811 08:08:57.673221 2372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:57.664671 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.195:39271 (local address 127.27.243.254:35961)
0811 08:08:57.664725 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:57.664727 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:57.664943 (+ 216us) server_negotiation.cc:407] Connection header received
0811 08:08:57.666004 (+ 1061us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:57.666005 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:57.666015 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:57.666071 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:57.666704 (+ 633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:57.667419 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:57.668427 (+ 1008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:57.668615 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:57.668669 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:57.670831 (+ 2162us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:08:57.670833 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:08:57.670833 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:08:57.670868 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:08:57.672119 (+ 1251us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:57.672506 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:57.672506 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:57.672507 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:57.672555 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:57.672732 (+ 177us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:57.672732 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:57.672732 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:57.672823 (+ 91us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:08:57.672896 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:57.673099 (+ 203us) server_negotiation.cc:299] Negotiation successful
0811 08:08:57.673159 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260811 08:08:57.673399 3059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:57.664647 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:35961 (local address 127.27.243.195:39271)
0811 08:08:57.664821 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0811 08:08:57.664865 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 08:08:57.665912 (+ 1047us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:08:57.666137 (+ 225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:08:57.666140 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:08:57.666408 (+ 268us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:08:57.666609 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:57.666613 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:57.667525 (+ 912us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:57.667527 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:57.668352 (+ 825us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:57.668355 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:57.668681 (+ 326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:57.668681 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:57.668839 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:57.669260 (+ 421us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:08:57.669269 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:08:57.670743 (+ 1474us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:08:57.672191 (+ 1448us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:08:57.672199 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:08:57.672201 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:08:57.672442 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:08:57.672598 (+ 156us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:08:57.672599 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:08:57.672599 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:08:57.672691 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:08:57.672892 (+ 201us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:08:57.672895 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:08:57.673002 (+ 107us) client_negotiation.cc:769] Sending connection context
0811 08:08:57.673078 (+ 76us) client_negotiation.cc:240] Negotiation successful
0811 08:08:57.673194 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":73,"threads_started":1}
I20260811 08:08:57.673839 3056 heartbeater.cc:347] Connected to a master server at 127.27.243.254:35961
I20260811 08:08:57.673939 3056 heartbeater.cc:464] Registering TS with master...
I20260811 08:08:57.674111 3056 heartbeater.cc:511] Master 127.27.243.254:35961 requested a full tablet report, sending...
I20260811 08:08:57.674439 2299 ts_manager.cc:194] Registered new tserver with Master: 5d52f2345cfa44f4ac9524cf2ca463b5 (127.27.243.195:38575)
I20260811 08:08:57.674782 2299 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.243.195@KRBTEST.COM'} at 127.27.243.195:39271
I20260811 08:08:57.678478 28623 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 08:08:57 dist-test-slave-7lbf krb5kdc[2228](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435737, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 08:08:57 dist-test-slave-7lbf krb5kdc[2228](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435737, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.243.193@KRBTEST.COM
I20260811 08:08:57.701273 3065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:57.694390 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37440 (local address 127.27.243.193:41407)
0811 08:08:57.694559 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:57.694564 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:57.694573 (+ 9us) server_negotiation.cc:407] Connection header received
0811 08:08:57.694597 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:57.694599 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:57.694612 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:57.694675 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:57.695176 (+ 501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:57.695877 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:57.696530 (+ 653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:57.696814 (+ 284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:57.696860 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:57.698924 (+ 2064us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:08:57.698932 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:08:57.698932 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:08:57.698939 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:08:57.700250 (+ 1311us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:57.700601 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:57.700604 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:57.700604 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:57.700662 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:57.700822 (+ 160us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:57.700822 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:57.700823 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:57.700953 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:08:57.701056 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:57.701110 (+ 54us) server_negotiation.cc:299] Negotiation successful
0811 08:08:57.701174 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":138,"thread_start_us":95,"threads_started":1}
Aug 11 08:08:57 dist-test-slave-7lbf krb5kdc[2228](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435737, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.243.254@KRBTEST.COM
I20260811 08:08:57.708668 2372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:57.702636 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45014 (local address 127.27.243.254:35961)
0811 08:08:57.702704 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:57.702706 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:57.702713 (+ 7us) server_negotiation.cc:407] Connection header received
0811 08:08:57.702736 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:57.702737 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:57.702746 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:57.702791 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:57.703213 (+ 422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:57.703688 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:57.704333 (+ 645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:57.704527 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:57.704581 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:57.706638 (+ 2057us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:08:57.706640 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:08:57.706640 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:08:57.706647 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:08:57.707663 (+ 1016us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:57.707966 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:57.707967 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:57.707967 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:57.708018 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:57.708172 (+ 154us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:57.708172 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:57.708173 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:57.708311 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:08:57.708409 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:57.708503 (+ 94us) server_negotiation.cc:299] Negotiation successful
0811 08:08:57.708579 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
W20260811 08:08:57.708880 2299 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45014
I20260811 08:08:57.709236 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 2396
I20260811 08:08:57.718495 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 2624
I20260811 08:08:57.739998 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 2858
I20260811 08:08:57.751441 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 2249
2026-08-11T08:08:57Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (2054 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435717191469-28623-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:08:57 dist-test-slave-7lbf krb5kdc[3071](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:08:57 dist-test-slave-7lbf krb5kdc[3071](info): set up 2 sockets
Aug 11 08:08:57 dist-test-slave-7lbf krb5kdc[3071](info): commencing operation
krb5kdc: starting...
W20260811 08:08:58.920090 28623 mini_kdc.cc:121] Time spent starting KDC: real 1.139s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435717191469-28623-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435717191469-28623-0/krb5kdc/test-user.keytab.
Aug 11 08:08:59 dist-test-slave-7lbf krb5kdc[3071](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435739, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:08:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:08:59Z Disabled control of system clock
WARNING: no policy specified for kudu/127.27.243.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.243.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.243.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab.
Entry for principal kudu/127.27.243.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab.
I20260811 08:08:59.036026 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435717191469-28623-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435717191469-28623-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435717191469-28623-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.243.254:41579
--webserver_interface=127.27.243.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab
--principal=kudu/127.27.243.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:41357
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.243.254:41579
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:08:59.116071 3097 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:08:59.116269 3097 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:08:59.116298 3097 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:08:59.117422 3097 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:08:59.117463 3097 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:08:59.117480 3097 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:08:59.117497 3097 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:08:59.117530 3097 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:08:59.119020 3097 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:41357
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435717191469-28623-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435717191469-28623-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.243.254:41579
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab
--principal=kudu/127.27.243.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.243.254:41579
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.243.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3097
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435717191469-28623-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:08:59.119261 3097 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:08:59.119455 3097 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:08:59.123930 3106 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:08:59.124022 3097 server_base.cc:1034] running on GCE node
W20260811 08:08:59.123940 3108 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:08:59.123924 3111 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:08:59.124364 3097 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:08:59.124620 3097 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:08:59.125753 3097 hybrid_clock.cc:648] HybridClock initialized: now 1786435739125739 us; error 27 us; skew 500 ppm
Aug 11 08:08:59 dist-test-slave-7lbf krb5kdc[3071](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435739, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:08:59.128171 3097 init.cc:377] Logged in from keytab as kudu/127.27.243.254@KRBTEST.COM (short username kudu)
I20260811 08:08:59.128477 3097 fs_manager.cc:359] Metadata directory not provided
I20260811 08:08:59.128525 3097 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:08:59.128620 3097 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:08:59.129680 3097 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435717191469-28623-0/minicluster-data/master-0/data/instance:
uuid: "64cb5277dd0b4a388aa01c32bdcfba0b"
format_stamp: "Formatted at 2026-08-11 08:08:59 on dist-test-slave-7lbf"
server_key: "69aafbc4af483431f6027ee7e3bbe35a"
server_key_iv: "a900a4826e23a715e4cc7e008386837c"
server_key_version: "encryptionkey@0"
I20260811 08:08:59.130024 3097 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435717191469-28623-0/minicluster-data/master-0/wal/instance:
uuid: "64cb5277dd0b4a388aa01c32bdcfba0b"
format_stamp: "Formatted at 2026-08-11 08:08:59 on dist-test-slave-7lbf"
server_key: "69aafbc4af483431f6027ee7e3bbe35a"
server_key_iv: "a900a4826e23a715e4cc7e008386837c"
server_key_version: "encryptionkey@0"
I20260811 08:08:59.131336 3097 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 08:08:59.132012 3121 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:08:59.132141 3097 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 08:08:59.132226 3097 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435717191469-28623-0/minicluster-data/master-0/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435717191469-28623-0/minicluster-data/master-0/wal
uuid: "64cb5277dd0b4a388aa01c32bdcfba0b"
format_stamp: "Formatted at 2026-08-11 08:08:59 on dist-test-slave-7lbf"
server_key: "69aafbc4af483431f6027ee7e3bbe35a"
server_key_iv: "a900a4826e23a715e4cc7e008386837c"
server_key_version: "encryptionkey@0"
I20260811 08:08:59.132287 3097 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435717191469-28623-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435717191469-28623-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435717191469-28623-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:08:59.163009 3097 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:08:59.165252 3097 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:08:59.165401 3097 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:08:59.169241 3097 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.254:41579
I20260811 08:08:59.169274 3211 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.254:41579 every 8 connection(s)
I20260811 08:08:59.169598 3097 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
I20260811 08:08:59.170670 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 3097
I20260811 08:08:59.170804 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435717191469-28623-0/minicluster-data/master-0/wal/instance
I20260811 08:08:59.170817 3212 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:08:59.171006 28623 external_mini_cluster.cc:1428] Setting key 4380d1ee85621e1bdc2854cdc991c970
I20260811 08:08:59.173662 3212 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 64cb5277dd0b4a388aa01c32bdcfba0b: Bootstrap starting.
I20260811 08:08:59.174271 3212 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 64cb5277dd0b4a388aa01c32bdcfba0b: Neither blocks nor log segments found. Creating new log.
I20260811 08:08:59.174540 3212 log.cc:824] T 00000000000000000000000000000000 P 64cb5277dd0b4a388aa01c32bdcfba0b: Log is configured to *not* fsync() on all Append() calls
I20260811 08:08:59.175155 3212 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 64cb5277dd0b4a388aa01c32bdcfba0b: No bootstrap required, opened a new log
I20260811 08:08:59.176839 3212 raft_consensus.cc:348] T 00000000000000000000000000000000 P 64cb5277dd0b4a388aa01c32bdcfba0b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64cb5277dd0b4a388aa01c32bdcfba0b" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 41579 } }
I20260811 08:08:59.176980 3212 raft_consensus.cc:374] T 00000000000000000000000000000000 P 64cb5277dd0b4a388aa01c32bdcfba0b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:08:59.177016 3212 raft_consensus.cc:729] T 00000000000000000000000000000000 P 64cb5277dd0b4a388aa01c32bdcfba0b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64cb5277dd0b4a388aa01c32bdcfba0b, State: Initialized, Role: FOLLOWER
Aug 11 08:08:59 dist-test-slave-7lbf krb5kdc[3071](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435739, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.243.254@KRBTEST.COM
I20260811 08:08:59.177165 3212 consensus_queue.cc:260] T 00000000000000000000000000000000 P 64cb5277dd0b4a388aa01c32bdcfba0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64cb5277dd0b4a388aa01c32bdcfba0b" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 41579 } }
I20260811 08:08:59.177255 3212 raft_consensus.cc:388] T 00000000000000000000000000000000 P 64cb5277dd0b4a388aa01c32bdcfba0b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:08:59.177285 3212 raft_consensus.cc:482] T 00000000000000000000000000000000 P 64cb5277dd0b4a388aa01c32bdcfba0b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:08:59.177336 3212 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 64cb5277dd0b4a388aa01c32bdcfba0b [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:08:59.177927 3212 raft_consensus.cc:504] T 00000000000000000000000000000000 P 64cb5277dd0b4a388aa01c32bdcfba0b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64cb5277dd0b4a388aa01c32bdcfba0b" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 41579 } }
I20260811 08:08:59.178036 3212 leader_election.cc:302] T 00000000000000000000000000000000 P 64cb5277dd0b4a388aa01c32bdcfba0b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 64cb5277dd0b4a388aa01c32bdcfba0b; no voters:
I20260811 08:08:59.178205 3212 leader_election.cc:288] T 00000000000000000000000000000000 P 64cb5277dd0b4a388aa01c32bdcfba0b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:08:59.178236 3220 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 64cb5277dd0b4a388aa01c32bdcfba0b [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:08:59.178382 3220 raft_consensus.cc:686] T 00000000000000000000000000000000 P 64cb5277dd0b4a388aa01c32bdcfba0b [term 1 LEADER]: Becoming Leader. State: Replica: 64cb5277dd0b4a388aa01c32bdcfba0b, State: Running, Role: LEADER
I20260811 08:08:59.178463 3212 sys_catalog.cc:564] T 00000000000000000000000000000000 P 64cb5277dd0b4a388aa01c32bdcfba0b [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:08:59.178470 3220 consensus_queue.cc:237] T 00000000000000000000000000000000 P 64cb5277dd0b4a388aa01c32bdcfba0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64cb5277dd0b4a388aa01c32bdcfba0b" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 41579 } }
I20260811 08:08:59.178855 3221 sys_catalog.cc:455] T 00000000000000000000000000000000 P 64cb5277dd0b4a388aa01c32bdcfba0b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "64cb5277dd0b4a388aa01c32bdcfba0b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64cb5277dd0b4a388aa01c32bdcfba0b" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 41579 } } }
I20260811 08:08:59.178941 3221 sys_catalog.cc:458] T 00000000000000000000000000000000 P 64cb5277dd0b4a388aa01c32bdcfba0b [sys.catalog]: This master's current role is: LEADER
I20260811 08:08:59.179163 3225 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:08:59.179178 3222 sys_catalog.cc:455] T 00000000000000000000000000000000 P 64cb5277dd0b4a388aa01c32bdcfba0b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 64cb5277dd0b4a388aa01c32bdcfba0b. Latest consensus state: current_term: 1 leader_uuid: "64cb5277dd0b4a388aa01c32bdcfba0b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64cb5277dd0b4a388aa01c32bdcfba0b" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 41579 } } }
I20260811 08:08:59.179582 3222 sys_catalog.cc:458] T 00000000000000000000000000000000 P 64cb5277dd0b4a388aa01c32bdcfba0b [sys.catalog]: This master's current role is: LEADER
I20260811 08:08:59.179667 3225 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:08:59.181180 3225 catalog_manager.cc:1347] Generated new cluster ID: b8bb71625c784e28906ab8e21cfb485c
I20260811 08:08:59.181221 3218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:59.171549 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40776 (local address 127.27.243.254:41579)
0811 08:08:59.171728 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:59.171737 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:59.171762 (+ 25us) server_negotiation.cc:407] Connection header received
0811 08:08:59.172249 (+ 487us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:59.172257 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:59.172320 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:59.172455 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:59.173096 (+ 641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:59.174079 (+ 983us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:59.174921 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:59.175358 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:59.175456 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:59.177653 (+ 2197us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:08:59.177657 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:08:59.177657 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:08:59.177667 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:08:59.179596 (+ 1929us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:59.179994 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:59.179997 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:59.179998 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:59.180107 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:59.180309 (+ 202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:59.180310 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:59.180310 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:59.180622 (+ 312us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:08:59.180751 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:59.180886 (+ 135us) server_negotiation.cc:299] Negotiation successful
0811 08:08:59.181026 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132,"thread_start_us":82,"threads_started":1}
I20260811 08:08:59.181231 3225 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:08:59.218708 3225 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:08:59.219515 3225 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:08:59.226521 3225 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 64cb5277dd0b4a388aa01c32bdcfba0b: Generated new TSK 0
I20260811 08:08:59.226729 3225 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.27.243.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.243.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.243.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.193.keytab.
Entry for principal kudu/127.27.243.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.193.keytab.
I20260811 08:08:59.255767 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435717191469-28623-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435717191469-28623-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435717191469-28623-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435717191469-28623-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.243.193:0
--local_ip_for_outbound_sockets=127.27.243.193
--webserver_interface=127.27.243.193
--webserver_port=0
--tserver_master_addrs=127.27.243.254:41579
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.193.keytab
--principal=kudu/127.27.243.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:41357
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:08:59.339335 3256 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:08:59.339625 3256 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:08:59.339665 3256 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:08:59.341327 3256 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:08:59.341394 3256 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:08:59.341437 3256 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.243.193
I20260811 08:08:59.343156 3256 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:41357
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435717191469-28623-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435717191469-28623-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.193.keytab
--principal=kudu/127.27.243.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.243.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435717191469-28623-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.243.193
--webserver_port=0
--tserver_master_addrs=127.27.243.254:41579
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3256
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.243.193
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435717191469-28623-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:08:59.343374 3256 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:08:59.343568 3256 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:08:59.348500 3262 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:08:59.348574 3256 server_base.cc:1034] running on GCE node
W20260811 08:08:59.348524 3263 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:08:59.348524 3268 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:08:59.348896 3256 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:08:59.349107 3256 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:08:59.350240 3256 hybrid_clock.cc:648] HybridClock initialized: now 1786435739350217 us; error 43 us; skew 500 ppm
Aug 11 08:08:59 dist-test-slave-7lbf krb5kdc[3071](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435739, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:08:59.352661 3256 init.cc:377] Logged in from keytab as kudu/127.27.243.193@KRBTEST.COM (short username kudu)
I20260811 08:08:59.352972 3256 fs_manager.cc:359] Metadata directory not provided
I20260811 08:08:59.353019 3256 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:08:59.353116 3256 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:08:59.354149 3256 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435717191469-28623-0/minicluster-data/ts-0/data/instance:
uuid: "f990ca7dc72542dfa8bdb7d12a3d9147"
format_stamp: "Formatted at 2026-08-11 08:08:59 on dist-test-slave-7lbf"
server_key: "3d87774c179195e0ca8a44f974efbb9c"
server_key_iv: "871ea411069e19b14624d78270d8e9c2"
server_key_version: "encryptionkey@0"
I20260811 08:08:59.354461 3256 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435717191469-28623-0/minicluster-data/ts-0/wal/instance:
uuid: "f990ca7dc72542dfa8bdb7d12a3d9147"
format_stamp: "Formatted at 2026-08-11 08:08:59 on dist-test-slave-7lbf"
server_key: "3d87774c179195e0ca8a44f974efbb9c"
server_key_iv: "871ea411069e19b14624d78270d8e9c2"
server_key_version: "encryptionkey@0"
I20260811 08:08:59.355613 3256 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 08:08:59.356285 3278 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:08:59.356427 3256 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 08:08:59.356500 3256 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435717191469-28623-0/minicluster-data/ts-0/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435717191469-28623-0/minicluster-data/ts-0/wal
uuid: "f990ca7dc72542dfa8bdb7d12a3d9147"
format_stamp: "Formatted at 2026-08-11 08:08:59 on dist-test-slave-7lbf"
server_key: "3d87774c179195e0ca8a44f974efbb9c"
server_key_iv: "871ea411069e19b14624d78270d8e9c2"
server_key_version: "encryptionkey@0"
I20260811 08:08:59.356554 3256 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435717191469-28623-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435717191469-28623-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435717191469-28623-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:08:59.370950 3256 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:08:59.372864 3256 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:08:59.372978 3256 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:08:59.373165 3256 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:08:59.373476 3256 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:08:59.373535 3256 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:08:59.373577 3256 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:08:59.373597 3256 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:08:59.379349 3256 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.193:41517
I20260811 08:08:59.379406 3460 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.193:41517 every 8 connection(s)
I20260811 08:08:59.379655 3256 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435717191469-28623-0/minicluster-data/ts-0/data/info.pb
I20260811 08:08:59.381089 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 3256
I20260811 08:08:59.381181 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435717191469-28623-0/minicluster-data/ts-0/wal/instance
I20260811 08:08:59.381388 28623 external_mini_cluster.cc:1428] Setting key 17ad5d663dbbbfcae0a06ed35ec591b6
Aug 11 08:08:59 dist-test-slave-7lbf krb5kdc[3071](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435739, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.193@KRBTEST.COM for kudu/127.27.243.254@KRBTEST.COM
I20260811 08:08:59.388908 3218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:59.380375 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.193:52175 (local address 127.27.243.254:41579)
0811 08:08:59.380432 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:59.380434 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:59.380689 (+ 255us) server_negotiation.cc:407] Connection header received
0811 08:08:59.381232 (+ 543us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:59.381234 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:59.381246 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:59.381299 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:59.382488 (+ 1189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:59.382996 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:59.383980 (+ 984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:59.384198 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:59.384254 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:59.386367 (+ 2113us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:08:59.386369 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:08:59.386370 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:08:59.386377 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:08:59.387648 (+ 1271us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:59.388015 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:59.388016 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:59.388016 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:59.388076 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:59.388291 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:59.388292 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:59.388292 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:59.388405 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:08:59.388462 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:59.388718 (+ 256us) server_negotiation.cc:299] Negotiation successful
0811 08:08:59.388809 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260811 08:08:59.389079 3463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:59.380387 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:41579 (local address 127.27.243.193:52175)
0811 08:08:59.380567 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0811 08:08:59.380607 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 08:08:59.381134 (+ 527us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:08:59.381386 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:08:59.381390 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:08:59.381756 (+ 366us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:08:59.382392 (+ 636us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:59.382398 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:59.383084 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:59.383085 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:59.383892 (+ 807us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:59.383895 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:59.384269 (+ 374us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:59.384270 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:59.384407 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:59.384879 (+ 472us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:08:59.384887 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:08:59.386282 (+ 1395us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:08:59.387723 (+ 1441us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:08:59.387730 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:08:59.387733 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:08:59.387947 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:08:59.388128 (+ 181us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:08:59.388129 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:08:59.388130 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:08:59.388235 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:08:59.388459 (+ 224us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:08:59.388467 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:08:59.388601 (+ 134us) client_negotiation.cc:769] Sending connection context
0811 08:08:59.388698 (+ 97us) client_negotiation.cc:240] Negotiation successful
0811 08:08:59.388858 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":101,"threads_started":1}
WARNING: no policy specified for kudu/127.27.243.194@KRBTEST.COM; defaulting to no policy
I20260811 08:08:59.390576 3461 heartbeater.cc:347] Connected to a master server at 127.27.243.254:41579
I20260811 08:08:59.390671 3461 heartbeater.cc:464] Registering TS with master...
I20260811 08:08:59.390813 3461 heartbeater.cc:511] Master 127.27.243.254:41579 requested a full tablet report, sending...
I20260811 08:08:59.391322 3148 ts_manager.cc:194] Registered new tserver with Master: f990ca7dc72542dfa8bdb7d12a3d9147 (127.27.243.193:41517)
I20260811 08:08:59.391995 3148 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.243.193@KRBTEST.COM'} at 127.27.243.193:52175
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.243.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.243.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.194.keytab.
Entry for principal kudu/127.27.243.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.194.keytab.
I20260811 08:08:59.407878 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435717191469-28623-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435717191469-28623-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435717191469-28623-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435717191469-28623-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.243.194:0
--local_ip_for_outbound_sockets=127.27.243.194
--webserver_interface=127.27.243.194
--webserver_port=0
--tserver_master_addrs=127.27.243.254:41579
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.194.keytab
--principal=kudu/127.27.243.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:41357
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:08:59.490818 3467 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:08:59.491025 3467 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:08:59.491050 3467 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:08:59.492201 3467 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:08:59.492247 3467 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:08:59.492276 3467 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.243.194
I20260811 08:08:59.493841 3467 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:41357
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435717191469-28623-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435717191469-28623-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.194.keytab
--principal=kudu/127.27.243.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.243.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435717191469-28623-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.243.194
--webserver_port=0
--tserver_master_addrs=127.27.243.254:41579
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3467
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.243.194
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435717191469-28623-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:08:59.494078 3467 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:08:59.494298 3467 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:08:59.499101 3474 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:08:59.499132 3476 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:08:59.499137 3473 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:08:59.499325 3467 server_base.cc:1034] running on GCE node
I20260811 08:08:59.499586 3467 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:08:59.499809 3467 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:08:59.500975 3467 hybrid_clock.cc:648] HybridClock initialized: now 1786435739500960 us; error 30 us; skew 500 ppm
Aug 11 08:08:59 dist-test-slave-7lbf krb5kdc[3071](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435739, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:08:59.503346 3467 init.cc:377] Logged in from keytab as kudu/127.27.243.194@KRBTEST.COM (short username kudu)
I20260811 08:08:59.503654 3467 fs_manager.cc:359] Metadata directory not provided
I20260811 08:08:59.503705 3467 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:08:59.503840 3467 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:08:59.504976 3467 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435717191469-28623-0/minicluster-data/ts-1/data/instance:
uuid: "556d028a3dd745298b5b50a18e35cdb2"
format_stamp: "Formatted at 2026-08-11 08:08:59 on dist-test-slave-7lbf"
server_key: "becfaeb6eadcb2d99cd1b88f9b232a74"
server_key_iv: "67294186fb234ff63ade1eba05e4c1bd"
server_key_version: "encryptionkey@0"
I20260811 08:08:59.505268 3467 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435717191469-28623-0/minicluster-data/ts-1/wal/instance:
uuid: "556d028a3dd745298b5b50a18e35cdb2"
format_stamp: "Formatted at 2026-08-11 08:08:59 on dist-test-slave-7lbf"
server_key: "becfaeb6eadcb2d99cd1b88f9b232a74"
server_key_iv: "67294186fb234ff63ade1eba05e4c1bd"
server_key_version: "encryptionkey@0"
I20260811 08:08:59.506492 3467 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 08:08:59.507176 3483 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:08:59.507323 3467 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 08:08:59.507401 3467 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435717191469-28623-0/minicluster-data/ts-1/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435717191469-28623-0/minicluster-data/ts-1/wal
uuid: "556d028a3dd745298b5b50a18e35cdb2"
format_stamp: "Formatted at 2026-08-11 08:08:59 on dist-test-slave-7lbf"
server_key: "becfaeb6eadcb2d99cd1b88f9b232a74"
server_key_iv: "67294186fb234ff63ade1eba05e4c1bd"
server_key_version: "encryptionkey@0"
I20260811 08:08:59.507467 3467 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435717191469-28623-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435717191469-28623-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435717191469-28623-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:08:59.519575 3467 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:08:59.521495 3467 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:08:59.521661 3467 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:08:59.521875 3467 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:08:59.522167 3467 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:08:59.522207 3467 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:08:59.522234 3467 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:08:59.522251 3467 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:08:59.527936 3467 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.194:41377
I20260811 08:08:59.527993 3658 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.194:41377 every 8 connection(s)
I20260811 08:08:59.528223 3467 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435717191469-28623-0/minicluster-data/ts-1/data/info.pb
I20260811 08:08:59.533059 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 3467
I20260811 08:08:59.533154 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435717191469-28623-0/minicluster-data/ts-1/wal/instance
I20260811 08:08:59.533331 28623 external_mini_cluster.cc:1428] Setting key 94e5849cc0f698f3b6fb92a5b109005e
Aug 11 08:08:59 dist-test-slave-7lbf krb5kdc[3071](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435739, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.194@KRBTEST.COM for kudu/127.27.243.254@KRBTEST.COM
I20260811 08:08:59.536846 3218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:59.528866 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.194:45925 (local address 127.27.243.254:41579)
0811 08:08:59.528926 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:59.528928 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:59.529125 (+ 197us) server_negotiation.cc:407] Connection header received
0811 08:08:59.529652 (+ 527us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:59.529653 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:59.529664 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:59.529721 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:59.530575 (+ 854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:59.531075 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:59.532000 (+ 925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:59.532175 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:59.532217 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:59.534346 (+ 2129us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:08:59.534348 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:08:59.534348 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:08:59.534354 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:08:59.535533 (+ 1179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:59.535951 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:59.535953 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:59.535953 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:59.536008 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:59.536247 (+ 239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:59.536248 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:59.536248 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:59.536363 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:08:59.536421 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:59.536674 (+ 253us) server_negotiation.cc:299] Negotiation successful
0811 08:08:59.536758 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260811 08:08:59.537135 3662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:59.528813 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:41579 (local address 127.27.243.194:45925)
0811 08:08:59.529007 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0811 08:08:59.529047 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 08:08:59.529558 (+ 511us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:08:59.529775 (+ 217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:08:59.529779 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:08:59.530016 (+ 237us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:08:59.530493 (+ 477us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:59.530498 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:59.531141 (+ 643us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:59.531142 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:59.531938 (+ 796us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:59.531940 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:59.532225 (+ 285us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:59.532225 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:59.532317 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:59.532770 (+ 453us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:08:59.532778 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:08:59.534243 (+ 1465us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:08:59.535607 (+ 1364us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:08:59.535615 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:08:59.535617 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:08:59.535877 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:08:59.536080 (+ 203us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:08:59.536080 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:08:59.536081 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:08:59.536188 (+ 107us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:08:59.536420 (+ 232us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:08:59.536427 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:08:59.536557 (+ 130us) client_negotiation.cc:769] Sending connection context
0811 08:08:59.536645 (+ 88us) client_negotiation.cc:240] Negotiation successful
0811 08:08:59.536806 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":116,"threads_started":1}
I20260811 08:08:59.537601 3659 heartbeater.cc:347] Connected to a master server at 127.27.243.254:41579
I20260811 08:08:59.537686 3659 heartbeater.cc:464] Registering TS with master...
I20260811 08:08:59.537827 3659 heartbeater.cc:511] Master 127.27.243.254:41579 requested a full tablet report, sending...
I20260811 08:08:59.538192 3148 ts_manager.cc:194] Registered new tserver with Master: 556d028a3dd745298b5b50a18e35cdb2 (127.27.243.194:41377)
I20260811 08:08:59.538692 3148 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.243.194@KRBTEST.COM'} at 127.27.243.194:45925
WARNING: no policy specified for kudu/127.27.243.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.243.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.243.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.195.keytab.
Entry for principal kudu/127.27.243.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.195.keytab.
I20260811 08:08:59.558465 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435717191469-28623-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435717191469-28623-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435717191469-28623-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435717191469-28623-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.243.195:0
--local_ip_for_outbound_sockets=127.27.243.195
--webserver_interface=127.27.243.195
--webserver_port=0
--tserver_master_addrs=127.27.243.254:41579
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.195.keytab
--principal=kudu/127.27.243.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:41357
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:08:59.640328 3665 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:08:59.640522 3665 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:08:59.640543 3665 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:08:59.641649 3665 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:08:59.641682 3665 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:08:59.641706 3665 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.243.195
I20260811 08:08:59.643127 3665 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:41357
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435717191469-28623-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435717191469-28623-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.195.keytab
--principal=kudu/127.27.243.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.243.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435717191469-28623-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.243.195
--webserver_port=0
--tserver_master_addrs=127.27.243.254:41579
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3665
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.243.195
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435717191469-28623-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:08:59.643304 3665 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:08:59.643479 3665 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:08:59.648128 3671 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:08:59.648165 3676 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:08:59.648288 3665 server_base.cc:1034] running on GCE node
W20260811 08:08:59.648334 3674 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:08:59.648597 3665 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:08:59.648833 3665 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:08:59.649974 3665 hybrid_clock.cc:648] HybridClock initialized: now 1786435739649944 us; error 41 us; skew 500 ppm
Aug 11 08:08:59 dist-test-slave-7lbf krb5kdc[3071](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435739, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:08:59.652303 3665 init.cc:377] Logged in from keytab as kudu/127.27.243.195@KRBTEST.COM (short username kudu)
I20260811 08:08:59.652702 3665 fs_manager.cc:359] Metadata directory not provided
I20260811 08:08:59.652758 3665 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:08:59.652884 3665 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:08:59.654007 3665 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435717191469-28623-0/minicluster-data/ts-2/data/instance:
uuid: "81536cb45b514b438245778acb6242c4"
format_stamp: "Formatted at 2026-08-11 08:08:59 on dist-test-slave-7lbf"
server_key: "46fee7d99378015d9010dcbf8a4e870f"
server_key_iv: "7a2b6a4c098771b1201f2a72f253748d"
server_key_version: "encryptionkey@0"
I20260811 08:08:59.654341 3665 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435717191469-28623-0/minicluster-data/ts-2/wal/instance:
uuid: "81536cb45b514b438245778acb6242c4"
format_stamp: "Formatted at 2026-08-11 08:08:59 on dist-test-slave-7lbf"
server_key: "46fee7d99378015d9010dcbf8a4e870f"
server_key_iv: "7a2b6a4c098771b1201f2a72f253748d"
server_key_version: "encryptionkey@0"
I20260811 08:08:59.655541 3665 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 08:08:59.656190 3686 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:08:59.656351 3665 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 08:08:59.656435 3665 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435717191469-28623-0/minicluster-data/ts-2/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435717191469-28623-0/minicluster-data/ts-2/wal
uuid: "81536cb45b514b438245778acb6242c4"
format_stamp: "Formatted at 2026-08-11 08:08:59 on dist-test-slave-7lbf"
server_key: "46fee7d99378015d9010dcbf8a4e870f"
server_key_iv: "7a2b6a4c098771b1201f2a72f253748d"
server_key_version: "encryptionkey@0"
I20260811 08:08:59.656497 3665 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435717191469-28623-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435717191469-28623-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435717191469-28623-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:08:59.675004 3665 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:08:59.676820 3665 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:08:59.676956 3665 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:08:59.677174 3665 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:08:59.677481 3665 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:08:59.677537 3665 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:08:59.677570 3665 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:08:59.677595 3665 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:08:59.683336 3665 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.195:44331
I20260811 08:08:59.683388 3867 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.195:44331 every 8 connection(s)
I20260811 08:08:59.683621 3665 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435717191469-28623-0/minicluster-data/ts-2/data/info.pb
I20260811 08:08:59.684087 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 3665
I20260811 08:08:59.684175 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435717191469-28623-0/minicluster-data/ts-2/wal/instance
I20260811 08:08:59.684360 28623 external_mini_cluster.cc:1428] Setting key 6cd4cdf3b9522b77ba3af695a064ad25
Aug 11 08:08:59 dist-test-slave-7lbf krb5kdc[3071](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435739, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.195@KRBTEST.COM for kudu/127.27.243.254@KRBTEST.COM
I20260811 08:08:59.691955 3218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:59.684565 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.195:57651 (local address 127.27.243.254:41579)
0811 08:08:59.684612 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:59.684615 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:59.684624 (+ 9us) server_negotiation.cc:407] Connection header received
0811 08:08:59.685230 (+ 606us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:59.685230 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:59.685240 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:59.685273 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:59.686179 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:59.686664 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:59.687598 (+ 934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:59.687768 (+ 170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:59.687808 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:59.689828 (+ 2020us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:08:59.689829 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:08:59.689829 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:08:59.689835 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:08:59.690915 (+ 1080us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:59.691255 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:59.691256 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:59.691256 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:59.691299 (+ 43us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:59.691473 (+ 174us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:59.691473 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:59.691473 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:59.691564 (+ 91us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:08:59.691608 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:59.691806 (+ 198us) server_negotiation.cc:299] Negotiation successful
0811 08:08:59.691894 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 08:08:59.692083 3871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:59.684291 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:41579 (local address 127.27.243.195:57651)
0811 08:08:59.684469 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0811 08:08:59.684518 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0811 08:08:59.685134 (+ 616us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:08:59.685335 (+ 201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:08:59.685338 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:08:59.685632 (+ 294us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:08:59.686107 (+ 475us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:59.686112 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:59.686728 (+ 616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:59.686728 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:59.687537 (+ 809us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:59.687539 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:59.687818 (+ 279us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:59.687818 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:59.687942 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:59.688379 (+ 437us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:08:59.688387 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:08:59.689750 (+ 1363us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:08:59.690982 (+ 1232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:08:59.690989 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:08:59.690991 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:08:59.691200 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:08:59.691343 (+ 143us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:08:59.691344 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:08:59.691344 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:08:59.691432 (+ 88us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:08:59.691605 (+ 173us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:08:59.691607 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:08:59.691714 (+ 107us) client_negotiation.cc:769] Sending connection context
0811 08:08:59.691789 (+ 75us) client_negotiation.cc:240] Negotiation successful
0811 08:08:59.691910 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":80,"threads_started":1}
I20260811 08:08:59.692454 3869 heartbeater.cc:347] Connected to a master server at 127.27.243.254:41579
I20260811 08:08:59.692535 3869 heartbeater.cc:464] Registering TS with master...
I20260811 08:08:59.692651 3869 heartbeater.cc:511] Master 127.27.243.254:41579 requested a full tablet report, sending...
I20260811 08:08:59.692970 3148 ts_manager.cc:194] Registered new tserver with Master: 81536cb45b514b438245778acb6242c4 (127.27.243.195:44331)
I20260811 08:08:59.693295 3148 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.243.195@KRBTEST.COM'} at 127.27.243.195:57651
I20260811 08:08:59.695940 28623 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 08:08:59.702358 3218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:59.697188 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40790 (local address 127.27.243.254:41579)
0811 08:08:59.697225 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:59.697227 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:59.697335 (+ 108us) server_negotiation.cc:407] Connection header received
0811 08:08:59.697370 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:59.697371 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:59.697378 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:59.697419 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:59.697946 (+ 527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:59.698393 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:59.699034 (+ 641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:59.699202 (+ 168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:59.699252 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:59.700276 (+ 1024us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:08:59.700277 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:08:59.700277 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:08:59.700282 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:08:59.701436 (+ 1154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:59.701722 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:59.701722 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:59.701722 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:59.701767 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:59.701896 (+ 129us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:59.701897 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:59.701897 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:59.702015 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:08:59.702081 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:59.702233 (+ 152us) server_negotiation.cc:299] Negotiation successful
0811 08:08:59.702284 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 08:08:59.703661 3148 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40790:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 08:08:59.705282 3148 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 08:08:59.711464 3885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:59.707365 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40100 (local address 127.27.243.193:41517)
0811 08:08:59.707739 (+ 374us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:59.707742 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:59.707751 (+ 9us) server_negotiation.cc:407] Connection header received
0811 08:08:59.707790 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:59.707791 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:59.707804 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:59.707867 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:08:59.708058 (+ 191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:59.708921 (+ 863us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:59.710382 (+ 1461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:59.711034 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:59.711100 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:59.711157 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:59.711336 (+ 179us) server_negotiation.cc:299] Negotiation successful
0811 08:08:59.711380 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":337,"thread_start_us":82,"threads_started":1}
I20260811 08:08:59.711460 3882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:59.707259 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.193:41517 (local address 127.0.0.1:40100)
0811 08:08:59.707551 (+ 292us) negotiation.cc:107] Waiting for socket to connect
0811 08:08:59.707589 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 08:08:59.707654 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:08:59.707907 (+ 253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:08:59.707910 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:08:59.707912 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:08:59.707973 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:59.707975 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:59.709003 (+ 1028us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:59.709004 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:59.710296 (+ 1292us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:59.710300 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:59.711108 (+ 808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:59.711109 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:59.711227 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:59.711245 (+ 18us) client_negotiation.cc:769] Sending connection context
0811 08:08:59.711309 (+ 64us) client_negotiation.cc:240] Negotiation successful
0811 08:08:59.711381 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":265,"thread_start_us":52,"threads_started":1}
I20260811 08:08:59.711634 3891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:59.707457 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50022 (local address 127.27.243.194:41377)
0811 08:08:59.707639 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:59.707644 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:59.707655 (+ 11us) server_negotiation.cc:407] Connection header received
0811 08:08:59.707770 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:59.707773 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:59.707788 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:59.707892 (+ 104us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:08:59.708073 (+ 181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:59.709157 (+ 1084us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:59.710404 (+ 1247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:59.711091 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:59.711163 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:59.711217 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:59.711510 (+ 293us) server_negotiation.cc:299] Negotiation successful
0811 08:08:59.711556 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":152,"thread_start_us":80,"threads_started":1}
I20260811 08:08:59.711711 3890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:59.707446 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.195:44331 (local address 127.0.0.1:36528)
0811 08:08:59.708027 (+ 581us) negotiation.cc:107] Waiting for socket to connect
0811 08:08:59.708037 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 08:08:59.708083 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:08:59.708329 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:08:59.708330 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:08:59.708332 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:08:59.708395 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:59.708396 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:59.709549 (+ 1153us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:59.709550 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:59.710523 (+ 973us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:59.710525 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:59.711502 (+ 977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:59.711503 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:59.711568 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:59.711572 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 08:08:59.711616 (+ 44us) client_negotiation.cc:240] Negotiation successful
0811 08:08:59.711652 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":570,"thread_start_us":48,"threads_started":1}
I20260811 08:08:59.711783 3881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:59.707260 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.194:41377 (local address 127.0.0.1:50022)
0811 08:08:59.707549 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0811 08:08:59.707589 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 08:08:59.707653 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:08:59.707909 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:08:59.707910 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:08:59.707916 (+ 6us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:08:59.707991 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:59.707993 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:59.709254 (+ 1261us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:59.709255 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:59.710321 (+ 1066us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:59.710323 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:59.711254 (+ 931us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:59.711255 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:59.711359 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:59.711364 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 08:08:59.711409 (+ 45us) client_negotiation.cc:240] Negotiation successful
0811 08:08:59.711450 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":266,"mutex_wait_us":32,"thread_start_us":62,"threads_started":1}
I20260811 08:08:59.711911 3894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:59.707530 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36528 (local address 127.27.243.195:44331)
0811 08:08:59.707700 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:59.707704 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:59.708136 (+ 432us) server_negotiation.cc:407] Connection header received
0811 08:08:59.708178 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:59.708180 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:59.708194 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:59.708257 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:08:59.708473 (+ 216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:59.709446 (+ 973us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:59.710616 (+ 1170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:59.711345 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:59.711419 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:59.711469 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:59.711797 (+ 328us) server_negotiation.cc:299] Negotiation successful
0811 08:08:59.711839 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142,"thread_start_us":84,"threads_started":1}
I20260811 08:08:59.712608 3765 tablet_service.cc:1467] Processing CreateTablet for tablet 46adaa4d12894559b1c1a948e539652d (DEFAULT_TABLE table=test-table [id=14b49463f227400eadc805dfd7362df1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:08:59.712608 3559 tablet_service.cc:1467] Processing CreateTablet for tablet 46adaa4d12894559b1c1a948e539652d (DEFAULT_TABLE table=test-table [id=14b49463f227400eadc805dfd7362df1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:08:59.712689 3352 tablet_service.cc:1467] Processing CreateTablet for tablet 46adaa4d12894559b1c1a948e539652d (DEFAULT_TABLE table=test-table [id=14b49463f227400eadc805dfd7362df1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:08:59.712961 3765 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 46adaa4d12894559b1c1a948e539652d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:08:59.712961 3559 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 46adaa4d12894559b1c1a948e539652d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:08:59.712983 3352 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 46adaa4d12894559b1c1a948e539652d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:08:59.715533 3896 tablet_bootstrap.cc:492] T 46adaa4d12894559b1c1a948e539652d P f990ca7dc72542dfa8bdb7d12a3d9147: Bootstrap starting.
I20260811 08:08:59.716100 3900 tablet_bootstrap.cc:492] T 46adaa4d12894559b1c1a948e539652d P 556d028a3dd745298b5b50a18e35cdb2: Bootstrap starting.
I20260811 08:08:59.716218 3896 tablet_bootstrap.cc:654] T 46adaa4d12894559b1c1a948e539652d P f990ca7dc72542dfa8bdb7d12a3d9147: Neither blocks nor log segments found. Creating new log.
I20260811 08:08:59.716730 3900 tablet_bootstrap.cc:654] T 46adaa4d12894559b1c1a948e539652d P 556d028a3dd745298b5b50a18e35cdb2: Neither blocks nor log segments found. Creating new log.
I20260811 08:08:59.716943 3896 log.cc:824] T 46adaa4d12894559b1c1a948e539652d P f990ca7dc72542dfa8bdb7d12a3d9147: Log is configured to *not* fsync() on all Append() calls
I20260811 08:08:59.717331 3900 log.cc:824] T 46adaa4d12894559b1c1a948e539652d P 556d028a3dd745298b5b50a18e35cdb2: Log is configured to *not* fsync() on all Append() calls
I20260811 08:08:59.717722 3896 tablet_bootstrap.cc:492] T 46adaa4d12894559b1c1a948e539652d P f990ca7dc72542dfa8bdb7d12a3d9147: No bootstrap required, opened a new log
I20260811 08:08:59.717695 3898 tablet_bootstrap.cc:492] T 46adaa4d12894559b1c1a948e539652d P 81536cb45b514b438245778acb6242c4: Bootstrap starting.
I20260811 08:08:59.717784 3896 ts_tablet_manager.cc:1397] T 46adaa4d12894559b1c1a948e539652d P f990ca7dc72542dfa8bdb7d12a3d9147: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 08:08:59.718143 3900 tablet_bootstrap.cc:492] T 46adaa4d12894559b1c1a948e539652d P 556d028a3dd745298b5b50a18e35cdb2: No bootstrap required, opened a new log
I20260811 08:08:59.718219 3900 ts_tablet_manager.cc:1397] T 46adaa4d12894559b1c1a948e539652d P 556d028a3dd745298b5b50a18e35cdb2: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260811 08:08:59.718256 3898 tablet_bootstrap.cc:654] T 46adaa4d12894559b1c1a948e539652d P 81536cb45b514b438245778acb6242c4: Neither blocks nor log segments found. Creating new log.
I20260811 08:08:59.718838 3898 log.cc:824] T 46adaa4d12894559b1c1a948e539652d P 81536cb45b514b438245778acb6242c4: Log is configured to *not* fsync() on all Append() calls
I20260811 08:08:59.719455 3898 tablet_bootstrap.cc:492] T 46adaa4d12894559b1c1a948e539652d P 81536cb45b514b438245778acb6242c4: No bootstrap required, opened a new log
I20260811 08:08:59.719515 3898 ts_tablet_manager.cc:1397] T 46adaa4d12894559b1c1a948e539652d P 81536cb45b514b438245778acb6242c4: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 08:08:59.719871 3896 raft_consensus.cc:348] T 46adaa4d12894559b1c1a948e539652d P f990ca7dc72542dfa8bdb7d12a3d9147 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f990ca7dc72542dfa8bdb7d12a3d9147" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 41517 } } peers { permanent_uuid: "556d028a3dd745298b5b50a18e35cdb2" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 41377 } } peers { permanent_uuid: "81536cb45b514b438245778acb6242c4" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 44331 } }
I20260811 08:08:59.720065 3896 raft_consensus.cc:374] T 46adaa4d12894559b1c1a948e539652d P f990ca7dc72542dfa8bdb7d12a3d9147 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:08:59.720116 3896 raft_consensus.cc:729] T 46adaa4d12894559b1c1a948e539652d P f990ca7dc72542dfa8bdb7d12a3d9147 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f990ca7dc72542dfa8bdb7d12a3d9147, State: Initialized, Role: FOLLOWER
I20260811 08:08:59.720078 3900 raft_consensus.cc:348] T 46adaa4d12894559b1c1a948e539652d P 556d028a3dd745298b5b50a18e35cdb2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f990ca7dc72542dfa8bdb7d12a3d9147" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 41517 } } peers { permanent_uuid: "556d028a3dd745298b5b50a18e35cdb2" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 41377 } } peers { permanent_uuid: "81536cb45b514b438245778acb6242c4" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 44331 } }
I20260811 08:08:59.720235 3900 raft_consensus.cc:374] T 46adaa4d12894559b1c1a948e539652d P 556d028a3dd745298b5b50a18e35cdb2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:08:59.720274 3900 raft_consensus.cc:729] T 46adaa4d12894559b1c1a948e539652d P 556d028a3dd745298b5b50a18e35cdb2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 556d028a3dd745298b5b50a18e35cdb2, State: Initialized, Role: FOLLOWER
I20260811 08:08:59.720263 3896 consensus_queue.cc:260] T 46adaa4d12894559b1c1a948e539652d P f990ca7dc72542dfa8bdb7d12a3d9147 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f990ca7dc72542dfa8bdb7d12a3d9147" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 41517 } } peers { permanent_uuid: "556d028a3dd745298b5b50a18e35cdb2" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 41377 } } peers { permanent_uuid: "81536cb45b514b438245778acb6242c4" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 44331 } }
I20260811 08:08:59.720427 3900 consensus_queue.cc:260] T 46adaa4d12894559b1c1a948e539652d P 556d028a3dd745298b5b50a18e35cdb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f990ca7dc72542dfa8bdb7d12a3d9147" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 41517 } } peers { permanent_uuid: "556d028a3dd745298b5b50a18e35cdb2" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 41377 } } peers { permanent_uuid: "81536cb45b514b438245778acb6242c4" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 44331 } }
I20260811 08:08:59.720542 3896 ts_tablet_manager.cc:1428] T 46adaa4d12894559b1c1a948e539652d P f990ca7dc72542dfa8bdb7d12a3d9147: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 08:08:59.720603 3461 heartbeater.cc:503] Master 127.27.243.254:41579 was elected leader, sending a full tablet report...
I20260811 08:08:59.720711 3900 ts_tablet_manager.cc:1428] T 46adaa4d12894559b1c1a948e539652d P 556d028a3dd745298b5b50a18e35cdb2: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260811 08:08:59.720724 3659 heartbeater.cc:503] Master 127.27.243.254:41579 was elected leader, sending a full tablet report...
I20260811 08:08:59.721175 3898 raft_consensus.cc:348] T 46adaa4d12894559b1c1a948e539652d P 81536cb45b514b438245778acb6242c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f990ca7dc72542dfa8bdb7d12a3d9147" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 41517 } } peers { permanent_uuid: "556d028a3dd745298b5b50a18e35cdb2" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 41377 } } peers { permanent_uuid: "81536cb45b514b438245778acb6242c4" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 44331 } }
I20260811 08:08:59.721323 3898 raft_consensus.cc:374] T 46adaa4d12894559b1c1a948e539652d P 81536cb45b514b438245778acb6242c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:08:59.721364 3898 raft_consensus.cc:729] T 46adaa4d12894559b1c1a948e539652d P 81536cb45b514b438245778acb6242c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81536cb45b514b438245778acb6242c4, State: Initialized, Role: FOLLOWER
I20260811 08:08:59.721534 3898 consensus_queue.cc:260] T 46adaa4d12894559b1c1a948e539652d P 81536cb45b514b438245778acb6242c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f990ca7dc72542dfa8bdb7d12a3d9147" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 41517 } } peers { permanent_uuid: "556d028a3dd745298b5b50a18e35cdb2" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 41377 } } peers { permanent_uuid: "81536cb45b514b438245778acb6242c4" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 44331 } }
I20260811 08:08:59.721804 3898 ts_tablet_manager.cc:1428] T 46adaa4d12894559b1c1a948e539652d P 81536cb45b514b438245778acb6242c4: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 08:08:59.721812 3869 heartbeater.cc:503] Master 127.27.243.254:41579 was elected leader, sending a full tablet report...
W20260811 08:08:59.778733 3661 tablet.cc:2369] T 46adaa4d12894559b1c1a948e539652d P 556d028a3dd745298b5b50a18e35cdb2: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 08:08:59.880324 3462 tablet.cc:2369] T 46adaa4d12894559b1c1a948e539652d P f990ca7dc72542dfa8bdb7d12a3d9147: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 08:08:59.934239 3870 tablet.cc:2369] T 46adaa4d12894559b1c1a948e539652d P 81536cb45b514b438245778acb6242c4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 08:08:59.995187 3908 raft_consensus.cc:482] T 46adaa4d12894559b1c1a948e539652d P f990ca7dc72542dfa8bdb7d12a3d9147 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:08:59.995325 3908 raft_consensus.cc:504] T 46adaa4d12894559b1c1a948e539652d P f990ca7dc72542dfa8bdb7d12a3d9147 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f990ca7dc72542dfa8bdb7d12a3d9147" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 41517 } } peers { permanent_uuid: "556d028a3dd745298b5b50a18e35cdb2" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 41377 } } peers { permanent_uuid: "81536cb45b514b438245778acb6242c4" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 44331 } }
I20260811 08:08:59.995748 3908 leader_election.cc:288] T 46adaa4d12894559b1c1a948e539652d P f990ca7dc72542dfa8bdb7d12a3d9147 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 556d028a3dd745298b5b50a18e35cdb2 (127.27.243.194:41377), 81536cb45b514b438245778acb6242c4 (127.27.243.195:44331)
I20260811 08:08:59.998899 3894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:59.996076 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.193:52017 (local address 127.27.243.195:44331)
0811 08:08:59.996119 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:59.996120 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:59.996242 (+ 122us) server_negotiation.cc:407] Connection header received
0811 08:08:59.996284 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:59.996285 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:59.996297 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:59.996375 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:08:59.996519 (+ 144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:59.997020 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:59.998132 (+ 1112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:59.998570 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:59.998628 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:59.998637 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:59.998791 (+ 154us) server_negotiation.cc:299] Negotiation successful
0811 08:08:59.998830 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 08:08:59.998896 3912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:59.995952 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.195:44331 (local address 127.27.243.193:52017)
0811 08:08:59.996181 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0811 08:08:59.996190 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 08:08:59.996239 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:08:59.996379 (+ 140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:08:59.996380 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:08:59.996381 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:08:59.996432 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:59.996438 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:59.997152 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:59.997153 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:59.998040 (+ 887us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:59.998043 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:59.998654 (+ 611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:59.998655 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:59.998724 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:59.998728 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 08:08:59.998776 (+ 48us) client_negotiation.cc:240] Negotiation successful
0811 08:08:59.998807 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":217,"mutex_wait_us":17,"thread_start_us":57,"threads_started":1}
I20260811 08:08:59.998981 3891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:59.996053 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.193:58983 (local address 127.27.243.194:41377)
0811 08:08:59.996105 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:59.996108 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:59.996150 (+ 42us) server_negotiation.cc:407] Connection header received
0811 08:08:59.996237 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:59.996238 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:59.996249 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:59.996326 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:08:59.996591 (+ 265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:59.997211 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:59.998232 (+ 1021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:59.998629 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:59.998702 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:59.998711 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:59.998872 (+ 161us) server_negotiation.cc:299] Negotiation successful
0811 08:08:59.998922 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 08:08:59.999002 3914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:59.995952 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.194:41377 (local address 127.27.243.193:58983)
0811 08:08:59.996086 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0811 08:08:59.996098 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 08:08:59.996168 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:08:59.996340 (+ 172us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:08:59.996341 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:08:59.996343 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:08:59.996471 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:59.996473 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:59.997301 (+ 828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:59.997302 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:59.998146 (+ 844us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:59.998149 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:59.998713 (+ 564us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:59.998714 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:59.998786 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:59.998790 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 08:08:59.998848 (+ 58us) client_negotiation.cc:240] Negotiation successful
0811 08:08:59.998886 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":69,"threads_started":1}
I20260811 08:08:59.999226 3799 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "46adaa4d12894559b1c1a948e539652d" candidate_uuid: "f990ca7dc72542dfa8bdb7d12a3d9147" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81536cb45b514b438245778acb6242c4" is_pre_election: true
I20260811 08:08:59.999300 3586 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "46adaa4d12894559b1c1a948e539652d" candidate_uuid: "f990ca7dc72542dfa8bdb7d12a3d9147" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "556d028a3dd745298b5b50a18e35cdb2" is_pre_election: true
I20260811 08:08:59.999392 3799 raft_consensus.cc:2454] T 46adaa4d12894559b1c1a948e539652d P 81536cb45b514b438245778acb6242c4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f990ca7dc72542dfa8bdb7d12a3d9147 in term 0.
I20260811 08:08:59.999469 3586 raft_consensus.cc:2454] T 46adaa4d12894559b1c1a948e539652d P 556d028a3dd745298b5b50a18e35cdb2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f990ca7dc72542dfa8bdb7d12a3d9147 in term 0.
I20260811 08:08:59.999610 3279 leader_election.cc:302] T 46adaa4d12894559b1c1a948e539652d P f990ca7dc72542dfa8bdb7d12a3d9147 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81536cb45b514b438245778acb6242c4, f990ca7dc72542dfa8bdb7d12a3d9147; no voters:
I20260811 08:08:59.999768 3908 raft_consensus.cc:2781] T 46adaa4d12894559b1c1a948e539652d P f990ca7dc72542dfa8bdb7d12a3d9147 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 08:08:59.999820 3908 raft_consensus.cc:482] T 46adaa4d12894559b1c1a948e539652d P f990ca7dc72542dfa8bdb7d12a3d9147 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 08:08:59.999843 3908 raft_consensus.cc:3037] T 46adaa4d12894559b1c1a948e539652d P f990ca7dc72542dfa8bdb7d12a3d9147 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:09:00.000856 3908 raft_consensus.cc:504] T 46adaa4d12894559b1c1a948e539652d P f990ca7dc72542dfa8bdb7d12a3d9147 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f990ca7dc72542dfa8bdb7d12a3d9147" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 41517 } } peers { permanent_uuid: "556d028a3dd745298b5b50a18e35cdb2" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 41377 } } peers { permanent_uuid: "81536cb45b514b438245778acb6242c4" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 44331 } }
I20260811 08:09:00.001005 3908 leader_election.cc:288] T 46adaa4d12894559b1c1a948e539652d P f990ca7dc72542dfa8bdb7d12a3d9147 [CANDIDATE]: Term 1 election: Requested vote from peers 556d028a3dd745298b5b50a18e35cdb2 (127.27.243.194:41377), 81536cb45b514b438245778acb6242c4 (127.27.243.195:44331)
I20260811 08:09:00.001217 3586 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "46adaa4d12894559b1c1a948e539652d" candidate_uuid: "f990ca7dc72542dfa8bdb7d12a3d9147" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "556d028a3dd745298b5b50a18e35cdb2"
I20260811 08:09:00.001251 3799 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "46adaa4d12894559b1c1a948e539652d" candidate_uuid: "f990ca7dc72542dfa8bdb7d12a3d9147" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81536cb45b514b438245778acb6242c4"
I20260811 08:09:00.001298 3586 raft_consensus.cc:3037] T 46adaa4d12894559b1c1a948e539652d P 556d028a3dd745298b5b50a18e35cdb2 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:09:00.001319 3799 raft_consensus.cc:3037] T 46adaa4d12894559b1c1a948e539652d P 81536cb45b514b438245778acb6242c4 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:09:00.002029 3586 raft_consensus.cc:2454] T 46adaa4d12894559b1c1a948e539652d P 556d028a3dd745298b5b50a18e35cdb2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f990ca7dc72542dfa8bdb7d12a3d9147 in term 1.
I20260811 08:09:00.002148 3799 raft_consensus.cc:2454] T 46adaa4d12894559b1c1a948e539652d P 81536cb45b514b438245778acb6242c4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f990ca7dc72542dfa8bdb7d12a3d9147 in term 1.
I20260811 08:09:00.002243 3283 leader_election.cc:302] T 46adaa4d12894559b1c1a948e539652d P f990ca7dc72542dfa8bdb7d12a3d9147 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 556d028a3dd745298b5b50a18e35cdb2, f990ca7dc72542dfa8bdb7d12a3d9147; no voters:
I20260811 08:09:00.002341 3908 raft_consensus.cc:2781] T 46adaa4d12894559b1c1a948e539652d P f990ca7dc72542dfa8bdb7d12a3d9147 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:09:00.002476 3908 raft_consensus.cc:686] T 46adaa4d12894559b1c1a948e539652d P f990ca7dc72542dfa8bdb7d12a3d9147 [term 1 LEADER]: Becoming Leader. State: Replica: f990ca7dc72542dfa8bdb7d12a3d9147, State: Running, Role: LEADER
I20260811 08:09:00.002556 3908 consensus_queue.cc:237] T 46adaa4d12894559b1c1a948e539652d P f990ca7dc72542dfa8bdb7d12a3d9147 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f990ca7dc72542dfa8bdb7d12a3d9147" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 41517 } } peers { permanent_uuid: "556d028a3dd745298b5b50a18e35cdb2" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 41377 } } peers { permanent_uuid: "81536cb45b514b438245778acb6242c4" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 44331 } }
I20260811 08:09:00.003413 3147 catalog_manager.cc:5495] T 46adaa4d12894559b1c1a948e539652d P f990ca7dc72542dfa8bdb7d12a3d9147 reported cstate change: term changed from 0 to 1, leader changed from <none> to f990ca7dc72542dfa8bdb7d12a3d9147 (127.27.243.193). New cstate: current_term: 1 leader_uuid: "f990ca7dc72542dfa8bdb7d12a3d9147" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f990ca7dc72542dfa8bdb7d12a3d9147" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 41517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "556d028a3dd745298b5b50a18e35cdb2" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 41377 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81536cb45b514b438245778acb6242c4" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 44331 } health_report { overall_health: UNKNOWN } } }
I20260811 08:09:00.062674 3885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:00.060481 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40104 (local address 127.27.243.193:41517)
0811 08:09:00.060545 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:00.060547 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:00.060554 (+ 7us) server_negotiation.cc:407] Connection header received
0811 08:09:00.060595 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:00.060596 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:00.060617 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:00.060679 (+ 62us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:09:00.060791 (+ 112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:00.061300 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:00.062045 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:00.062231 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:00.062273 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:00.062382 (+ 109us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:09:00.062484 (+ 102us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:09:00.062539 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 08:09:00.062567 (+ 28us) server_negotiation.cc:299] Negotiation successful
0811 08:09:00.062585 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260811 08:09:00.064687 3799 raft_consensus.cc:1261] T 46adaa4d12894559b1c1a948e539652d P 81536cb45b514b438245778acb6242c4 [term 1 FOLLOWER]: Refusing update from remote peer f990ca7dc72542dfa8bdb7d12a3d9147: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:09:00.064687 3586 raft_consensus.cc:1261] T 46adaa4d12894559b1c1a948e539652d P 556d028a3dd745298b5b50a18e35cdb2 [term 1 FOLLOWER]: Refusing update from remote peer f990ca7dc72542dfa8bdb7d12a3d9147: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:09:00.065058 3915 consensus_queue.cc:1035] T 46adaa4d12894559b1c1a948e539652d P f990ca7dc72542dfa8bdb7d12a3d9147 [LEADER]: Connected to new peer: Peer: permanent_uuid: "556d028a3dd745298b5b50a18e35cdb2" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 41377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:09:00.065193 3908 consensus_queue.cc:1035] T 46adaa4d12894559b1c1a948e539652d P f990ca7dc72542dfa8bdb7d12a3d9147 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81536cb45b514b438245778acb6242c4" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 44331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:09:00.068244 3925 mvcc.cc:205] Tried to move back new op lower bound from 7317240791301890048 to 7317240791051051008. Current Snapshot: MvccSnapshot[applied={T|T < 7317240791301890048}]
I20260811 08:09:00.069840 3146 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40790:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:09:00.069947 3146 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40790:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:09:00.070727 3146 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 64cb5277dd0b4a388aa01c32bdcfba0b: Sending DeleteTablet for 3 replicas of tablet 46adaa4d12894559b1c1a948e539652d
I20260811 08:09:00.071048 3352 tablet_service.cc:1514] Processing DeleteTablet for tablet 46adaa4d12894559b1c1a948e539652d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:09:00 UTC) from {username='kudu', principal='kudu/127.27.243.254@KRBTEST.COM'} at 127.0.0.1:40100
I20260811 08:09:00.071110 3559 tablet_service.cc:1514] Processing DeleteTablet for tablet 46adaa4d12894559b1c1a948e539652d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:09:00 UTC) from {username='kudu', principal='kudu/127.27.243.254@KRBTEST.COM'} at 127.0.0.1:50022
I20260811 08:09:00.071308 3942 tablet_replica.cc:330] T 46adaa4d12894559b1c1a948e539652d P f990ca7dc72542dfa8bdb7d12a3d9147: stopping tablet replica
I20260811 08:09:00.071288 3765 tablet_service.cc:1514] Processing DeleteTablet for tablet 46adaa4d12894559b1c1a948e539652d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:09:00 UTC) from {username='kudu', principal='kudu/127.27.243.254@KRBTEST.COM'} at 127.0.0.1:36528
I20260811 08:09:00.071411 3942 raft_consensus.cc:2229] T 46adaa4d12894559b1c1a948e539652d P f990ca7dc72542dfa8bdb7d12a3d9147 [term 1 LEADER]: Raft consensus shutting down.
I20260811 08:09:00.071496 3946 tablet_replica.cc:330] T 46adaa4d12894559b1c1a948e539652d P 81536cb45b514b438245778acb6242c4: stopping tablet replica
I20260811 08:09:00.071514 3942 raft_consensus.cc:2258] T 46adaa4d12894559b1c1a948e539652d P f990ca7dc72542dfa8bdb7d12a3d9147 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:09:00.071610 3946 raft_consensus.cc:2229] T 46adaa4d12894559b1c1a948e539652d P 81536cb45b514b438245778acb6242c4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:09:00.071718 3946 raft_consensus.cc:2258] T 46adaa4d12894559b1c1a948e539652d P 81536cb45b514b438245778acb6242c4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:09:00.072018 3945 tablet_replica.cc:330] T 46adaa4d12894559b1c1a948e539652d P 556d028a3dd745298b5b50a18e35cdb2: stopping tablet replica
I20260811 08:09:00.072094 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 3256
I20260811 08:09:00.072093 3942 ts_tablet_manager.cc:1905] T 46adaa4d12894559b1c1a948e539652d P f990ca7dc72542dfa8bdb7d12a3d9147: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:09:00.075032 3945 raft_consensus.cc:2229] T 46adaa4d12894559b1c1a948e539652d P 556d028a3dd745298b5b50a18e35cdb2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:09:00.075218 3945 raft_consensus.cc:2258] T 46adaa4d12894559b1c1a948e539652d P 556d028a3dd745298b5b50a18e35cdb2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:09:00.079273 3945 ts_tablet_manager.cc:1905] T 46adaa4d12894559b1c1a948e539652d P 556d028a3dd745298b5b50a18e35cdb2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:09:00.080808 3945 ts_tablet_manager.cc:1918] T 46adaa4d12894559b1c1a948e539652d P 556d028a3dd745298b5b50a18e35cdb2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:09:00.080914 3945 log.cc:1196] T 46adaa4d12894559b1c1a948e539652d P 556d028a3dd745298b5b50a18e35cdb2: Deleting WAL directory at /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435717191469-28623-0/minicluster-data/ts-1/wal/wals/46adaa4d12894559b1c1a948e539652d
I20260811 08:09:00.081231 3945 ts_tablet_manager.cc:1939] T 46adaa4d12894559b1c1a948e539652d P 556d028a3dd745298b5b50a18e35cdb2: Deleting consensus metadata
I20260811 08:09:00.083313 3127 catalog_manager.cc:4841] TS 556d028a3dd745298b5b50a18e35cdb2 (127.27.243.194:41377): tablet 46adaa4d12894559b1c1a948e539652d (table test-table [id=14b49463f227400eadc805dfd7362df1]) successfully deleted
I20260811 08:09:00.086709 3946 ts_tablet_manager.cc:1905] T 46adaa4d12894559b1c1a948e539652d P 81536cb45b514b438245778acb6242c4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:09:00.088248 3946 ts_tablet_manager.cc:1918] T 46adaa4d12894559b1c1a948e539652d P 81536cb45b514b438245778acb6242c4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:09:00.088342 3946 log.cc:1196] T 46adaa4d12894559b1c1a948e539652d P 81536cb45b514b438245778acb6242c4: Deleting WAL directory at /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435717191469-28623-0/minicluster-data/ts-2/wal/wals/46adaa4d12894559b1c1a948e539652d
I20260811 08:09:00.088626 3946 ts_tablet_manager.cc:1939] T 46adaa4d12894559b1c1a948e539652d P 81536cb45b514b438245778acb6242c4: Deleting consensus metadata
I20260811 08:09:00.089133 3122 catalog_manager.cc:4841] TS 81536cb45b514b438245778acb6242c4 (127.27.243.195:44331): tablet 46adaa4d12894559b1c1a948e539652d (table test-table [id=14b49463f227400eadc805dfd7362df1]) successfully deleted
W20260811 08:09:00.092353 3122 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.27.243.193:41517 (error 108)
I20260811 08:09:00.092499 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 3467
I20260811 08:09:00.098172 3881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:00.098000 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.193:41517 (local address 127.0.0.1:40120)
0811 08:09:00.098069 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:00.098132 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.193:41517: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260811 08:09:00.098352 3122 catalog_manager.cc:4584] TS f990ca7dc72542dfa8bdb7d12a3d9147 (127.27.243.193:41517): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 46adaa4d12894559b1c1a948e539652d: Network error: Client connection negotiation failed: client connection to 127.27.243.193:41517: connect: Connection refused (error 111)
I20260811 08:09:00.101817 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 3665
I20260811 08:09:00.114499 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 3097
2026-08-11T08:09:00Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (2360 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-11T08:09:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:09:00Z Disabled control of system clock
I20260811 08:09:00.149694 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435717191469-28623-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435717191469-28623-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435717191469-28623-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.243.254:38135
--webserver_interface=127.27.243.254
--webserver_port=0
--builtin_ntp_servers=127.27.243.212:46163
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.243.254:38135
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260811 08:09:00.230502 3954 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:09:00.230728 3954 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:09:00.230748 3954 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:09:00.231876 3954 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:09:00.231928 3954 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:09:00.231940 3954 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:09:00.231951 3954 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:09:00.231963 3954 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:09:00.233295 3954 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:46163
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435717191469-28623-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435717191469-28623-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.243.254:38135
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.243.254:38135
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.243.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3954
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435717191469-28623-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:09:00.233557 3954 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:09:00.233839 3954 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:09:00.238412 3961 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:09:00.238514 3954 server_base.cc:1034] running on GCE node
W20260811 08:09:00.238461 3959 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:09:00.238600 3964 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:09:00.238854 3954 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:09:00.239137 3954 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:09:00.240304 3954 hybrid_clock.cc:648] HybridClock initialized: now 1786435740240275 us; error 37 us; skew 500 ppm
I20260811 08:09:00.241618 3954 webserver.cc:460] Webserver started at http://127.27.243.254:45183/ using document root <none> and password file <none>
I20260811 08:09:00.241837 3954 fs_manager.cc:359] Metadata directory not provided
I20260811 08:09:00.241887 3954 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:09:00.242014 3954 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:09:00.243058 3954 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435717191469-28623-0/minicluster-data/master-0/data/instance:
uuid: "c7e3903ed2fe492589b14b42129398a4"
format_stamp: "Formatted at 2026-08-11 08:09:00 on dist-test-slave-7lbf"
server_key: "ec1b9b19d1049448c07e0db221826854"
server_key_iv: "e0e45a09ee0dcec7706c4ad10384ba40"
server_key_version: "encryptionkey@0"
I20260811 08:09:00.243408 3954 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435717191469-28623-0/minicluster-data/master-0/wal/instance:
uuid: "c7e3903ed2fe492589b14b42129398a4"
format_stamp: "Formatted at 2026-08-11 08:09:00 on dist-test-slave-7lbf"
server_key: "ec1b9b19d1049448c07e0db221826854"
server_key_iv: "e0e45a09ee0dcec7706c4ad10384ba40"
server_key_version: "encryptionkey@0"
I20260811 08:09:00.244655 3954 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 08:09:00.245326 3976 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:00.245476 3954 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 08:09:00.245579 3954 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435717191469-28623-0/minicluster-data/master-0/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435717191469-28623-0/minicluster-data/master-0/wal
uuid: "c7e3903ed2fe492589b14b42129398a4"
format_stamp: "Formatted at 2026-08-11 08:09:00 on dist-test-slave-7lbf"
server_key: "ec1b9b19d1049448c07e0db221826854"
server_key_iv: "e0e45a09ee0dcec7706c4ad10384ba40"
server_key_version: "encryptionkey@0"
I20260811 08:09:00.245649 3954 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435717191469-28623-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435717191469-28623-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435717191469-28623-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:09:00.248970 3954 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:09:00.249219 3954 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:09:00.249341 3954 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:09:00.252978 3954 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.254:38135
I20260811 08:09:00.253010 4071 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.254:38135 every 8 connection(s)
I20260811 08:09:00.253312 3954 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
I20260811 08:09:00.253947 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 3954
I20260811 08:09:00.254056 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435717191469-28623-0/minicluster-data/master-0/wal/instance
I20260811 08:09:00.254055 4072 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:09:00.254249 28623 external_mini_cluster.cc:1428] Setting key c631b133fb2ebe62ea5427980ba8427e
I20260811 08:09:00.257130 4076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:00.254801 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56570 (local address 127.27.243.254:38135)
0811 08:09:00.255001 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:00.255008 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:00.255032 (+ 24us) server_negotiation.cc:407] Connection header received
0811 08:09:00.255819 (+ 787us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:00.255828 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:00.255876 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:00.256016 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:00.256691 (+ 675us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:09:00.256696 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:09:00.256696 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:09:00.256701 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:09:00.256744 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:09:00.256754 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:09:00.256811 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 08:09:00.256924 (+ 113us) server_negotiation.cc:299] Negotiation successful
0811 08:09:00.256983 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":101,"threads_started":1}
I20260811 08:09:00.257758 4072 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c7e3903ed2fe492589b14b42129398a4: Bootstrap starting.
I20260811 08:09:00.258354 4072 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c7e3903ed2fe492589b14b42129398a4: Neither blocks nor log segments found. Creating new log.
I20260811 08:09:00.258603 4072 log.cc:824] T 00000000000000000000000000000000 P c7e3903ed2fe492589b14b42129398a4: Log is configured to *not* fsync() on all Append() calls
I20260811 08:09:00.259227 4072 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c7e3903ed2fe492589b14b42129398a4: No bootstrap required, opened a new log
I20260811 08:09:00.260617 4072 raft_consensus.cc:348] T 00000000000000000000000000000000 P c7e3903ed2fe492589b14b42129398a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7e3903ed2fe492589b14b42129398a4" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 38135 } }
I20260811 08:09:00.260747 4072 raft_consensus.cc:374] T 00000000000000000000000000000000 P c7e3903ed2fe492589b14b42129398a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:09:00.260769 4072 raft_consensus.cc:729] T 00000000000000000000000000000000 P c7e3903ed2fe492589b14b42129398a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7e3903ed2fe492589b14b42129398a4, State: Initialized, Role: FOLLOWER
I20260811 08:09:00.260857 4072 consensus_queue.cc:260] T 00000000000000000000000000000000 P c7e3903ed2fe492589b14b42129398a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7e3903ed2fe492589b14b42129398a4" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 38135 } }
I20260811 08:09:00.260916 4072 raft_consensus.cc:388] T 00000000000000000000000000000000 P c7e3903ed2fe492589b14b42129398a4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:09:00.260936 4072 raft_consensus.cc:482] T 00000000000000000000000000000000 P c7e3903ed2fe492589b14b42129398a4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:09:00.260967 4072 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c7e3903ed2fe492589b14b42129398a4 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:09:00.261415 4072 raft_consensus.cc:504] T 00000000000000000000000000000000 P c7e3903ed2fe492589b14b42129398a4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7e3903ed2fe492589b14b42129398a4" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 38135 } }
I20260811 08:09:00.261499 4072 leader_election.cc:302] T 00000000000000000000000000000000 P c7e3903ed2fe492589b14b42129398a4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c7e3903ed2fe492589b14b42129398a4; no voters:
I20260811 08:09:00.261653 4072 leader_election.cc:288] T 00000000000000000000000000000000 P c7e3903ed2fe492589b14b42129398a4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:09:00.261906 4072 sys_catalog.cc:564] T 00000000000000000000000000000000 P c7e3903ed2fe492589b14b42129398a4 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:09:00.262081 4078 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c7e3903ed2fe492589b14b42129398a4 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:09:00.262216 4078 raft_consensus.cc:686] T 00000000000000000000000000000000 P c7e3903ed2fe492589b14b42129398a4 [term 1 LEADER]: Becoming Leader. State: Replica: c7e3903ed2fe492589b14b42129398a4, State: Running, Role: LEADER
I20260811 08:09:00.262321 4078 consensus_queue.cc:237] T 00000000000000000000000000000000 P c7e3903ed2fe492589b14b42129398a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7e3903ed2fe492589b14b42129398a4" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 38135 } }
I20260811 08:09:00.262681 4080 sys_catalog.cc:455] T 00000000000000000000000000000000 P c7e3903ed2fe492589b14b42129398a4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c7e3903ed2fe492589b14b42129398a4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7e3903ed2fe492589b14b42129398a4" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 38135 } } }
I20260811 08:09:00.262693 4082 sys_catalog.cc:455] T 00000000000000000000000000000000 P c7e3903ed2fe492589b14b42129398a4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c7e3903ed2fe492589b14b42129398a4. Latest consensus state: current_term: 1 leader_uuid: "c7e3903ed2fe492589b14b42129398a4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7e3903ed2fe492589b14b42129398a4" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 38135 } } }
I20260811 08:09:00.262825 4080 sys_catalog.cc:458] T 00000000000000000000000000000000 P c7e3903ed2fe492589b14b42129398a4 [sys.catalog]: This master's current role is: LEADER
I20260811 08:09:00.262878 4082 sys_catalog.cc:458] T 00000000000000000000000000000000 P c7e3903ed2fe492589b14b42129398a4 [sys.catalog]: This master's current role is: LEADER
W20260811 08:09:00.263734 4097 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c7e3903ed2fe492589b14b42129398a4: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 08:09:00.263777 4097 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 08:09:00.263839 4099 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:09:00.263991 4099 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:09:00.265295 4099 catalog_manager.cc:1347] Generated new cluster ID: 2c7043ed4a9840a291063b53b793b59d
I20260811 08:09:00.265357 4099 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:09:00.274009 4099 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:09:00.274169 4099 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:09:00.277915 4099 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c7e3903ed2fe492589b14b42129398a4: Generated new TSK 0
I20260811 08:09:00.278084 4099 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 08:09:00.281100 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435717191469-28623-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435717191469-28623-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435717191469-28623-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435717191469-28623-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.243.193:0
--local_ip_for_outbound_sockets=127.27.243.193
--webserver_interface=127.27.243.193
--webserver_port=0
--tserver_master_addrs=127.27.243.254:38135
--builtin_ntp_servers=127.27.243.212:46163
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260811 08:09:00.365319 4104 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:09:00.365547 4104 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:09:00.365581 4104 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:09:00.366722 4104 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:09:00.366761 4104 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:09:00.366796 4104 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.243.193
I20260811 08:09:00.368116 4104 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:46163
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435717191469-28623-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435717191469-28623-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.243.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435717191469-28623-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.243.193
--webserver_port=0
--tserver_master_addrs=127.27.243.254:38135
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4104
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.243.193
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435717191469-28623-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:09:00.368348 4104 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:09:00.368611 4104 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:09:00.373453 4115 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:09:00.373490 4114 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:09:00.373428 4120 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:09:00.373756 4104 server_base.cc:1034] running on GCE node
I20260811 08:09:00.373983 4104 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:09:00.374207 4104 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:09:00.375375 4104 hybrid_clock.cc:648] HybridClock initialized: now 1786435740375356 us; error 34 us; skew 500 ppm
I20260811 08:09:00.376639 4104 webserver.cc:460] Webserver started at http://127.27.243.193:39497/ using document root <none> and password file <none>
I20260811 08:09:00.376890 4104 fs_manager.cc:359] Metadata directory not provided
I20260811 08:09:00.376945 4104 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:09:00.377075 4104 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:09:00.378168 4104 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435717191469-28623-0/minicluster-data/ts-0/data/instance:
uuid: "eabca180c2c04938a2ef7118bbe25999"
format_stamp: "Formatted at 2026-08-11 08:09:00 on dist-test-slave-7lbf"
server_key: "488bd1a76cce1e746405667e902a9b16"
server_key_iv: "aef115037d39582d7f611314c0e771eb"
server_key_version: "encryptionkey@0"
I20260811 08:09:00.378495 4104 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435717191469-28623-0/minicluster-data/ts-0/wal/instance:
uuid: "eabca180c2c04938a2ef7118bbe25999"
format_stamp: "Formatted at 2026-08-11 08:09:00 on dist-test-slave-7lbf"
server_key: "488bd1a76cce1e746405667e902a9b16"
server_key_iv: "aef115037d39582d7f611314c0e771eb"
server_key_version: "encryptionkey@0"
I20260811 08:09:00.379736 4104 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 08:09:00.380438 4130 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:00.380647 4104 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 08:09:00.380765 4104 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435717191469-28623-0/minicluster-data/ts-0/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435717191469-28623-0/minicluster-data/ts-0/wal
uuid: "eabca180c2c04938a2ef7118bbe25999"
format_stamp: "Formatted at 2026-08-11 08:09:00 on dist-test-slave-7lbf"
server_key: "488bd1a76cce1e746405667e902a9b16"
server_key_iv: "aef115037d39582d7f611314c0e771eb"
server_key_version: "encryptionkey@0"
I20260811 08:09:00.380858 4104 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435717191469-28623-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435717191469-28623-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435717191469-28623-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:09:00.385387 4104 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:09:00.385686 4104 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:09:00.385818 4104 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:09:00.386018 4104 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:09:00.386327 4104 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:09:00.386366 4104 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:00.386475 4104 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:09:00.386502 4104 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:00.393085 4104 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.193:37543
I20260811 08:09:00.393146 4318 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.193:37543 every 8 connection(s)
I20260811 08:09:00.393429 4104 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435717191469-28623-0/minicluster-data/ts-0/data/info.pb
I20260811 08:09:00.396234 4076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:00.394076 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.193:52241 (local address 127.27.243.254:38135)
0811 08:09:00.394115 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:00.394117 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:00.394347 (+ 230us) server_negotiation.cc:407] Connection header received
0811 08:09:00.394866 (+ 519us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:00.394868 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:00.394875 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:00.394928 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:00.396008 (+ 1080us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:09:00.396010 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:09:00.396010 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:09:00.396015 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:09:00.396030 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:09:00.396034 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:09:00.396085 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 08:09:00.396153 (+ 68us) server_negotiation.cc:299] Negotiation successful
0811 08:09:00.396167 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260811 08:09:00.396425 4323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:00.394061 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:38135 (local address 127.27.243.193:52241)
0811 08:09:00.394220 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:00.394260 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:00.394733 (+ 473us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:00.395004 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:00.395008 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:00.395018 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:09:00.395868 (+ 850us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 08:09:00.395869 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:09:00.395896 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 08:09:00.395923 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:09:00.396088 (+ 165us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:09:00.396093 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:09:00.396097 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 08:09:00.396165 (+ 68us) client_negotiation.cc:240] Negotiation successful
0811 08:09:00.396225 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":70,"threads_started":1}
I20260811 08:09:00.396657 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 4104
I20260811 08:09:00.396740 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435717191469-28623-0/minicluster-data/ts-0/wal/instance
I20260811 08:09:00.396935 28623 external_mini_cluster.cc:1428] Setting key 62a1fb8d46e4345e4e2f4c54ba00b13c
I20260811 08:09:00.397053 4320 heartbeater.cc:347] Connected to a master server at 127.27.243.254:38135
I20260811 08:09:00.397151 4320 heartbeater.cc:464] Registering TS with master...
I20260811 08:09:00.397302 4320 heartbeater.cc:511] Master 127.27.243.254:38135 requested a full tablet report, sending...
I20260811 08:09:00.397795 4001 ts_manager.cc:194] Registered new tserver with Master: eabca180c2c04938a2ef7118bbe25999 (127.27.243.193:37543)
I20260811 08:09:00.397848 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435717191469-28623-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435717191469-28623-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435717191469-28623-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435717191469-28623-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.243.194:0
--local_ip_for_outbound_sockets=127.27.243.194
--webserver_interface=127.27.243.194
--webserver_port=0
--tserver_master_addrs=127.27.243.254:38135
--builtin_ntp_servers=127.27.243.212:46163
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260811 08:09:00.478380 4324 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:09:00.478565 4324 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:09:00.478586 4324 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:09:00.479708 4324 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:09:00.479748 4324 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:09:00.479771 4324 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.243.194
I20260811 08:09:00.481062 4324 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:46163
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435717191469-28623-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435717191469-28623-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.243.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435717191469-28623-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.243.194
--webserver_port=0
--tserver_master_addrs=127.27.243.254:38135
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4324
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.243.194
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435717191469-28623-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:09:00.481277 4324 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:09:00.481571 4324 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:09:00.486361 4331 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:09:00.486410 4333 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:09:00.486533 4324 server_base.cc:1034] running on GCE node
W20260811 08:09:00.486621 4336 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:09:00.486815 4324 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:09:00.487061 4324 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:09:00.488205 4324 hybrid_clock.cc:648] HybridClock initialized: now 1786435740488193 us; error 25 us; skew 500 ppm
I20260811 08:09:00.489368 4324 webserver.cc:460] Webserver started at http://127.27.243.194:37275/ using document root <none> and password file <none>
I20260811 08:09:00.489612 4324 fs_manager.cc:359] Metadata directory not provided
I20260811 08:09:00.489663 4324 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:09:00.489794 4324 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:09:00.490852 4324 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435717191469-28623-0/minicluster-data/ts-1/data/instance:
uuid: "62427fcfb8ea439a98d19ff00187cf0e"
format_stamp: "Formatted at 2026-08-11 08:09:00 on dist-test-slave-7lbf"
server_key: "38b66cf5ffeaa45220449cd6a4c1747c"
server_key_iv: "a8769e5cdbbf936c0f8d669e97bdd15f"
server_key_version: "encryptionkey@0"
I20260811 08:09:00.491196 4324 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435717191469-28623-0/minicluster-data/ts-1/wal/instance:
uuid: "62427fcfb8ea439a98d19ff00187cf0e"
format_stamp: "Formatted at 2026-08-11 08:09:00 on dist-test-slave-7lbf"
server_key: "38b66cf5ffeaa45220449cd6a4c1747c"
server_key_iv: "a8769e5cdbbf936c0f8d669e97bdd15f"
server_key_version: "encryptionkey@0"
I20260811 08:09:00.492550 4324 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 08:09:00.493273 4348 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:00.493454 4324 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:09:00.493556 4324 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435717191469-28623-0/minicluster-data/ts-1/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435717191469-28623-0/minicluster-data/ts-1/wal
uuid: "62427fcfb8ea439a98d19ff00187cf0e"
format_stamp: "Formatted at 2026-08-11 08:09:00 on dist-test-slave-7lbf"
server_key: "38b66cf5ffeaa45220449cd6a4c1747c"
server_key_iv: "a8769e5cdbbf936c0f8d669e97bdd15f"
server_key_version: "encryptionkey@0"
I20260811 08:09:00.493630 4324 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435717191469-28623-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435717191469-28623-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435717191469-28623-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:09:00.496867 4324 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:09:00.497100 4324 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:09:00.497215 4324 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:09:00.497418 4324 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:09:00.497725 4324 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:09:00.497758 4324 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:00.497785 4324 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:09:00.497808 4324 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:00.503407 4324 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.194:42325
I20260811 08:09:00.503443 4554 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.194:42325 every 8 connection(s)
I20260811 08:09:00.503727 4324 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435717191469-28623-0/minicluster-data/ts-1/data/info.pb
I20260811 08:09:00.506438 4076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:00.504379 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.194:51263 (local address 127.27.243.254:38135)
0811 08:09:00.504427 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:00.504429 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:00.504635 (+ 206us) server_negotiation.cc:407] Connection header received
0811 08:09:00.505111 (+ 476us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:00.505112 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:00.505117 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:00.505157 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:00.506237 (+ 1080us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:09:00.506238 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:09:00.506238 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:09:00.506242 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:09:00.506257 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:09:00.506260 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:09:00.506302 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0811 08:09:00.506371 (+ 69us) server_negotiation.cc:299] Negotiation successful
0811 08:09:00.506382 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 08:09:00.506582 4559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:00.504348 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:38135 (local address 127.27.243.194:51263)
0811 08:09:00.504523 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:00.504559 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:00.505011 (+ 452us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:00.505222 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:00.505225 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:00.505234 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:09:00.506102 (+ 868us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 08:09:00.506102 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:09:00.506129 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 08:09:00.506156 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:09:00.506303 (+ 147us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:09:00.506305 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:09:00.506321 (+ 16us) client_negotiation.cc:769] Sending connection context
0811 08:09:00.506370 (+ 49us) client_negotiation.cc:240] Negotiation successful
0811 08:09:00.506414 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":72,"threads_started":1}
I20260811 08:09:00.507036 4555 heartbeater.cc:347] Connected to a master server at 127.27.243.254:38135
I20260811 08:09:00.507121 4555 heartbeater.cc:464] Registering TS with master...
I20260811 08:09:00.507256 4555 heartbeater.cc:511] Master 127.27.243.254:38135 requested a full tablet report, sending...
I20260811 08:09:00.507606 4001 ts_manager.cc:194] Registered new tserver with Master: 62427fcfb8ea439a98d19ff00187cf0e (127.27.243.194:42325)
I20260811 08:09:00.512907 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 4324
I20260811 08:09:00.512995 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435717191469-28623-0/minicluster-data/ts-1/wal/instance
I20260811 08:09:00.513175 28623 external_mini_cluster.cc:1428] Setting key 129c46dfd5c08e780a6eb6fc8eeb5e56
I20260811 08:09:00.514118 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435717191469-28623-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435717191469-28623-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435717191469-28623-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435717191469-28623-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.243.195:0
--local_ip_for_outbound_sockets=127.27.243.195
--webserver_interface=127.27.243.195
--webserver_port=0
--tserver_master_addrs=127.27.243.254:38135
--builtin_ntp_servers=127.27.243.212:46163
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260811 08:09:00.596271 4561 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:09:00.596479 4561 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:09:00.596501 4561 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:09:00.597684 4561 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:09:00.597724 4561 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:09:00.597749 4561 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.243.195
I20260811 08:09:00.599023 4561 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:46163
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435717191469-28623-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435717191469-28623-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.243.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435717191469-28623-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.243.195
--webserver_port=0
--tserver_master_addrs=127.27.243.254:38135
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4561
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.243.195
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435717191469-28623-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:09:00.599210 4561 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:09:00.599445 4561 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:09:00.604229 4569 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:09:00.604226 4572 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:09:00.604255 4567 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:09:00.604383 4561 server_base.cc:1034] running on GCE node
I20260811 08:09:00.604635 4561 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:09:00.604876 4561 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:09:00.606014 4561 hybrid_clock.cc:648] HybridClock initialized: now 1786435740605996 us; error 28 us; skew 500 ppm
I20260811 08:09:00.607223 4561 webserver.cc:460] Webserver started at http://127.27.243.195:34657/ using document root <none> and password file <none>
I20260811 08:09:00.607434 4561 fs_manager.cc:359] Metadata directory not provided
I20260811 08:09:00.607483 4561 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:09:00.607605 4561 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:09:00.608615 4561 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435717191469-28623-0/minicluster-data/ts-2/data/instance:
uuid: "4351fbcc8557489a96b6ccfc5382aa05"
format_stamp: "Formatted at 2026-08-11 08:09:00 on dist-test-slave-7lbf"
server_key: "8ed88a893426657a3ab32f72acc67b7c"
server_key_iv: "adf4cb3e29d8b6b0e9907bda63e1d88a"
server_key_version: "encryptionkey@0"
I20260811 08:09:00.608973 4561 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435717191469-28623-0/minicluster-data/ts-2/wal/instance:
uuid: "4351fbcc8557489a96b6ccfc5382aa05"
format_stamp: "Formatted at 2026-08-11 08:09:00 on dist-test-slave-7lbf"
server_key: "8ed88a893426657a3ab32f72acc67b7c"
server_key_iv: "adf4cb3e29d8b6b0e9907bda63e1d88a"
server_key_version: "encryptionkey@0"
I20260811 08:09:00.610311 4561 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 08:09:00.611042 4584 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:00.611202 4561 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 08:09:00.611290 4561 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435717191469-28623-0/minicluster-data/ts-2/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435717191469-28623-0/minicluster-data/ts-2/wal
uuid: "4351fbcc8557489a96b6ccfc5382aa05"
format_stamp: "Formatted at 2026-08-11 08:09:00 on dist-test-slave-7lbf"
server_key: "8ed88a893426657a3ab32f72acc67b7c"
server_key_iv: "adf4cb3e29d8b6b0e9907bda63e1d88a"
server_key_version: "encryptionkey@0"
I20260811 08:09:00.611362 4561 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435717191469-28623-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435717191469-28623-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435717191469-28623-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:09:00.614714 4561 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:09:00.615068 4561 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:09:00.615213 4561 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:09:00.615422 4561 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:09:00.615712 4561 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:09:00.615746 4561 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:00.615773 4561 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:09:00.615796 4561 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:00.621331 4561 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.195:45619
I20260811 08:09:00.621400 4784 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.195:45619 every 8 connection(s)
I20260811 08:09:00.621675 4561 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435717191469-28623-0/minicluster-data/ts-2/data/info.pb
I20260811 08:09:00.624516 4076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:00.622383 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.195:36035 (local address 127.27.243.254:38135)
0811 08:09:00.622428 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:00.622430 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:00.622656 (+ 226us) server_negotiation.cc:407] Connection header received
0811 08:09:00.623138 (+ 482us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:00.623140 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:00.623147 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:00.623203 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:00.624278 (+ 1075us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:09:00.624279 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:09:00.624280 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:09:00.624284 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:09:00.624301 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:09:00.624306 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:09:00.624355 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0811 08:09:00.624431 (+ 76us) server_negotiation.cc:299] Negotiation successful
0811 08:09:00.624445 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 08:09:00.624683 4790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:00.622358 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:38135 (local address 127.27.243.195:36035)
0811 08:09:00.622548 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:00.622578 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:00.623036 (+ 458us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:00.623284 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:00.623289 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:00.623297 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:09:00.624140 (+ 843us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 08:09:00.624141 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:09:00.624167 (+ 26us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 08:09:00.624194 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:09:00.624359 (+ 165us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:09:00.624365 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:09:00.624368 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 08:09:00.624438 (+ 70us) client_negotiation.cc:240] Negotiation successful
0811 08:09:00.624497 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":92,"threads_started":1}
I20260811 08:09:00.625124 4786 heartbeater.cc:347] Connected to a master server at 127.27.243.254:38135
I20260811 08:09:00.625203 4786 heartbeater.cc:464] Registering TS with master...
I20260811 08:09:00.625352 4786 heartbeater.cc:511] Master 127.27.243.254:38135 requested a full tablet report, sending...
I20260811 08:09:00.625722 4001 ts_manager.cc:194] Registered new tserver with Master: 4351fbcc8557489a96b6ccfc5382aa05 (127.27.243.195:45619)
I20260811 08:09:00.629175 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 4561
I20260811 08:09:00.629269 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435717191469-28623-0/minicluster-data/ts-2/wal/instance
I20260811 08:09:00.629454 28623 external_mini_cluster.cc:1428] Setting key a4f2a0a31e0c4f501099055886ec5156
I20260811 08:09:00.630389 28623 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 08:09:00.632509 4076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:00.631640 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56586 (local address 127.27.243.254:38135)
0811 08:09:00.631705 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:00.631706 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:00.631790 (+ 84us) server_negotiation.cc:407] Connection header received
0811 08:09:00.631839 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:00.631839 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:00.631844 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:00.631892 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:00.632353 (+ 461us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:09:00.632355 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:09:00.632355 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:09:00.632358 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:09:00.632370 (+ 12us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:09:00.632373 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:09:00.632414 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0811 08:09:00.632453 (+ 39us) server_negotiation.cc:299] Negotiation successful
0811 08:09:00.632463 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260811 08:09:00.634104 4001 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56586:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 08:09:00.635597 4001 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 08:09:00.639212 4801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:00.637678 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.195:45619 (local address 127.0.0.1:54340)
0811 08:09:00.637841 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:00.637890 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:00.637941 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:00.638290 (+ 349us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:00.638296 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:00.638302 (+ 6us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:09:00.638747 (+ 445us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 08:09:00.638747 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:09:00.638763 (+ 16us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 08:09:00.638786 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:09:00.639058 (+ 272us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:09:00.639065 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:09:00.639068 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 08:09:00.639137 (+ 69us) client_negotiation.cc:240] Negotiation successful
0811 08:09:00.639148 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":67,"threads_started":1}
I20260811 08:09:00.639278 4803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:00.637720 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54340 (local address 127.27.243.195:45619)
0811 08:09:00.638171 (+ 451us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:00.638175 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:00.638183 (+ 8us) server_negotiation.cc:407] Connection header received
0811 08:09:00.638200 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:00.638202 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:00.638208 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:00.638271 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:00.638906 (+ 635us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:09:00.638914 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:09:00.638914 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:09:00.638918 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:09:00.638955 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:09:00.638977 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:09:00.639030 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 08:09:00.639166 (+ 136us) server_negotiation.cc:299] Negotiation successful
0811 08:09:00.639185 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":421,"thread_start_us":77,"threads_started":1}
I20260811 08:09:00.639961 4802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:00.637684 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.194:42325 (local address 127.0.0.1:56660)
0811 08:09:00.638587 (+ 903us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:00.638596 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:00.638650 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:00.638855 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:00.638856 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:00.638858 (+ 2us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:09:00.639580 (+ 722us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 08:09:00.639581 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:09:00.639588 (+ 7us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 08:09:00.639603 (+ 15us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:09:00.639833 (+ 230us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:09:00.639834 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:09:00.639834 (+ 0us) client_negotiation.cc:769] Sending connection context
0811 08:09:00.639890 (+ 56us) client_negotiation.cc:240] Negotiation successful
0811 08:09:00.639903 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":885,"thread_start_us":86,"threads_started":1}
I20260811 08:09:00.640007 4806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:00.637794 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56660 (local address 127.27.243.194:42325)
0811 08:09:00.638063 (+ 269us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:00.638068 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:00.638653 (+ 585us) server_negotiation.cc:407] Connection header received
0811 08:09:00.638732 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:00.638738 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:00.638748 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:00.638814 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:00.639683 (+ 869us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:09:00.639691 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:09:00.639691 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:09:00.639697 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:09:00.639735 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:09:00.639762 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:09:00.639831 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 08:09:00.639896 (+ 65us) server_negotiation.cc:299] Negotiation successful
0811 08:09:00.639913 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":225,"thread_start_us":90,"threads_started":1}
I20260811 08:09:00.639961 4674 tablet_service.cc:1467] Processing CreateTablet for tablet 1d428aa8650f40468b61ae4fbb5395f7 (DEFAULT_TABLE table=test-table [id=a53c13a7308e4db69151a9c8b15e7fcc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:09:00.640332 4674 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1d428aa8650f40468b61ae4fbb5395f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:09:00.640765 4807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:00.637897 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.193:37543 (local address 127.0.0.1:41784)
0811 08:09:00.639105 (+ 1208us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:00.639114 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:00.639156 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:00.639568 (+ 412us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:00.639569 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:00.639572 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:09:00.640311 (+ 739us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 08:09:00.640311 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:09:00.640318 (+ 7us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 08:09:00.640331 (+ 13us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:09:00.640636 (+ 305us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:09:00.640637 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:09:00.640638 (+ 1us) client_negotiation.cc:769] Sending connection context
0811 08:09:00.640688 (+ 50us) client_negotiation.cc:240] Negotiation successful
0811 08:09:00.640701 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1193,"thread_start_us":73,"threads_started":1}
I20260811 08:09:00.640658 4448 tablet_service.cc:1467] Processing CreateTablet for tablet 1d428aa8650f40468b61ae4fbb5395f7 (DEFAULT_TABLE table=test-table [id=a53c13a7308e4db69151a9c8b15e7fcc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:09:00.641026 4808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:00.638009 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41784 (local address 127.27.243.193:37543)
0811 08:09:00.638174 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:00.638177 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:00.639206 (+ 1029us) server_negotiation.cc:407] Connection header received
0811 08:09:00.639235 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:00.639237 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:00.639247 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:00.639312 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:00.640457 (+ 1145us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:09:00.640465 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:09:00.640465 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:09:00.640471 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:09:00.640508 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:09:00.640534 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:09:00.640605 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 08:09:00.640924 (+ 319us) server_negotiation.cc:299] Negotiation successful
0811 08:09:00.640942 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":135,"thread_start_us":82,"threads_started":1}
I20260811 08:09:00.641042 4448 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1d428aa8650f40468b61ae4fbb5395f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:09:00.641733 4210 tablet_service.cc:1467] Processing CreateTablet for tablet 1d428aa8650f40468b61ae4fbb5395f7 (DEFAULT_TABLE table=test-table [id=a53c13a7308e4db69151a9c8b15e7fcc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:09:00.642102 4210 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1d428aa8650f40468b61ae4fbb5395f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:09:00.643573 4809 tablet_bootstrap.cc:492] T 1d428aa8650f40468b61ae4fbb5395f7 P 4351fbcc8557489a96b6ccfc5382aa05: Bootstrap starting.
I20260811 08:09:00.644130 4811 tablet_bootstrap.cc:492] T 1d428aa8650f40468b61ae4fbb5395f7 P 62427fcfb8ea439a98d19ff00187cf0e: Bootstrap starting.
I20260811 08:09:00.644366 4809 tablet_bootstrap.cc:654] T 1d428aa8650f40468b61ae4fbb5395f7 P 4351fbcc8557489a96b6ccfc5382aa05: Neither blocks nor log segments found. Creating new log.
I20260811 08:09:00.644702 4809 log.cc:824] T 1d428aa8650f40468b61ae4fbb5395f7 P 4351fbcc8557489a96b6ccfc5382aa05: Log is configured to *not* fsync() on all Append() calls
I20260811 08:09:00.644798 4811 tablet_bootstrap.cc:654] T 1d428aa8650f40468b61ae4fbb5395f7 P 62427fcfb8ea439a98d19ff00187cf0e: Neither blocks nor log segments found. Creating new log.
I20260811 08:09:00.645128 4811 log.cc:824] T 1d428aa8650f40468b61ae4fbb5395f7 P 62427fcfb8ea439a98d19ff00187cf0e: Log is configured to *not* fsync() on all Append() calls
I20260811 08:09:00.645488 4812 tablet_bootstrap.cc:492] T 1d428aa8650f40468b61ae4fbb5395f7 P eabca180c2c04938a2ef7118bbe25999: Bootstrap starting.
I20260811 08:09:00.645696 4809 tablet_bootstrap.cc:492] T 1d428aa8650f40468b61ae4fbb5395f7 P 4351fbcc8557489a96b6ccfc5382aa05: No bootstrap required, opened a new log
I20260811 08:09:00.645768 4809 ts_tablet_manager.cc:1397] T 1d428aa8650f40468b61ae4fbb5395f7 P 4351fbcc8557489a96b6ccfc5382aa05: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 08:09:00.646000 4811 tablet_bootstrap.cc:492] T 1d428aa8650f40468b61ae4fbb5395f7 P 62427fcfb8ea439a98d19ff00187cf0e: No bootstrap required, opened a new log
I20260811 08:09:00.646070 4811 ts_tablet_manager.cc:1397] T 1d428aa8650f40468b61ae4fbb5395f7 P 62427fcfb8ea439a98d19ff00187cf0e: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 08:09:00.646123 4812 tablet_bootstrap.cc:654] T 1d428aa8650f40468b61ae4fbb5395f7 P eabca180c2c04938a2ef7118bbe25999: Neither blocks nor log segments found. Creating new log.
I20260811 08:09:00.646395 4812 log.cc:824] T 1d428aa8650f40468b61ae4fbb5395f7 P eabca180c2c04938a2ef7118bbe25999: Log is configured to *not* fsync() on all Append() calls
I20260811 08:09:00.647035 4812 tablet_bootstrap.cc:492] T 1d428aa8650f40468b61ae4fbb5395f7 P eabca180c2c04938a2ef7118bbe25999: No bootstrap required, opened a new log
I20260811 08:09:00.647097 4812 ts_tablet_manager.cc:1397] T 1d428aa8650f40468b61ae4fbb5395f7 P eabca180c2c04938a2ef7118bbe25999: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260811 08:09:00.648571 4809 raft_consensus.cc:348] T 1d428aa8650f40468b61ae4fbb5395f7 P 4351fbcc8557489a96b6ccfc5382aa05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62427fcfb8ea439a98d19ff00187cf0e" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 42325 } } peers { permanent_uuid: "4351fbcc8557489a96b6ccfc5382aa05" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 45619 } } peers { permanent_uuid: "eabca180c2c04938a2ef7118bbe25999" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 37543 } }
I20260811 08:09:00.648571 4811 raft_consensus.cc:348] T 1d428aa8650f40468b61ae4fbb5395f7 P 62427fcfb8ea439a98d19ff00187cf0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62427fcfb8ea439a98d19ff00187cf0e" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 42325 } } peers { permanent_uuid: "4351fbcc8557489a96b6ccfc5382aa05" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 45619 } } peers { permanent_uuid: "eabca180c2c04938a2ef7118bbe25999" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 37543 } }
I20260811 08:09:00.648741 4809 raft_consensus.cc:374] T 1d428aa8650f40468b61ae4fbb5395f7 P 4351fbcc8557489a96b6ccfc5382aa05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:09:00.648741 4811 raft_consensus.cc:374] T 1d428aa8650f40468b61ae4fbb5395f7 P 62427fcfb8ea439a98d19ff00187cf0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:09:00.648778 4811 raft_consensus.cc:729] T 1d428aa8650f40468b61ae4fbb5395f7 P 62427fcfb8ea439a98d19ff00187cf0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62427fcfb8ea439a98d19ff00187cf0e, State: Initialized, Role: FOLLOWER
I20260811 08:09:00.648778 4809 raft_consensus.cc:729] T 1d428aa8650f40468b61ae4fbb5395f7 P 4351fbcc8557489a96b6ccfc5382aa05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4351fbcc8557489a96b6ccfc5382aa05, State: Initialized, Role: FOLLOWER
I20260811 08:09:00.648926 4811 consensus_queue.cc:260] T 1d428aa8650f40468b61ae4fbb5395f7 P 62427fcfb8ea439a98d19ff00187cf0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62427fcfb8ea439a98d19ff00187cf0e" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 42325 } } peers { permanent_uuid: "4351fbcc8557489a96b6ccfc5382aa05" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 45619 } } peers { permanent_uuid: "eabca180c2c04938a2ef7118bbe25999" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 37543 } }
I20260811 08:09:00.648950 4809 consensus_queue.cc:260] T 1d428aa8650f40468b61ae4fbb5395f7 P 4351fbcc8557489a96b6ccfc5382aa05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62427fcfb8ea439a98d19ff00187cf0e" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 42325 } } peers { permanent_uuid: "4351fbcc8557489a96b6ccfc5382aa05" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 45619 } } peers { permanent_uuid: "eabca180c2c04938a2ef7118bbe25999" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 37543 } }
I20260811 08:09:00.649195 4811 ts_tablet_manager.cc:1428] T 1d428aa8650f40468b61ae4fbb5395f7 P 62427fcfb8ea439a98d19ff00187cf0e: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 08:09:00.649195 4809 ts_tablet_manager.cc:1428] T 1d428aa8650f40468b61ae4fbb5395f7 P 4351fbcc8557489a96b6ccfc5382aa05: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260811 08:09:00.649312 4786 heartbeater.cc:503] Master 127.27.243.254:38135 was elected leader, sending a full tablet report...
I20260811 08:09:00.649312 4555 heartbeater.cc:503] Master 127.27.243.254:38135 was elected leader, sending a full tablet report...
I20260811 08:09:00.649241 4812 raft_consensus.cc:348] T 1d428aa8650f40468b61ae4fbb5395f7 P eabca180c2c04938a2ef7118bbe25999 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62427fcfb8ea439a98d19ff00187cf0e" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 42325 } } peers { permanent_uuid: "4351fbcc8557489a96b6ccfc5382aa05" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 45619 } } peers { permanent_uuid: "eabca180c2c04938a2ef7118bbe25999" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 37543 } }
I20260811 08:09:00.649408 4812 raft_consensus.cc:374] T 1d428aa8650f40468b61ae4fbb5395f7 P eabca180c2c04938a2ef7118bbe25999 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:09:00.649451 4812 raft_consensus.cc:729] T 1d428aa8650f40468b61ae4fbb5395f7 P eabca180c2c04938a2ef7118bbe25999 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eabca180c2c04938a2ef7118bbe25999, State: Initialized, Role: FOLLOWER
I20260811 08:09:00.649592 4812 consensus_queue.cc:260] T 1d428aa8650f40468b61ae4fbb5395f7 P eabca180c2c04938a2ef7118bbe25999 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62427fcfb8ea439a98d19ff00187cf0e" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 42325 } } peers { permanent_uuid: "4351fbcc8557489a96b6ccfc5382aa05" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 45619 } } peers { permanent_uuid: "eabca180c2c04938a2ef7118bbe25999" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 37543 } }
I20260811 08:09:00.649884 4320 heartbeater.cc:503] Master 127.27.243.254:38135 was elected leader, sending a full tablet report...
I20260811 08:09:00.649866 4812 ts_tablet_manager.cc:1428] T 1d428aa8650f40468b61ae4fbb5395f7 P eabca180c2c04938a2ef7118bbe25999: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
W20260811 08:09:00.754262 4558 tablet.cc:2369] T 1d428aa8650f40468b61ae4fbb5395f7 P 62427fcfb8ea439a98d19ff00187cf0e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 08:09:00.772482 4820 raft_consensus.cc:482] T 1d428aa8650f40468b61ae4fbb5395f7 P 4351fbcc8557489a96b6ccfc5382aa05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:09:00.772632 4820 raft_consensus.cc:504] T 1d428aa8650f40468b61ae4fbb5395f7 P 4351fbcc8557489a96b6ccfc5382aa05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62427fcfb8ea439a98d19ff00187cf0e" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 42325 } } peers { permanent_uuid: "4351fbcc8557489a96b6ccfc5382aa05" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 45619 } } peers { permanent_uuid: "eabca180c2c04938a2ef7118bbe25999" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 37543 } }
I20260811 08:09:00.772982 4820 leader_election.cc:288] T 1d428aa8650f40468b61ae4fbb5395f7 P 4351fbcc8557489a96b6ccfc5382aa05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 62427fcfb8ea439a98d19ff00187cf0e (127.27.243.194:42325), eabca180c2c04938a2ef7118bbe25999 (127.27.243.193:37543)
I20260811 08:09:00.774240 4790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:00.773161 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.194:42325 (local address 127.27.243.195:40265)
0811 08:09:00.773227 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:00.773239 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:00.773281 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:00.773443 (+ 162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:00.773444 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:00.773448 (+ 4us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:09:00.773895 (+ 447us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 08:09:00.773895 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:09:00.773904 (+ 9us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 08:09:00.773918 (+ 14us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:09:00.774113 (+ 195us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:09:00.774114 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:09:00.774114 (+ 0us) client_negotiation.cc:769] Sending connection context
0811 08:09:00.774155 (+ 41us) client_negotiation.cc:240] Negotiation successful
0811 08:09:00.774170 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42}
I20260811 08:09:00.774250 4806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:00.773223 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.195:40265 (local address 127.27.243.194:42325)
0811 08:09:00.773274 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:00.773276 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:00.773289 (+ 13us) server_negotiation.cc:407] Connection header received
0811 08:09:00.773365 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:00.773366 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:00.773372 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:00.773424 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:00.774010 (+ 586us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:09:00.774012 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:09:00.774012 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:09:00.774018 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:09:00.774040 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:09:00.774045 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:09:00.774102 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 08:09:00.774167 (+ 65us) server_negotiation.cc:299] Negotiation successful
0811 08:09:00.774181 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260811 08:09:00.774386 4823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:00.773276 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.193:37543 (local address 127.27.243.195:52395)
0811 08:09:00.773480 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:00.773488 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:00.773566 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:00.773682 (+ 116us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:00.773683 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:00.773685 (+ 2us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:09:00.774069 (+ 384us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 08:09:00.774069 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:09:00.774076 (+ 7us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 08:09:00.774089 (+ 13us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:09:00.774249 (+ 160us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:09:00.774250 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:09:00.774250 (+ 0us) client_negotiation.cc:769] Sending connection context
0811 08:09:00.774294 (+ 44us) client_negotiation.cc:240] Negotiation successful
0811 08:09:00.774306 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":135,"threads_started":1}
I20260811 08:09:00.774385 4808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:00.773345 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.195:52395 (local address 127.27.243.193:37543)
0811 08:09:00.773411 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:00.773413 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:00.773547 (+ 134us) server_negotiation.cc:407] Connection header received
0811 08:09:00.773620 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:00.773621 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:00.773626 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:00.773674 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:00.774164 (+ 490us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:09:00.774166 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:09:00.774167 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:09:00.774171 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:09:00.774188 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:09:00.774192 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:09:00.774245 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 08:09:00.774297 (+ 52us) server_negotiation.cc:299] Negotiation successful
0811 08:09:00.774309 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 08:09:00.774617 4483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1d428aa8650f40468b61ae4fbb5395f7" candidate_uuid: "4351fbcc8557489a96b6ccfc5382aa05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62427fcfb8ea439a98d19ff00187cf0e" is_pre_election: true
I20260811 08:09:00.774770 4483 raft_consensus.cc:2454] T 1d428aa8650f40468b61ae4fbb5395f7 P 62427fcfb8ea439a98d19ff00187cf0e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4351fbcc8557489a96b6ccfc5382aa05 in term 0.
I20260811 08:09:00.774719 4241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1d428aa8650f40468b61ae4fbb5395f7" candidate_uuid: "4351fbcc8557489a96b6ccfc5382aa05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eabca180c2c04938a2ef7118bbe25999" is_pre_election: true
I20260811 08:09:00.774873 4241 raft_consensus.cc:2454] T 1d428aa8650f40468b61ae4fbb5395f7 P eabca180c2c04938a2ef7118bbe25999 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4351fbcc8557489a96b6ccfc5382aa05 in term 0.
I20260811 08:09:00.774981 4589 leader_election.cc:302] T 1d428aa8650f40468b61ae4fbb5395f7 P 4351fbcc8557489a96b6ccfc5382aa05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4351fbcc8557489a96b6ccfc5382aa05, 62427fcfb8ea439a98d19ff00187cf0e; no voters:
I20260811 08:09:00.775099 4820 raft_consensus.cc:2781] T 1d428aa8650f40468b61ae4fbb5395f7 P 4351fbcc8557489a96b6ccfc5382aa05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 08:09:00.775154 4820 raft_consensus.cc:482] T 1d428aa8650f40468b61ae4fbb5395f7 P 4351fbcc8557489a96b6ccfc5382aa05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 08:09:00.775168 4820 raft_consensus.cc:3037] T 1d428aa8650f40468b61ae4fbb5395f7 P 4351fbcc8557489a96b6ccfc5382aa05 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:09:00.775841 4820 raft_consensus.cc:504] T 1d428aa8650f40468b61ae4fbb5395f7 P 4351fbcc8557489a96b6ccfc5382aa05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62427fcfb8ea439a98d19ff00187cf0e" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 42325 } } peers { permanent_uuid: "4351fbcc8557489a96b6ccfc5382aa05" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 45619 } } peers { permanent_uuid: "eabca180c2c04938a2ef7118bbe25999" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 37543 } }
I20260811 08:09:00.775947 4820 leader_election.cc:288] T 1d428aa8650f40468b61ae4fbb5395f7 P 4351fbcc8557489a96b6ccfc5382aa05 [CANDIDATE]: Term 1 election: Requested vote from peers 62427fcfb8ea439a98d19ff00187cf0e (127.27.243.194:42325), eabca180c2c04938a2ef7118bbe25999 (127.27.243.193:37543)
I20260811 08:09:00.776104 4483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1d428aa8650f40468b61ae4fbb5395f7" candidate_uuid: "4351fbcc8557489a96b6ccfc5382aa05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62427fcfb8ea439a98d19ff00187cf0e"
I20260811 08:09:00.776141 4241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1d428aa8650f40468b61ae4fbb5395f7" candidate_uuid: "4351fbcc8557489a96b6ccfc5382aa05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eabca180c2c04938a2ef7118bbe25999"
I20260811 08:09:00.776180 4483 raft_consensus.cc:3037] T 1d428aa8650f40468b61ae4fbb5395f7 P 62427fcfb8ea439a98d19ff00187cf0e [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:09:00.776206 4241 raft_consensus.cc:3037] T 1d428aa8650f40468b61ae4fbb5395f7 P eabca180c2c04938a2ef7118bbe25999 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:09:00.776921 4241 raft_consensus.cc:2454] T 1d428aa8650f40468b61ae4fbb5395f7 P eabca180c2c04938a2ef7118bbe25999 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4351fbcc8557489a96b6ccfc5382aa05 in term 1.
I20260811 08:09:00.776924 4483 raft_consensus.cc:2454] T 1d428aa8650f40468b61ae4fbb5395f7 P 62427fcfb8ea439a98d19ff00187cf0e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4351fbcc8557489a96b6ccfc5382aa05 in term 1.
I20260811 08:09:00.777060 4589 leader_election.cc:302] T 1d428aa8650f40468b61ae4fbb5395f7 P 4351fbcc8557489a96b6ccfc5382aa05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4351fbcc8557489a96b6ccfc5382aa05, 62427fcfb8ea439a98d19ff00187cf0e; no voters:
I20260811 08:09:00.777163 4820 raft_consensus.cc:2781] T 1d428aa8650f40468b61ae4fbb5395f7 P 4351fbcc8557489a96b6ccfc5382aa05 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:09:00.777329 4820 raft_consensus.cc:686] T 1d428aa8650f40468b61ae4fbb5395f7 P 4351fbcc8557489a96b6ccfc5382aa05 [term 1 LEADER]: Becoming Leader. State: Replica: 4351fbcc8557489a96b6ccfc5382aa05, State: Running, Role: LEADER
I20260811 08:09:00.777419 4820 consensus_queue.cc:237] T 1d428aa8650f40468b61ae4fbb5395f7 P 4351fbcc8557489a96b6ccfc5382aa05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62427fcfb8ea439a98d19ff00187cf0e" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 42325 } } peers { permanent_uuid: "4351fbcc8557489a96b6ccfc5382aa05" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 45619 } } peers { permanent_uuid: "eabca180c2c04938a2ef7118bbe25999" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 37543 } }
I20260811 08:09:00.778273 4001 catalog_manager.cc:5495] T 1d428aa8650f40468b61ae4fbb5395f7 P 4351fbcc8557489a96b6ccfc5382aa05 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4351fbcc8557489a96b6ccfc5382aa05 (127.27.243.195). New cstate: current_term: 1 leader_uuid: "4351fbcc8557489a96b6ccfc5382aa05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62427fcfb8ea439a98d19ff00187cf0e" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 42325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4351fbcc8557489a96b6ccfc5382aa05" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 45619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eabca180c2c04938a2ef7118bbe25999" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 37543 } health_report { overall_health: UNKNOWN } } }
I20260811 08:09:00.785949 4803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:00.784883 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54354 (local address 127.27.243.195:45619)
0811 08:09:00.784932 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:00.784934 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:00.784942 (+ 8us) server_negotiation.cc:407] Connection header received
0811 08:09:00.784998 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:00.784999 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:00.785012 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:00.785059 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:00.785663 (+ 604us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:09:00.785664 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:09:00.785665 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:09:00.785669 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:09:00.785685 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:09:00.785689 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:09:00.785749 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0811 08:09:00.785870 (+ 121us) server_negotiation.cc:299] Negotiation successful
0811 08:09:00.785884 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 08:09:00.787837 4483 raft_consensus.cc:1261] T 1d428aa8650f40468b61ae4fbb5395f7 P 62427fcfb8ea439a98d19ff00187cf0e [term 1 FOLLOWER]: Refusing update from remote peer 4351fbcc8557489a96b6ccfc5382aa05: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:09:00.787986 4241 raft_consensus.cc:1261] T 1d428aa8650f40468b61ae4fbb5395f7 P eabca180c2c04938a2ef7118bbe25999 [term 1 FOLLOWER]: Refusing update from remote peer 4351fbcc8557489a96b6ccfc5382aa05: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:09:00.788158 4824 consensus_queue.cc:1035] T 1d428aa8650f40468b61ae4fbb5395f7 P 4351fbcc8557489a96b6ccfc5382aa05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "62427fcfb8ea439a98d19ff00187cf0e" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 42325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:09:00.788311 4820 consensus_queue.cc:1035] T 1d428aa8650f40468b61ae4fbb5395f7 P 4351fbcc8557489a96b6ccfc5382aa05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eabca180c2c04938a2ef7118bbe25999" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 37543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:09:00.793359 4846 mvcc.cc:205] Tried to move back new op lower bound from 7317240794264170496 to 7317240794225074176. Current Snapshot: MvccSnapshot[applied={T|T < 7317240794264170496 or (T in {7317240794264170496})}]
I20260811 08:09:00.794080 3999 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56586:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:09:00.794179 3999 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56586:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:09:00.794492 4845 mvcc.cc:205] Tried to move back new op lower bound from 7317240794264170496 to 7317240794225074176. Current Snapshot: MvccSnapshot[applied={T|T < 7317240794264170496}]
I20260811 08:09:00.795197 3999 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c7e3903ed2fe492589b14b42129398a4: Sending DeleteTablet for 3 replicas of tablet 1d428aa8650f40468b61ae4fbb5395f7
I20260811 08:09:00.795563 4210 tablet_service.cc:1514] Processing DeleteTablet for tablet 1d428aa8650f40468b61ae4fbb5395f7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:09:00 UTC) from {username='slave'} at 127.0.0.1:41784
I20260811 08:09:00.795560 4674 tablet_service.cc:1514] Processing DeleteTablet for tablet 1d428aa8650f40468b61ae4fbb5395f7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:09:00 UTC) from {username='slave'} at 127.0.0.1:54340
I20260811 08:09:00.795801 4860 tablet_replica.cc:330] T 1d428aa8650f40468b61ae4fbb5395f7 P 4351fbcc8557489a96b6ccfc5382aa05: stopping tablet replica
I20260811 08:09:00.795897 4448 tablet_service.cc:1514] Processing DeleteTablet for tablet 1d428aa8650f40468b61ae4fbb5395f7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:09:00 UTC) from {username='slave'} at 127.0.0.1:56660
I20260811 08:09:00.796089 4868 tablet_replica.cc:330] T 1d428aa8650f40468b61ae4fbb5395f7 P 62427fcfb8ea439a98d19ff00187cf0e: stopping tablet replica
I20260811 08:09:00.796105 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 4104
I20260811 08:09:00.796190 4868 raft_consensus.cc:2229] T 1d428aa8650f40468b61ae4fbb5395f7 P 62427fcfb8ea439a98d19ff00187cf0e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:09:00.796280 4868 raft_consensus.cc:2258] T 1d428aa8650f40468b61ae4fbb5395f7 P 62427fcfb8ea439a98d19ff00187cf0e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:09:00.812532 4860 raft_consensus.cc:2229] T 1d428aa8650f40468b61ae4fbb5395f7 P 4351fbcc8557489a96b6ccfc5382aa05 [term 1 LEADER]: Raft consensus shutting down.
I20260811 08:09:00.812762 4860 raft_consensus.cc:2258] T 1d428aa8650f40468b61ae4fbb5395f7 P 4351fbcc8557489a96b6ccfc5382aa05 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:09:00.814988 4860 ts_tablet_manager.cc:1905] T 1d428aa8650f40468b61ae4fbb5395f7 P 4351fbcc8557489a96b6ccfc5382aa05: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:09:00.816385 4868 ts_tablet_manager.cc:1905] T 1d428aa8650f40468b61ae4fbb5395f7 P 62427fcfb8ea439a98d19ff00187cf0e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:09:00.816788 4860 ts_tablet_manager.cc:1918] T 1d428aa8650f40468b61ae4fbb5395f7 P 4351fbcc8557489a96b6ccfc5382aa05: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:09:00.816885 4860 log.cc:1196] T 1d428aa8650f40468b61ae4fbb5395f7 P 4351fbcc8557489a96b6ccfc5382aa05: Deleting WAL directory at /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435717191469-28623-0/minicluster-data/ts-2/wal/wals/1d428aa8650f40468b61ae4fbb5395f7
I20260811 08:09:00.817185 4860 ts_tablet_manager.cc:1939] T 1d428aa8650f40468b61ae4fbb5395f7 P 4351fbcc8557489a96b6ccfc5382aa05: Deleting consensus metadata
I20260811 08:09:00.817700 3979 catalog_manager.cc:4841] TS 4351fbcc8557489a96b6ccfc5382aa05 (127.27.243.195:45619): tablet 1d428aa8650f40468b61ae4fbb5395f7 (table test-table [id=a53c13a7308e4db69151a9c8b15e7fcc]) successfully deleted
I20260811 08:09:00.817967 4868 ts_tablet_manager.cc:1918] T 1d428aa8650f40468b61ae4fbb5395f7 P 62427fcfb8ea439a98d19ff00187cf0e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:09:00.818050 4868 log.cc:1196] T 1d428aa8650f40468b61ae4fbb5395f7 P 62427fcfb8ea439a98d19ff00187cf0e: Deleting WAL directory at /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435717191469-28623-0/minicluster-data/ts-1/wal/wals/1d428aa8650f40468b61ae4fbb5395f7
I20260811 08:09:00.818300 4868 ts_tablet_manager.cc:1939] T 1d428aa8650f40468b61ae4fbb5395f7 P 62427fcfb8ea439a98d19ff00187cf0e: Deleting consensus metadata
I20260811 08:09:00.818765 3980 catalog_manager.cc:4841] TS 62427fcfb8ea439a98d19ff00187cf0e (127.27.243.194:42325): tablet 1d428aa8650f40468b61ae4fbb5395f7 (table test-table [id=a53c13a7308e4db69151a9c8b15e7fcc]) successfully deleted
W20260811 08:09:00.820657 3980 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.27.243.193:37543 (error 108)
I20260811 08:09:00.820870 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 4324
I20260811 08:09:00.825446 4807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:00.825284 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.193:37543 (local address 127.0.0.1:41786)
0811 08:09:00.825348 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:00.825406 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.193:37543: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260811 08:09:00.825918 3980 catalog_manager.cc:4584] TS eabca180c2c04938a2ef7118bbe25999 (127.27.243.193:37543): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 1d428aa8650f40468b61ae4fbb5395f7: Network error: Client connection negotiation failed: client connection to 127.27.243.193:37543: connect: Connection refused (error 111)
I20260811 08:09:00.831672 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 4561
I20260811 08:09:00.842201 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 3954
2026-08-11T08:09:00Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (723 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260811 08:09:00.864949 28623 mini_oidc.cc:152] Starting JWKS server
I20260811 08:09:00.866075 28623 webserver.cc:460] Webserver started at https://127.0.0.1:36253/ using document root <none> and password file <none>
I20260811 08:09:00.866171 28623 mini_oidc.cc:189] Starting OIDC Discovery server
I20260811 08:09:00.866344 28623 webserver.cc:460] Webserver started at http://127.0.0.1:46679/ using document root <none> and password file <none>
2026-08-11T08:09:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:09:00Z Disabled control of system clock
I20260811 08:09:00.874922 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786435717191469-28623-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786435717191469-28623-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786435717191469-28623-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.243.254:40077
--webserver_interface=127.27.243.254
--webserver_port=0
--builtin_ntp_servers=127.27.243.212:40947
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.243.254:40077
--enable_jwt_token_auth=true
--jwks_url=https://localhost:36253/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786435717191469-28623-0/testchainca.cert with env {}
W20260811 08:09:00.956758 4881 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:09:00.956954 4881 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:09:00.956974 4881 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:09:00.958158 4881 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:09:00.958199 4881 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:09:00.958209 4881 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:09:00.958221 4881 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:09:00.958231 4881 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 08:09:00.958248 4881 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 08:09:00.958263 4881 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:36253/jwks.json
I20260811 08:09:00.959836 4881 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:40947
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786435717191469-28623-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786435717191469-28623-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.243.254:40077
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.243.254:40077
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:36253/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.243.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786435717191469-28623-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4881
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786435717191469-28623-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:09:00.960050 4881 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:09:00.960222 4881 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:09:00.964890 4892 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:09:00.964911 4891 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:09:00.964967 4881 server_base.cc:1034] running on GCE node
W20260811 08:09:00.964911 4896 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:09:00.965323 4881 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:09:00.965682 4881 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:09:00.966876 4881 hybrid_clock.cc:648] HybridClock initialized: now 1786435740966853 us; error 34 us; skew 500 ppm
I20260811 08:09:00.968083 4881 webserver.cc:460] Webserver started at http://127.27.243.254:37133/ using document root <none> and password file <none>
I20260811 08:09:00.968276 4881 fs_manager.cc:359] Metadata directory not provided
I20260811 08:09:00.968320 4881 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:09:00.968416 4881 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:09:00.969409 4881 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786435717191469-28623-0/minicluster-data/master-0/data/instance:
uuid: "995ca34816ee45d08d5cbe76ea607803"
format_stamp: "Formatted at 2026-08-11 08:09:00 on dist-test-slave-7lbf"
server_key: "0c10a73901f9d5bb69f3e7d9e0eaee04"
server_key_iv: "e871d33125358865459849133ac57779"
server_key_version: "encryptionkey@0"
I20260811 08:09:00.969754 4881 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786435717191469-28623-0/minicluster-data/master-0/wal/instance:
uuid: "995ca34816ee45d08d5cbe76ea607803"
format_stamp: "Formatted at 2026-08-11 08:09:00 on dist-test-slave-7lbf"
server_key: "0c10a73901f9d5bb69f3e7d9e0eaee04"
server_key_iv: "e871d33125358865459849133ac57779"
server_key_version: "encryptionkey@0"
I20260811 08:09:00.970932 4881 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:09:00.971557 4909 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:00.971751 4881 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 08:09:00.971876 4881 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786435717191469-28623-0/minicluster-data/master-0/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786435717191469-28623-0/minicluster-data/master-0/wal
uuid: "995ca34816ee45d08d5cbe76ea607803"
format_stamp: "Formatted at 2026-08-11 08:09:00 on dist-test-slave-7lbf"
server_key: "0c10a73901f9d5bb69f3e7d9e0eaee04"
server_key_iv: "e871d33125358865459849133ac57779"
server_key_version: "encryptionkey@0"
I20260811 08:09:00.971942 4881 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786435717191469-28623-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786435717191469-28623-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786435717191469-28623-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:09:00.978907 4881 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:09:00.979193 4881 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:09:00.979326 4881 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:09:00.983150 4881 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.254:40077
I20260811 08:09:00.983181 4997 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.254:40077 every 8 connection(s)
I20260811 08:09:00.983493 4881 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
I20260811 08:09:00.984445 4999 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:09:00.986780 4999 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 995ca34816ee45d08d5cbe76ea607803: Bootstrap starting.
I20260811 08:09:00.987330 4999 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 995ca34816ee45d08d5cbe76ea607803: Neither blocks nor log segments found. Creating new log.
I20260811 08:09:00.987668 4999 log.cc:824] T 00000000000000000000000000000000 P 995ca34816ee45d08d5cbe76ea607803: Log is configured to *not* fsync() on all Append() calls
I20260811 08:09:00.988480 4999 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 995ca34816ee45d08d5cbe76ea607803: No bootstrap required, opened a new log
I20260811 08:09:00.989274 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 4881
I20260811 08:09:00.989398 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786435717191469-28623-0/minicluster-data/master-0/wal/instance
I20260811 08:09:00.989635 28623 external_mini_cluster.cc:1428] Setting key 263a8d132bd3ff9143d9cdf3cac0c42e
I20260811 08:09:00.990495 4999 raft_consensus.cc:348] T 00000000000000000000000000000000 P 995ca34816ee45d08d5cbe76ea607803 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "995ca34816ee45d08d5cbe76ea607803" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 40077 } }
I20260811 08:09:00.990664 4999 raft_consensus.cc:374] T 00000000000000000000000000000000 P 995ca34816ee45d08d5cbe76ea607803 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:09:00.990700 4999 raft_consensus.cc:729] T 00000000000000000000000000000000 P 995ca34816ee45d08d5cbe76ea607803 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 995ca34816ee45d08d5cbe76ea607803, State: Initialized, Role: FOLLOWER
I20260811 08:09:00.990825 4999 consensus_queue.cc:260] T 00000000000000000000000000000000 P 995ca34816ee45d08d5cbe76ea607803 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "995ca34816ee45d08d5cbe76ea607803" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 40077 } }
I20260811 08:09:00.990919 4999 raft_consensus.cc:388] T 00000000000000000000000000000000 P 995ca34816ee45d08d5cbe76ea607803 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:09:00.990944 4999 raft_consensus.cc:482] T 00000000000000000000000000000000 P 995ca34816ee45d08d5cbe76ea607803 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:09:00.990986 4999 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 995ca34816ee45d08d5cbe76ea607803 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:09:00.991492 4999 raft_consensus.cc:504] T 00000000000000000000000000000000 P 995ca34816ee45d08d5cbe76ea607803 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "995ca34816ee45d08d5cbe76ea607803" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 40077 } }
I20260811 08:09:00.991591 4999 leader_election.cc:302] T 00000000000000000000000000000000 P 995ca34816ee45d08d5cbe76ea607803 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 995ca34816ee45d08d5cbe76ea607803; no voters:
I20260811 08:09:00.991739 4999 leader_election.cc:288] T 00000000000000000000000000000000 P 995ca34816ee45d08d5cbe76ea607803 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:09:00.991796 5008 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 995ca34816ee45d08d5cbe76ea607803 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:09:00.991912 5008 raft_consensus.cc:686] T 00000000000000000000000000000000 P 995ca34816ee45d08d5cbe76ea607803 [term 1 LEADER]: Becoming Leader. State: Replica: 995ca34816ee45d08d5cbe76ea607803, State: Running, Role: LEADER
I20260811 08:09:00.992013 4999 sys_catalog.cc:564] T 00000000000000000000000000000000 P 995ca34816ee45d08d5cbe76ea607803 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:09:00.991994 5008 consensus_queue.cc:237] T 00000000000000000000000000000000 P 995ca34816ee45d08d5cbe76ea607803 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "995ca34816ee45d08d5cbe76ea607803" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 40077 } }
I20260811 08:09:00.992324 5008 sys_catalog.cc:455] T 00000000000000000000000000000000 P 995ca34816ee45d08d5cbe76ea607803 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 995ca34816ee45d08d5cbe76ea607803. Latest consensus state: current_term: 1 leader_uuid: "995ca34816ee45d08d5cbe76ea607803" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "995ca34816ee45d08d5cbe76ea607803" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 40077 } } }
I20260811 08:09:00.992409 5008 sys_catalog.cc:458] T 00000000000000000000000000000000 P 995ca34816ee45d08d5cbe76ea607803 [sys.catalog]: This master's current role is: LEADER
I20260811 08:09:00.992342 5016 sys_catalog.cc:455] T 00000000000000000000000000000000 P 995ca34816ee45d08d5cbe76ea607803 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "995ca34816ee45d08d5cbe76ea607803" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "995ca34816ee45d08d5cbe76ea607803" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 40077 } } }
I20260811 08:09:00.992560 5016 sys_catalog.cc:458] T 00000000000000000000000000000000 P 995ca34816ee45d08d5cbe76ea607803 [sys.catalog]: This master's current role is: LEADER
W20260811 08:09:00.993793 5031 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 995ca34816ee45d08d5cbe76ea607803: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 08:09:00.993840 5031 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 08:09:00.994695 5020 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:09:00.994869 5020 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:09:00.995483 5006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:00.990152 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49112 (local address 127.27.243.254:40077)
0811 08:09:00.990353 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:00.990360 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:00.990385 (+ 25us) server_negotiation.cc:407] Connection header received
0811 08:09:00.990480 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:00.990486 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:00.990549 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:00.990654 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:00.990885 (+ 231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:00.992361 (+ 1476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:00.993454 (+ 1093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:00.994067 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:00.994185 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:00.994755 (+ 570us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:09:00.994760 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:09:00.994760 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:09:00.995008 (+ 248us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:09:00.995047 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:09:00.995059 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:09:00.995118 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0811 08:09:00.995192 (+ 74us) server_negotiation.cc:299] Negotiation successful
0811 08:09:00.995271 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":80,"threads_started":1}
I20260811 08:09:00.996387 28623 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 08:09:00.996544 5020 catalog_manager.cc:1347] Generated new cluster ID: 3ade0466c72e434e9bdadd2368494902
I20260811 08:09:00.996600 5020 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:09:01.023749 5020 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:09:01.024276 5020 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:09:01.030638 5020 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 995ca34816ee45d08d5cbe76ea607803: Generated new TSK 0
I20260811 08:09:01.030853 5020 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260811 08:09:01.059432 5050 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260811 08:09:01.059549 5050 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
W20260811 08:09:01.060058 5048 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:09:01.044889 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:40077 (local address 127.0.0.1:49128)
0811 08:09:01.045072 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:01.045083 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:01.045148 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:01.045314 (+ 166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:01.045315 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:01.045318 (+ 3us) client_negotiation.cc:189] Negotiated authn=JWT
0811 08:09:01.045382 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:01.045384 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:01.046069 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:01.046070 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:01.046673 (+ 603us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:01.046675 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:01.047030 (+ 355us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:01.047031 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:01.047096 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:01.047116 (+ 20us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 08:09:01.059671 (+ 12555us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36253/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0811 08:09:01.059753 (+ 82us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.27.243.254:40077: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36253/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":86,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.27.243.254:40077: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36253/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260811 08:09:01.060474 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 4881
2026-08-11T08:09:01Z chronyd exiting
I20260811 08:09:01.106462 28623 test_util.cc:175] -----------------------------------------------
I20260811 08:09:01.106551 28623 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786435717191469-28623-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (242 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260811 08:09:01.107379 28623 mini_oidc.cc:152] Starting JWKS server
I20260811 08:09:01.108060 28623 webserver.cc:460] Webserver started at https://127.0.0.1:35599/ using document root <none> and password file <none>
I20260811 08:09:01.108108 28623 mini_oidc.cc:189] Starting OIDC Discovery server
I20260811 08:09:01.108243 28623 webserver.cc:460] Webserver started at http://127.0.0.1:42605/ using document root <none> and password file <none>
2026-08-11T08:09:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:09:01Z Disabled control of system clock
I20260811 08:09:01.116966 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786435717191469-28623-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786435717191469-28623-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786435717191469-28623-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.243.254:42873
--webserver_interface=127.27.243.254
--webserver_port=0
--builtin_ntp_servers=127.27.243.212:33829
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.243.254:42873
--enable_jwt_token_auth=true
--jwks_url=https://localhost:35599/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786435717191469-28623-0/testchainca.cert with env {}
W20260811 08:09:01.197367 5062 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:09:01.197602 5062 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:09:01.197635 5062 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:09:01.198786 5062 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:09:01.198827 5062 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:09:01.198843 5062 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:09:01.198858 5062 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:09:01.198872 5062 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 08:09:01.198889 5062 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 08:09:01.198911 5062 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:35599/jwks.json
I20260811 08:09:01.200415 5062 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:33829
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786435717191469-28623-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786435717191469-28623-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.243.254:42873
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.243.254:42873
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:35599/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.243.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786435717191469-28623-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5062
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786435717191469-28623-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:09:01.200657 5062 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:09:01.200855 5062 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:09:01.205538 5070 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:09:01.205543 5069 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:09:01.205669 5062 server_base.cc:1034] running on GCE node
W20260811 08:09:01.205550 5075 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:09:01.206027 5062 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:09:01.206281 5062 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:09:01.207423 5062 hybrid_clock.cc:648] HybridClock initialized: now 1786435741207407 us; error 28 us; skew 500 ppm
I20260811 08:09:01.208642 5062 webserver.cc:460] Webserver started at http://127.27.243.254:35133/ using document root <none> and password file <none>
I20260811 08:09:01.208866 5062 fs_manager.cc:359] Metadata directory not provided
I20260811 08:09:01.208911 5062 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:09:01.209033 5062 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:09:01.210129 5062 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786435717191469-28623-0/minicluster-data/master-0/data/instance:
uuid: "13e79d03a5f9482594f7fa5560b717b1"
format_stamp: "Formatted at 2026-08-11 08:09:01 on dist-test-slave-7lbf"
server_key: "7d0c2e7a322a2855f9dd453d51ca0d9d"
server_key_iv: "504eef97e16906b3faa96d550ed3f022"
server_key_version: "encryptionkey@0"
I20260811 08:09:01.210474 5062 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786435717191469-28623-0/minicluster-data/master-0/wal/instance:
uuid: "13e79d03a5f9482594f7fa5560b717b1"
format_stamp: "Formatted at 2026-08-11 08:09:01 on dist-test-slave-7lbf"
server_key: "7d0c2e7a322a2855f9dd453d51ca0d9d"
server_key_iv: "504eef97e16906b3faa96d550ed3f022"
server_key_version: "encryptionkey@0"
I20260811 08:09:01.211759 5062 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 08:09:01.212517 5086 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:01.212659 5062 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 08:09:01.212745 5062 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786435717191469-28623-0/minicluster-data/master-0/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786435717191469-28623-0/minicluster-data/master-0/wal
uuid: "13e79d03a5f9482594f7fa5560b717b1"
format_stamp: "Formatted at 2026-08-11 08:09:01 on dist-test-slave-7lbf"
server_key: "7d0c2e7a322a2855f9dd453d51ca0d9d"
server_key_iv: "504eef97e16906b3faa96d550ed3f022"
server_key_version: "encryptionkey@0"
I20260811 08:09:01.212806 5062 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786435717191469-28623-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786435717191469-28623-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786435717191469-28623-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:09:01.228209 5062 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:09:01.228543 5062 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:09:01.228688 5062 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:09:01.232647 5062 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.254:42873
I20260811 08:09:01.232683 5165 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.254:42873 every 8 connection(s)
I20260811 08:09:01.233021 5062 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
I20260811 08:09:01.233731 5167 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:09:01.236445 5167 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 13e79d03a5f9482594f7fa5560b717b1: Bootstrap starting.
I20260811 08:09:01.236999 5167 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 13e79d03a5f9482594f7fa5560b717b1: Neither blocks nor log segments found. Creating new log.
I20260811 08:09:01.237269 5167 log.cc:824] T 00000000000000000000000000000000 P 13e79d03a5f9482594f7fa5560b717b1: Log is configured to *not* fsync() on all Append() calls
I20260811 08:09:01.237985 5167 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 13e79d03a5f9482594f7fa5560b717b1: No bootstrap required, opened a new log
I20260811 08:09:01.239562 5167 raft_consensus.cc:348] T 00000000000000000000000000000000 P 13e79d03a5f9482594f7fa5560b717b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "13e79d03a5f9482594f7fa5560b717b1" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 42873 } }
I20260811 08:09:01.239697 5167 raft_consensus.cc:374] T 00000000000000000000000000000000 P 13e79d03a5f9482594f7fa5560b717b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:09:01.239719 5167 raft_consensus.cc:729] T 00000000000000000000000000000000 P 13e79d03a5f9482594f7fa5560b717b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13e79d03a5f9482594f7fa5560b717b1, State: Initialized, Role: FOLLOWER
I20260811 08:09:01.239843 5167 consensus_queue.cc:260] T 00000000000000000000000000000000 P 13e79d03a5f9482594f7fa5560b717b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "13e79d03a5f9482594f7fa5560b717b1" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 42873 } }
I20260811 08:09:01.239907 5167 raft_consensus.cc:388] T 00000000000000000000000000000000 P 13e79d03a5f9482594f7fa5560b717b1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:09:01.239928 5167 raft_consensus.cc:482] T 00000000000000000000000000000000 P 13e79d03a5f9482594f7fa5560b717b1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:09:01.239955 5167 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 13e79d03a5f9482594f7fa5560b717b1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:09:01.240449 5167 raft_consensus.cc:504] T 00000000000000000000000000000000 P 13e79d03a5f9482594f7fa5560b717b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "13e79d03a5f9482594f7fa5560b717b1" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 42873 } }
I20260811 08:09:01.240538 5167 leader_election.cc:302] T 00000000000000000000000000000000 P 13e79d03a5f9482594f7fa5560b717b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 13e79d03a5f9482594f7fa5560b717b1; no voters:
I20260811 08:09:01.240684 5167 leader_election.cc:288] T 00000000000000000000000000000000 P 13e79d03a5f9482594f7fa5560b717b1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:09:01.240736 5170 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 13e79d03a5f9482594f7fa5560b717b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:09:01.240880 5170 raft_consensus.cc:686] T 00000000000000000000000000000000 P 13e79d03a5f9482594f7fa5560b717b1 [term 1 LEADER]: Becoming Leader. State: Replica: 13e79d03a5f9482594f7fa5560b717b1, State: Running, Role: LEADER
I20260811 08:09:01.240923 5167 sys_catalog.cc:564] T 00000000000000000000000000000000 P 13e79d03a5f9482594f7fa5560b717b1 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:09:01.240983 5170 consensus_queue.cc:237] T 00000000000000000000000000000000 P 13e79d03a5f9482594f7fa5560b717b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "13e79d03a5f9482594f7fa5560b717b1" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 42873 } }
I20260811 08:09:01.241369 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 5062
I20260811 08:09:01.241477 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786435717191469-28623-0/minicluster-data/master-0/wal/instance
I20260811 08:09:01.241592 5172 sys_catalog.cc:455] T 00000000000000000000000000000000 P 13e79d03a5f9482594f7fa5560b717b1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "13e79d03a5f9482594f7fa5560b717b1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "13e79d03a5f9482594f7fa5560b717b1" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 42873 } } }
I20260811 08:09:01.241667 5172 sys_catalog.cc:458] T 00000000000000000000000000000000 P 13e79d03a5f9482594f7fa5560b717b1 [sys.catalog]: This master's current role is: LEADER
I20260811 08:09:01.241685 28623 external_mini_cluster.cc:1428] Setting key 572604501800027fd3f76f177be027b7
I20260811 08:09:01.241755 5173 sys_catalog.cc:455] T 00000000000000000000000000000000 P 13e79d03a5f9482594f7fa5560b717b1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 13e79d03a5f9482594f7fa5560b717b1. Latest consensus state: current_term: 1 leader_uuid: "13e79d03a5f9482594f7fa5560b717b1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "13e79d03a5f9482594f7fa5560b717b1" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 42873 } } }
I20260811 08:09:01.241806 5173 sys_catalog.cc:458] T 00000000000000000000000000000000 P 13e79d03a5f9482594f7fa5560b717b1 [sys.catalog]: This master's current role is: LEADER
I20260811 08:09:01.241900 5182 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:09:01.242429 5182 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:09:01.243901 5182 catalog_manager.cc:1347] Generated new cluster ID: 39fa4fd163134619bbb931e186472b95
I20260811 08:09:01.243959 5182 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:09:01.248046 5189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:01.242305 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60966 (local address 127.27.243.254:42873)
0811 08:09:01.242551 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:01.242561 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:01.242997 (+ 436us) server_negotiation.cc:407] Connection header received
0811 08:09:01.243129 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:01.243137 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:01.243198 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:01.243316 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:01.243520 (+ 204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:01.244854 (+ 1334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:01.245945 (+ 1091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:01.246596 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:01.246736 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:01.247353 (+ 617us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:09:01.247357 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:09:01.247357 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:09:01.247563 (+ 206us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:09:01.247607 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:09:01.247622 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:09:01.247694 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0811 08:09:01.247751 (+ 57us) server_negotiation.cc:299] Negotiation successful
0811 08:09:01.247830 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":111,"thread_start_us":56,"threads_started":1}
I20260811 08:09:01.248948 28623 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 08:09:01.257143 5182 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:09:01.257843 5182 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:09:01.260985 5182 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 13e79d03a5f9482594f7fa5560b717b1: Generated new TSK 0
I20260811 08:09:01.261139 5182 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260811 08:09:01.283479 5211 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260811 08:09:01.283556 5211 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260811 08:09:01.283910 5189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:01.269443 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60978 (local address 127.27.243.254:42873)
0811 08:09:01.269488 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:01.269490 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:01.269621 (+ 131us) server_negotiation.cc:407] Connection header received
0811 08:09:01.269674 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:01.269675 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:01.269688 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:01.269763 (+ 75us) server_negotiation.cc:226] Negotiated authn=JWT
0811 08:09:01.269859 (+ 96us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:01.270741 (+ 882us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:01.271520 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:01.271837 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:01.271904 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:01.272053 (+ 149us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 08:09:01.283682 (+ 11629us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35599/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0811 08:09:01.283836 (+ 154us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:60978: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35599/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":22}
W20260811 08:09:01.283977 5189 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:60978: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35599/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260811 08:09:01.284011 5209 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:09:01.269393 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:42873 (local address 127.0.0.1:60978)
0811 08:09:01.269557 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:01.269567 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:01.269620 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:01.269761 (+ 141us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:01.269762 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:01.269763 (+ 1us) client_negotiation.cc:189] Negotiated authn=JWT
0811 08:09:01.269809 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:01.269810 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:01.270829 (+ 1019us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:01.270830 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:01.271445 (+ 615us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:01.271447 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:01.271916 (+ 469us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:01.271917 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:01.271964 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:01.271969 (+ 5us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 08:09:01.283786 (+ 11817us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35599/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0811 08:09:01.283921 (+ 135us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.27.243.254:42873: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35599/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":78,"threads_started":1}
I20260811 08:09:01.284332 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 5062
2026-08-11T08:09:01Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (224 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260811 08:09:01.331382 28623 mini_oidc.cc:152] Starting JWKS server
I20260811 08:09:01.332039 28623 webserver.cc:460] Webserver started at https://127.0.0.1:44029/ using document root <none> and password file <none>
I20260811 08:09:01.332083 28623 mini_oidc.cc:189] Starting OIDC Discovery server
I20260811 08:09:01.332191 28623 webserver.cc:460] Webserver started at http://127.0.0.1:45903/ using document root <none> and password file <none>
2026-08-11T08:09:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:09:01Z Disabled control of system clock
I20260811 08:09:01.340896 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786435717191469-28623-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786435717191469-28623-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786435717191469-28623-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.243.254:38489
--webserver_interface=127.27.243.254
--webserver_port=0
--builtin_ntp_servers=127.27.243.212:40545
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.243.254:38489
--enable_jwt_token_auth=true
--jwks_url=https://localhost:44029/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260811 08:09:01.423647 5223 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:09:01.423868 5223 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:09:01.423898 5223 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:09:01.425037 5223 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:09:01.425076 5223 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:09:01.425092 5223 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:09:01.425107 5223 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:09:01.425123 5223 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 08:09:01.425148 5223 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 08:09:01.425169 5223 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:44029/jwks.json
I20260811 08:09:01.426543 5223 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:40545
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786435717191469-28623-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786435717191469-28623-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.243.254:38489
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.243.254:38489
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:44029/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.243.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5223
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786435717191469-28623-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:09:01.426781 5223 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:09:01.427053 5223 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:09:01.431712 5232 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:09:01.431707 5235 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:09:01.431790 5223 server_base.cc:1034] running on GCE node
W20260811 08:09:01.431720 5231 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:09:01.432145 5223 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:09:01.432422 5223 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:09:01.433564 5223 hybrid_clock.cc:648] HybridClock initialized: now 1786435741433548 us; error 38 us; skew 500 ppm
I20260811 08:09:01.434737 5223 webserver.cc:460] Webserver started at http://127.27.243.254:46771/ using document root <none> and password file <none>
I20260811 08:09:01.434953 5223 fs_manager.cc:359] Metadata directory not provided
I20260811 08:09:01.435004 5223 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:09:01.435132 5223 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:09:01.436161 5223 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786435717191469-28623-0/minicluster-data/master-0/data/instance:
uuid: "df1959ca788a484e94b84c026e2c094e"
format_stamp: "Formatted at 2026-08-11 08:09:01 on dist-test-slave-7lbf"
server_key: "2b4e94ddec13612b35edafb652fe7bd1"
server_key_iv: "e05dc1c79c0b5fdc5b3552b94315bbff"
server_key_version: "encryptionkey@0"
I20260811 08:09:01.436510 5223 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786435717191469-28623-0/minicluster-data/master-0/wal/instance:
uuid: "df1959ca788a484e94b84c026e2c094e"
format_stamp: "Formatted at 2026-08-11 08:09:01 on dist-test-slave-7lbf"
server_key: "2b4e94ddec13612b35edafb652fe7bd1"
server_key_iv: "e05dc1c79c0b5fdc5b3552b94315bbff"
server_key_version: "encryptionkey@0"
I20260811 08:09:01.437841 5223 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 08:09:01.438575 5245 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:01.438727 5223 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 08:09:01.438812 5223 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786435717191469-28623-0/minicluster-data/master-0/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786435717191469-28623-0/minicluster-data/master-0/wal
uuid: "df1959ca788a484e94b84c026e2c094e"
format_stamp: "Formatted at 2026-08-11 08:09:01 on dist-test-slave-7lbf"
server_key: "2b4e94ddec13612b35edafb652fe7bd1"
server_key_iv: "e05dc1c79c0b5fdc5b3552b94315bbff"
server_key_version: "encryptionkey@0"
I20260811 08:09:01.438874 5223 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786435717191469-28623-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786435717191469-28623-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786435717191469-28623-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:09:01.460261 5223 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:09:01.460556 5223 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:09:01.460680 5223 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:09:01.464464 5223 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.254:38489
I20260811 08:09:01.464512 5336 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.254:38489 every 8 connection(s)
I20260811 08:09:01.464816 5223 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
I20260811 08:09:01.465281 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 5223
I20260811 08:09:01.465373 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786435717191469-28623-0/minicluster-data/master-0/wal/instance
I20260811 08:09:01.465490 5338 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:09:01.465559 28623 external_mini_cluster.cc:1428] Setting key 0164bef7c6394b011fc7859c78d451fb
I20260811 08:09:01.469061 5338 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P df1959ca788a484e94b84c026e2c094e: Bootstrap starting.
I20260811 08:09:01.469703 5338 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P df1959ca788a484e94b84c026e2c094e: Neither blocks nor log segments found. Creating new log.
I20260811 08:09:01.470005 5338 log.cc:824] T 00000000000000000000000000000000 P df1959ca788a484e94b84c026e2c094e: Log is configured to *not* fsync() on all Append() calls
I20260811 08:09:01.470861 5338 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P df1959ca788a484e94b84c026e2c094e: No bootstrap required, opened a new log
I20260811 08:09:01.470916 5343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:01.466078 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45042 (local address 127.27.243.254:38489)
0811 08:09:01.466264 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:01.466271 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:01.466298 (+ 27us) server_negotiation.cc:407] Connection header received
0811 08:09:01.466701 (+ 403us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:01.466706 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:01.466763 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:01.466879 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:01.467107 (+ 228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:01.467952 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:01.469004 (+ 1052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:01.469449 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:01.469575 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:01.470169 (+ 594us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:09:01.470173 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:09:01.470173 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:09:01.470342 (+ 169us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:09:01.470376 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:09:01.470387 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:09:01.470435 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0811 08:09:01.470565 (+ 130us) server_negotiation.cc:299] Negotiation successful
0811 08:09:01.470646 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":108,"thread_start_us":69,"threads_started":1}
I20260811 08:09:01.471786 28623 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 08:09:01.472905 5338 raft_consensus.cc:348] T 00000000000000000000000000000000 P df1959ca788a484e94b84c026e2c094e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "df1959ca788a484e94b84c026e2c094e" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 38489 } }
I20260811 08:09:01.473037 5338 raft_consensus.cc:374] T 00000000000000000000000000000000 P df1959ca788a484e94b84c026e2c094e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:09:01.473057 5338 raft_consensus.cc:729] T 00000000000000000000000000000000 P df1959ca788a484e94b84c026e2c094e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df1959ca788a484e94b84c026e2c094e, State: Initialized, Role: FOLLOWER
I20260811 08:09:01.473172 5338 consensus_queue.cc:260] T 00000000000000000000000000000000 P df1959ca788a484e94b84c026e2c094e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "df1959ca788a484e94b84c026e2c094e" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 38489 } }
I20260811 08:09:01.473237 5338 raft_consensus.cc:388] T 00000000000000000000000000000000 P df1959ca788a484e94b84c026e2c094e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:09:01.473268 5338 raft_consensus.cc:482] T 00000000000000000000000000000000 P df1959ca788a484e94b84c026e2c094e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:09:01.473320 5338 raft_consensus.cc:3037] T 00000000000000000000000000000000 P df1959ca788a484e94b84c026e2c094e [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:09:01.473901 5338 raft_consensus.cc:504] T 00000000000000000000000000000000 P df1959ca788a484e94b84c026e2c094e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "df1959ca788a484e94b84c026e2c094e" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 38489 } }
I20260811 08:09:01.473996 5338 leader_election.cc:302] T 00000000000000000000000000000000 P df1959ca788a484e94b84c026e2c094e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: df1959ca788a484e94b84c026e2c094e; no voters:
I20260811 08:09:01.474149 5338 leader_election.cc:288] T 00000000000000000000000000000000 P df1959ca788a484e94b84c026e2c094e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:09:01.474184 5345 raft_consensus.cc:2781] T 00000000000000000000000000000000 P df1959ca788a484e94b84c026e2c094e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:09:01.474303 5345 raft_consensus.cc:686] T 00000000000000000000000000000000 P df1959ca788a484e94b84c026e2c094e [term 1 LEADER]: Becoming Leader. State: Replica: df1959ca788a484e94b84c026e2c094e, State: Running, Role: LEADER
I20260811 08:09:01.474388 5338 sys_catalog.cc:564] T 00000000000000000000000000000000 P df1959ca788a484e94b84c026e2c094e [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:09:01.474413 5345 consensus_queue.cc:237] T 00000000000000000000000000000000 P df1959ca788a484e94b84c026e2c094e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "df1959ca788a484e94b84c026e2c094e" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 38489 } }
I20260811 08:09:01.474742 5347 sys_catalog.cc:455] T 00000000000000000000000000000000 P df1959ca788a484e94b84c026e2c094e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "df1959ca788a484e94b84c026e2c094e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "df1959ca788a484e94b84c026e2c094e" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 38489 } } }
I20260811 08:09:01.474752 5348 sys_catalog.cc:455] T 00000000000000000000000000000000 P df1959ca788a484e94b84c026e2c094e [sys.catalog]: SysCatalogTable state changed. Reason: New leader df1959ca788a484e94b84c026e2c094e. Latest consensus state: current_term: 1 leader_uuid: "df1959ca788a484e94b84c026e2c094e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "df1959ca788a484e94b84c026e2c094e" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 38489 } } }
I20260811 08:09:01.474857 5347 sys_catalog.cc:458] T 00000000000000000000000000000000 P df1959ca788a484e94b84c026e2c094e [sys.catalog]: This master's current role is: LEADER
I20260811 08:09:01.474865 5348 sys_catalog.cc:458] T 00000000000000000000000000000000 P df1959ca788a484e94b84c026e2c094e [sys.catalog]: This master's current role is: LEADER
I20260811 08:09:01.475466 5358 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:09:01.475916 5358 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:09:01.477242 5358 catalog_manager.cc:1347] Generated new cluster ID: 74ed4820e702484885d19ef87b59ccb3
I20260811 08:09:01.477281 5358 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:09:01.489655 5358 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:09:01.490114 5358 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:09:01.495967 5358 catalog_manager.cc:5868] T 00000000000000000000000000000000 P df1959ca788a484e94b84c026e2c094e: Generated new TSK 0
I20260811 08:09:01.496107 5358 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 08:09:01.505636 5343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:01.502044 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45048 (local address 127.27.243.254:38489)
0811 08:09:01.502089 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:01.502091 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:01.502179 (+ 88us) server_negotiation.cc:407] Connection header received
0811 08:09:01.502230 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:01.502231 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:01.502243 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:01.502327 (+ 84us) server_negotiation.cc:226] Negotiated authn=JWT
0811 08:09:01.502432 (+ 105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:01.503176 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:01.503953 (+ 777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:01.504253 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:01.504328 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:01.504488 (+ 160us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 08:09:01.505407 (+ 919us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44029/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0811 08:09:01.505571 (+ 164us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:45048: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44029/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":25}
W20260811 08:09:01.505690 5343 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:45048: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44029/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260811 08:09:01.507575 5386 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:09:01.501966 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:38489 (local address 127.0.0.1:45048)
0811 08:09:01.502113 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:01.502123 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:01.502180 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:01.502332 (+ 152us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:01.502333 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:01.502334 (+ 1us) client_negotiation.cc:189] Negotiated authn=JWT
0811 08:09:01.502383 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:01.502384 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:01.503259 (+ 875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:01.503260 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:01.503884 (+ 624us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:01.503886 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:01.504351 (+ 465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:01.504352 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:01.504399 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:01.504404 (+ 5us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 08:09:01.505529 (+ 1125us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44029/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0811 08:09:01.507482 (+ 1953us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.27.243.254:38489: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44029/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":123,"mutex_wait_us":1767,"thread_start_us":86,"threads_started":1}
I20260811 08:09:01.507972 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 5223
E20260811 08:09:01.523064 5387 webserver.cc:533] Webserver: sslize failed:
E20260811 08:09:01.523138 5387 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
2026-08-11T08:09:01Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (220 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-11T08:09:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:09:01Z Disabled control of system clock
I20260811 08:09:01.560526 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786435717191469-28623-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786435717191469-28623-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786435717191469-28623-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.243.254:33733
--webserver_interface=127.27.243.254
--webserver_port=0
--builtin_ntp_servers=127.27.243.212:41727
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.243.254:33733
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786435717191469-28623-0/testchainca.cert with env {}
W20260811 08:09:01.640524 5393 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:09:01.640725 5393 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:09:01.640755 5393 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:09:01.641906 5393 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:09:01.641942 5393 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:09:01.641958 5393 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:09:01.641975 5393 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:09:01.641989 5393 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 08:09:01.642005 5393 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 08:09:01.642025 5393 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260811 08:09:01.643466 5393 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:41727
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786435717191469-28623-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786435717191469-28623-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.243.254:33733
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.243.254:33733
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.243.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786435717191469-28623-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5393
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786435717191469-28623-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:09:01.643707 5393 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:09:01.643913 5393 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:09:01.648693 5413 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:09:01.648684 5405 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:09:01.648684 5409 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:09:01.648944 5393 server_base.cc:1034] running on GCE node
I20260811 08:09:01.649189 5393 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:09:01.649468 5393 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:09:01.650637 5393 hybrid_clock.cc:648] HybridClock initialized: now 1786435741650621 us; error 35 us; skew 500 ppm
I20260811 08:09:01.651850 5393 webserver.cc:460] Webserver started at http://127.27.243.254:39123/ using document root <none> and password file <none>
I20260811 08:09:01.652063 5393 fs_manager.cc:359] Metadata directory not provided
I20260811 08:09:01.652112 5393 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:09:01.652235 5393 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:09:01.653311 5393 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786435717191469-28623-0/minicluster-data/master-0/data/instance:
uuid: "2ed971b2ada74fc1acdb34a1e80588d2"
format_stamp: "Formatted at 2026-08-11 08:09:01 on dist-test-slave-7lbf"
server_key: "7cb0feb5c19901322276e4c7e21ba6ed"
server_key_iv: "5baf14feaa1c85774287ad02500ac1e7"
server_key_version: "encryptionkey@0"
I20260811 08:09:01.653671 5393 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786435717191469-28623-0/minicluster-data/master-0/wal/instance:
uuid: "2ed971b2ada74fc1acdb34a1e80588d2"
format_stamp: "Formatted at 2026-08-11 08:09:01 on dist-test-slave-7lbf"
server_key: "7cb0feb5c19901322276e4c7e21ba6ed"
server_key_iv: "5baf14feaa1c85774287ad02500ac1e7"
server_key_version: "encryptionkey@0"
I20260811 08:09:01.655056 5393 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 08:09:01.655808 5422 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:01.655962 5393 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:01.656051 5393 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786435717191469-28623-0/minicluster-data/master-0/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786435717191469-28623-0/minicluster-data/master-0/wal
uuid: "2ed971b2ada74fc1acdb34a1e80588d2"
format_stamp: "Formatted at 2026-08-11 08:09:01 on dist-test-slave-7lbf"
server_key: "7cb0feb5c19901322276e4c7e21ba6ed"
server_key_iv: "5baf14feaa1c85774287ad02500ac1e7"
server_key_version: "encryptionkey@0"
I20260811 08:09:01.656117 5393 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786435717191469-28623-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786435717191469-28623-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786435717191469-28623-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:09:01.669588 5393 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:09:01.669867 5393 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:09:01.669991 5393 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:09:01.674054 5393 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.254:33733
I20260811 08:09:01.674134 5513 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.254:33733 every 8 connection(s)
I20260811 08:09:01.674431 5393 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
I20260811 08:09:01.674706 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 5393
I20260811 08:09:01.674805 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786435717191469-28623-0/minicluster-data/master-0/wal/instance
I20260811 08:09:01.674964 28623 external_mini_cluster.cc:1428] Setting key 569ad49febb32b18085cceedc8318cc7
I20260811 08:09:01.675642 5515 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:09:01.678890 5515 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2ed971b2ada74fc1acdb34a1e80588d2: Bootstrap starting.
I20260811 08:09:01.679628 5515 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2ed971b2ada74fc1acdb34a1e80588d2: Neither blocks nor log segments found. Creating new log.
I20260811 08:09:01.679979 5515 log.cc:824] T 00000000000000000000000000000000 P 2ed971b2ada74fc1acdb34a1e80588d2: Log is configured to *not* fsync() on all Append() calls
I20260811 08:09:01.680734 5515 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2ed971b2ada74fc1acdb34a1e80588d2: No bootstrap required, opened a new log
I20260811 08:09:01.680789 5520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:01.675427 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43724 (local address 127.27.243.254:33733)
0811 08:09:01.675681 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:01.675690 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:01.675727 (+ 37us) server_negotiation.cc:407] Connection header received
0811 08:09:01.676304 (+ 577us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:01.676314 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:01.676399 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:01.676559 (+ 160us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:01.676718 (+ 159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:01.678039 (+ 1321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:01.678808 (+ 769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:01.679412 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:01.679546 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:01.680198 (+ 652us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:09:01.680202 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:09:01.680203 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:09:01.680363 (+ 160us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:09:01.680394 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:09:01.680405 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:09:01.680458 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 08:09:01.680539 (+ 81us) server_negotiation.cc:299] Negotiation successful
0811 08:09:01.680619 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":156,"thread_start_us":104,"threads_started":1}
I20260811 08:09:01.681670 28623 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 08:09:01.682957 5515 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2ed971b2ada74fc1acdb34a1e80588d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ed971b2ada74fc1acdb34a1e80588d2" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 33733 } }
I20260811 08:09:01.683097 5515 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2ed971b2ada74fc1acdb34a1e80588d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:09:01.683122 5515 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2ed971b2ada74fc1acdb34a1e80588d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ed971b2ada74fc1acdb34a1e80588d2, State: Initialized, Role: FOLLOWER
I20260811 08:09:01.683241 5515 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2ed971b2ada74fc1acdb34a1e80588d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ed971b2ada74fc1acdb34a1e80588d2" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 33733 } }
I20260811 08:09:01.683311 5515 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2ed971b2ada74fc1acdb34a1e80588d2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:09:01.683347 5515 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2ed971b2ada74fc1acdb34a1e80588d2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:09:01.683396 5515 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2ed971b2ada74fc1acdb34a1e80588d2 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:09:01.684021 5515 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2ed971b2ada74fc1acdb34a1e80588d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ed971b2ada74fc1acdb34a1e80588d2" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 33733 } }
I20260811 08:09:01.684136 5515 leader_election.cc:302] T 00000000000000000000000000000000 P 2ed971b2ada74fc1acdb34a1e80588d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2ed971b2ada74fc1acdb34a1e80588d2; no voters:
I20260811 08:09:01.684297 5515 leader_election.cc:288] T 00000000000000000000000000000000 P 2ed971b2ada74fc1acdb34a1e80588d2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:09:01.684360 5523 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2ed971b2ada74fc1acdb34a1e80588d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:09:01.684500 5523 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2ed971b2ada74fc1acdb34a1e80588d2 [term 1 LEADER]: Becoming Leader. State: Replica: 2ed971b2ada74fc1acdb34a1e80588d2, State: Running, Role: LEADER
I20260811 08:09:01.684546 5515 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2ed971b2ada74fc1acdb34a1e80588d2 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:09:01.684594 5523 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2ed971b2ada74fc1acdb34a1e80588d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ed971b2ada74fc1acdb34a1e80588d2" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 33733 } }
I20260811 08:09:01.684908 5523 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2ed971b2ada74fc1acdb34a1e80588d2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2ed971b2ada74fc1acdb34a1e80588d2. Latest consensus state: current_term: 1 leader_uuid: "2ed971b2ada74fc1acdb34a1e80588d2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ed971b2ada74fc1acdb34a1e80588d2" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 33733 } } }
I20260811 08:09:01.684991 5523 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2ed971b2ada74fc1acdb34a1e80588d2 [sys.catalog]: This master's current role is: LEADER
I20260811 08:09:01.684933 5529 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2ed971b2ada74fc1acdb34a1e80588d2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2ed971b2ada74fc1acdb34a1e80588d2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ed971b2ada74fc1acdb34a1e80588d2" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 33733 } } }
I20260811 08:09:01.685102 5529 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2ed971b2ada74fc1acdb34a1e80588d2 [sys.catalog]: This master's current role is: LEADER
I20260811 08:09:01.685556 5536 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:09:01.686062 5536 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:09:01.687592 5536 catalog_manager.cc:1347] Generated new cluster ID: b414c28c13b24fc48e66951b223e329b
I20260811 08:09:01.687646 5536 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:09:01.696836 5536 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:09:01.697502 5536 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:09:01.706053 5536 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2ed971b2ada74fc1acdb34a1e80588d2: Generated new TSK 0
I20260811 08:09:01.706226 5536 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 08:09:01.733384 5520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:01.717761 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43728 (local address 127.27.243.254:33733)
0811 08:09:01.717808 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:01.717810 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:01.717917 (+ 107us) server_negotiation.cc:407] Connection header received
0811 08:09:01.717981 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:01.717981 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:01.717992 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:01.718052 (+ 60us) server_negotiation.cc:226] Negotiated authn=JWT
0811 08:09:01.718174 (+ 122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:01.718681 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:01.719799 (+ 1118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:01.720019 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:01.720074 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:01.720251 (+ 177us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 08:09:01.733190 (+ 12939us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0811 08:09:01.733326 (+ 136us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:43728: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":26}
W20260811 08:09:01.733444 5520 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:43728: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260811 08:09:01.733563 5570 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:09:01.717687 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:33733 (local address 127.0.0.1:43728)
0811 08:09:01.717843 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:01.717853 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:01.717920 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:01.718060 (+ 140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:01.718061 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:01.718063 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0811 08:09:01.718121 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:01.718123 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:01.718745 (+ 622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:01.718745 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:01.719705 (+ 960us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:01.719709 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:01.720093 (+ 384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:01.720095 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:01.720155 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:01.720161 (+ 6us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 08:09:01.733309 (+ 13148us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0811 08:09:01.733428 (+ 119us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.27.243.254:33733: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":86,"threads_started":1}
I20260811 08:09:01.733858 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 5393
2026-08-11T08:09:01Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (211 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (101 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (91 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435717191469-28623-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:09:01 dist-test-slave-7lbf krb5kdc[5590](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:09:01 dist-test-slave-7lbf krb5kdc[5590](info): set up 2 sockets
Aug 11 08:09:01 dist-test-slave-7lbf krb5kdc[5590](info): commencing operation
krb5kdc: starting...
W20260811 08:09:03.087616 28623 mini_kdc.cc:121] Time spent starting KDC: real 1.131s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435717191469-28623-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435717191469-28623-0/krb5kdc/test-user.keytab.
Aug 11 08:09:03 dist-test-slave-7lbf krb5kdc[5590](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435743, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:09:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:09:03Z Disabled control of system clock
WARNING: no policy specified for kudu/127.27.243.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.243.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.243.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab.
Entry for principal kudu/127.27.243.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab.
I20260811 08:09:03.209297 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435717191469-28623-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435717191469-28623-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435717191469-28623-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.243.254:35261
--webserver_interface=127.27.243.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab
--principal=kudu/127.27.243.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:44005
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.243.254:35261
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:09:03.294094 5611 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:09:03.294315 5611 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:09:03.294349 5611 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:09:03.295513 5611 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:09:03.295562 5611 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:09:03.295584 5611 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:09:03.295603 5611 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:09:03.295624 5611 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:09:03.297097 5611 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:44005
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435717191469-28623-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435717191469-28623-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.243.254:35261
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab
--principal=kudu/127.27.243.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.243.254:35261
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.243.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5611
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435717191469-28623-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:09:03.297353 5611 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:09:03.297600 5611 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:09:03.302297 5624 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:09:03.302313 5622 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:09:03.302320 5621 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:09:03.302641 5611 server_base.cc:1034] running on GCE node
I20260811 08:09:03.302855 5611 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:09:03.303121 5611 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:09:03.304263 5611 hybrid_clock.cc:648] HybridClock initialized: now 1786435743304246 us; error 35 us; skew 500 ppm
Aug 11 08:09:03 dist-test-slave-7lbf krb5kdc[5590](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435743, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:09:03.310460 5611 init.cc:377] Logged in from keytab as kudu/127.27.243.254@KRBTEST.COM (short username kudu)
I20260811 08:09:03.310910 5611 webserver.cc:460] Webserver started at http://127.27.243.254:40609/ using document root <none> and password file <none>
I20260811 08:09:03.311131 5611 fs_manager.cc:359] Metadata directory not provided
I20260811 08:09:03.311182 5611 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:09:03.311322 5611 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:09:03.312407 5611 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435717191469-28623-0/minicluster-data/master-0/data/instance:
uuid: "82bcad6708174b918c128ead997966e6"
format_stamp: "Formatted at 2026-08-11 08:09:03 on dist-test-slave-7lbf"
server_key: "31956ea76ed9f05044ee87fff20ba034"
server_key_iv: "7447d98a5c49aa250e854bde587e90ee"
server_key_version: "encryptionkey@0"
I20260811 08:09:03.312747 5611 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435717191469-28623-0/minicluster-data/master-0/wal/instance:
uuid: "82bcad6708174b918c128ead997966e6"
format_stamp: "Formatted at 2026-08-11 08:09:03 on dist-test-slave-7lbf"
server_key: "31956ea76ed9f05044ee87fff20ba034"
server_key_iv: "7447d98a5c49aa250e854bde587e90ee"
server_key_version: "encryptionkey@0"
I20260811 08:09:03.314178 5611 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260811 08:09:03.315016 5638 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:03.315238 5611 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:09:03.315325 5611 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435717191469-28623-0/minicluster-data/master-0/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435717191469-28623-0/minicluster-data/master-0/wal
uuid: "82bcad6708174b918c128ead997966e6"
format_stamp: "Formatted at 2026-08-11 08:09:03 on dist-test-slave-7lbf"
server_key: "31956ea76ed9f05044ee87fff20ba034"
server_key_iv: "7447d98a5c49aa250e854bde587e90ee"
server_key_version: "encryptionkey@0"
I20260811 08:09:03.315400 5611 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435717191469-28623-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435717191469-28623-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435717191469-28623-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:09:03.322911 5611 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:09:03.324880 5611 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:09:03.325016 5611 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:09:03.328979 5611 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.254:35261
I20260811 08:09:03.329010 5728 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.254:35261 every 8 connection(s)
I20260811 08:09:03.329344 5611 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
I20260811 08:09:03.330276 5729 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:09:03.332590 5729 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 82bcad6708174b918c128ead997966e6: Bootstrap starting.
I20260811 08:09:03.333140 5729 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 82bcad6708174b918c128ead997966e6: Neither blocks nor log segments found. Creating new log.
I20260811 08:09:03.333410 5729 log.cc:824] T 00000000000000000000000000000000 P 82bcad6708174b918c128ead997966e6: Log is configured to *not* fsync() on all Append() calls
I20260811 08:09:03.334205 5729 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 82bcad6708174b918c128ead997966e6: No bootstrap required, opened a new log
I20260811 08:09:03.334607 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 5611
I20260811 08:09:03.334708 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435717191469-28623-0/minicluster-data/master-0/wal/instance
I20260811 08:09:03.334931 28623 external_mini_cluster.cc:1428] Setting key 1bbf448d44f3da7a6ec4add5d8218a1e
I20260811 08:09:03.336145 5729 raft_consensus.cc:348] T 00000000000000000000000000000000 P 82bcad6708174b918c128ead997966e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82bcad6708174b918c128ead997966e6" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 35261 } }
I20260811 08:09:03.336285 5729 raft_consensus.cc:374] T 00000000000000000000000000000000 P 82bcad6708174b918c128ead997966e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:09:03.336318 5729 raft_consensus.cc:729] T 00000000000000000000000000000000 P 82bcad6708174b918c128ead997966e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82bcad6708174b918c128ead997966e6, State: Initialized, Role: FOLLOWER
I20260811 08:09:03.336467 5729 consensus_queue.cc:260] T 00000000000000000000000000000000 P 82bcad6708174b918c128ead997966e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82bcad6708174b918c128ead997966e6" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 35261 } }
I20260811 08:09:03.336547 5729 raft_consensus.cc:388] T 00000000000000000000000000000000 P 82bcad6708174b918c128ead997966e6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:09:03.336580 5729 raft_consensus.cc:482] T 00000000000000000000000000000000 P 82bcad6708174b918c128ead997966e6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:09:03.336628 5729 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 82bcad6708174b918c128ead997966e6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:09:03.337643 5729 raft_consensus.cc:504] T 00000000000000000000000000000000 P 82bcad6708174b918c128ead997966e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82bcad6708174b918c128ead997966e6" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 35261 } }
I20260811 08:09:03.337743 5729 leader_election.cc:302] T 00000000000000000000000000000000 P 82bcad6708174b918c128ead997966e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 82bcad6708174b918c128ead997966e6; no voters:
I20260811 08:09:03.337915 5729 leader_election.cc:288] T 00000000000000000000000000000000 P 82bcad6708174b918c128ead997966e6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:09:03.337956 5741 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 82bcad6708174b918c128ead997966e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:09:03.338109 5741 raft_consensus.cc:686] T 00000000000000000000000000000000 P 82bcad6708174b918c128ead997966e6 [term 1 LEADER]: Becoming Leader. State: Replica: 82bcad6708174b918c128ead997966e6, State: Running, Role: LEADER
I20260811 08:09:03.338219 5729 sys_catalog.cc:564] T 00000000000000000000000000000000 P 82bcad6708174b918c128ead997966e6 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:09:03.338248 5741 consensus_queue.cc:237] T 00000000000000000000000000000000 P 82bcad6708174b918c128ead997966e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82bcad6708174b918c128ead997966e6" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 35261 } }
I20260811 08:09:03.338698 5741 sys_catalog.cc:455] T 00000000000000000000000000000000 P 82bcad6708174b918c128ead997966e6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 82bcad6708174b918c128ead997966e6. Latest consensus state: current_term: 1 leader_uuid: "82bcad6708174b918c128ead997966e6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82bcad6708174b918c128ead997966e6" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 35261 } } }
I20260811 08:09:03.338742 5743 sys_catalog.cc:455] T 00000000000000000000000000000000 P 82bcad6708174b918c128ead997966e6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "82bcad6708174b918c128ead997966e6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82bcad6708174b918c128ead997966e6" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 35261 } } }
I20260811 08:09:03.338847 5743 sys_catalog.cc:458] T 00000000000000000000000000000000 P 82bcad6708174b918c128ead997966e6 [sys.catalog]: This master's current role is: LEADER
I20260811 08:09:03.339036 5741 sys_catalog.cc:458] T 00000000000000000000000000000000 P 82bcad6708174b918c128ead997966e6 [sys.catalog]: This master's current role is: LEADER
I20260811 08:09:03.339203 5755 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:09:03.339798 5755 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:09:03.341390 5755 catalog_manager.cc:1347] Generated new cluster ID: fc9b4c21f13e4863876e4edcf029d36a
I20260811 08:09:03.341434 5755 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 08:09:03 dist-test-slave-7lbf krb5kdc[5590](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435743, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.243.254@KRBTEST.COM
I20260811 08:09:03.346143 5739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:03.335479 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55910 (local address 127.27.243.254:35261)
0811 08:09:03.335646 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:03.335654 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:03.335681 (+ 27us) server_negotiation.cc:407] Connection header received
0811 08:09:03.336144 (+ 463us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:03.336153 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:03.336210 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:03.336365 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:03.337083 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:03.338171 (+ 1088us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:03.339196 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:03.339784 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:03.340285 (+ 501us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:03.342675 (+ 2390us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:09:03.342679 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:09:03.342679 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:09:03.342691 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:09:03.344525 (+ 1834us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:03.344927 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:03.344930 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:03.344931 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:03.345042 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:03.345230 (+ 188us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:03.345231 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:03.345231 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:03.345509 (+ 278us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:09:03.345676 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0811 08:09:03.345802 (+ 126us) server_negotiation.cc:299] Negotiation successful
0811 08:09:03.345944 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":118,"thread_start_us":77,"threads_started":1}
I20260811 08:09:03.358762 5755 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:09:03.359371 5755 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:09:03.370564 5755 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 82bcad6708174b918c128ead997966e6: Generated new TSK 0
I20260811 08:09:03.370760 5755 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.27.243.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.243.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.243.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.193.keytab.
Entry for principal kudu/127.27.243.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.193.keytab.
I20260811 08:09:03.401927 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435717191469-28623-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435717191469-28623-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435717191469-28623-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435717191469-28623-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.243.193:0
--local_ip_for_outbound_sockets=127.27.243.193
--webserver_interface=127.27.243.193
--webserver_port=0
--tserver_master_addrs=127.27.243.254:35261
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.193.keytab
--principal=kudu/127.27.243.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:44005
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:09:03.483728 5782 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:09:03.483927 5782 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:09:03.483948 5782 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:09:03.485020 5782 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:09:03.485052 5782 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:09:03.485076 5782 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.243.193
I20260811 08:09:03.486557 5782 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:44005
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435717191469-28623-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435717191469-28623-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.193.keytab
--principal=kudu/127.27.243.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.243.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435717191469-28623-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.243.193
--webserver_port=0
--tserver_master_addrs=127.27.243.254:35261
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5782
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.243.193
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435717191469-28623-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:09:03.486743 5782 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:09:03.486917 5782 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:09:03.491712 5792 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:09:03.491761 5782 server_base.cc:1034] running on GCE node
W20260811 08:09:03.491719 5790 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:09:03.491719 5794 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:09:03.492136 5782 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:09:03.492340 5782 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:09:03.493498 5782 hybrid_clock.cc:648] HybridClock initialized: now 1786435743493480 us; error 34 us; skew 500 ppm
Aug 11 08:09:03 dist-test-slave-7lbf krb5kdc[5590](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435743, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:09:03.496043 5782 init.cc:377] Logged in from keytab as kudu/127.27.243.193@KRBTEST.COM (short username kudu)
I20260811 08:09:03.496469 5782 webserver.cc:460] Webserver started at http://127.27.243.193:38613/ using document root <none> and password file <none>
I20260811 08:09:03.496682 5782 fs_manager.cc:359] Metadata directory not provided
I20260811 08:09:03.496726 5782 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:09:03.496850 5782 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:09:03.497895 5782 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435717191469-28623-0/minicluster-data/ts-0/data/instance:
uuid: "63e2c7e270274480a19ffbb7eb0604fe"
format_stamp: "Formatted at 2026-08-11 08:09:03 on dist-test-slave-7lbf"
server_key: "10b9dec60128cffc4e451da5ffad0d4c"
server_key_iv: "1d53a2eac875b5e9e84ed7f9f46e0848"
server_key_version: "encryptionkey@0"
I20260811 08:09:03.498208 5782 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435717191469-28623-0/minicluster-data/ts-0/wal/instance:
uuid: "63e2c7e270274480a19ffbb7eb0604fe"
format_stamp: "Formatted at 2026-08-11 08:09:03 on dist-test-slave-7lbf"
server_key: "10b9dec60128cffc4e451da5ffad0d4c"
server_key_iv: "1d53a2eac875b5e9e84ed7f9f46e0848"
server_key_version: "encryptionkey@0"
I20260811 08:09:03.499433 5782 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:09:03.500078 5803 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:03.500241 5782 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:03.500334 5782 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435717191469-28623-0/minicluster-data/ts-0/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435717191469-28623-0/minicluster-data/ts-0/wal
uuid: "63e2c7e270274480a19ffbb7eb0604fe"
format_stamp: "Formatted at 2026-08-11 08:09:03 on dist-test-slave-7lbf"
server_key: "10b9dec60128cffc4e451da5ffad0d4c"
server_key_iv: "1d53a2eac875b5e9e84ed7f9f46e0848"
server_key_version: "encryptionkey@0"
I20260811 08:09:03.500391 5782 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435717191469-28623-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435717191469-28623-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435717191469-28623-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:09:03.519729 5782 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:09:03.521643 5782 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:09:03.521770 5782 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:09:03.521971 5782 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:09:03.522253 5782 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:09:03.522303 5782 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:03.522328 5782 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:09:03.522342 5782 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:03.528328 5782 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.193:38167
I20260811 08:09:03.528403 5990 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.193:38167 every 8 connection(s)
I20260811 08:09:03.528694 5782 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435717191469-28623-0/minicluster-data/ts-0/data/info.pb
Aug 11 08:09:03 dist-test-slave-7lbf krb5kdc[5590](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435743, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.193@KRBTEST.COM for kudu/127.27.243.254@KRBTEST.COM
I20260811 08:09:03.537266 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 5782
I20260811 08:09:03.537391 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435717191469-28623-0/minicluster-data/ts-0/wal/instance
I20260811 08:09:03.537626 28623 external_mini_cluster.cc:1428] Setting key 3a93f4ec2b02e5d6646f378fd5872766
I20260811 08:09:03.537861 5739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:03.529444 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.193:42213 (local address 127.27.243.254:35261)
0811 08:09:03.529547 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:03.529549 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:03.529701 (+ 152us) server_negotiation.cc:407] Connection header received
0811 08:09:03.530650 (+ 949us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:03.530652 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:03.530664 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:03.530720 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:03.531345 (+ 625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:03.531861 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:03.532813 (+ 952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:03.533026 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:03.533081 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:03.535298 (+ 2217us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:09:03.535300 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:09:03.535300 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:09:03.535309 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:09:03.536477 (+ 1168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:03.536855 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:03.536856 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:03.536857 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:03.536914 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:03.537117 (+ 203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:03.537118 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:03.537118 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:03.537214 (+ 96us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:09:03.537258 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0811 08:09:03.537625 (+ 367us) server_negotiation.cc:299] Negotiation successful
0811 08:09:03.537714 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260811 08:09:03.537987 5995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:03.529403 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:35261 (local address 127.27.243.193:42213)
0811 08:09:03.529580 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:03.529623 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:03.530524 (+ 901us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:03.530778 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:03.530782 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:03.531074 (+ 292us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:09:03.531264 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:03.531274 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:03.531932 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:03.531933 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:03.532732 (+ 799us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:03.532734 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:03.533090 (+ 356us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:03.533091 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:03.533193 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:03.533716 (+ 523us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:09:03.533724 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:09:03.535205 (+ 1481us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:09:03.536546 (+ 1341us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:09:03.536553 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:09:03.536555 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:09:03.536762 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:09:03.536966 (+ 204us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:09:03.536966 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:09:03.536967 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:09:03.537066 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:09:03.537265 (+ 199us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:09:03.537271 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:09:03.537466 (+ 195us) client_negotiation.cc:769] Sending connection context
0811 08:09:03.537607 (+ 141us) client_negotiation.cc:240] Negotiation successful
0811 08:09:03.537778 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":80,"threads_started":1}
I20260811 08:09:03.538523 5992 heartbeater.cc:347] Connected to a master server at 127.27.243.254:35261
I20260811 08:09:03.538630 5992 heartbeater.cc:464] Registering TS with master...
I20260811 08:09:03.538815 5992 heartbeater.cc:511] Master 127.27.243.254:35261 requested a full tablet report, sending...
I20260811 08:09:03.539327 5669 ts_manager.cc:194] Registered new tserver with Master: 63e2c7e270274480a19ffbb7eb0604fe (127.27.243.193:38167)
I20260811 08:09:03.539922 5669 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.243.193@KRBTEST.COM'} at 127.27.243.193:42213
WARNING: no policy specified for kudu/127.27.243.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.243.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.243.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.194.keytab.
Entry for principal kudu/127.27.243.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.194.keytab.
I20260811 08:09:03.562124 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435717191469-28623-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435717191469-28623-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435717191469-28623-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435717191469-28623-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.243.194:0
--local_ip_for_outbound_sockets=127.27.243.194
--webserver_interface=127.27.243.194
--webserver_port=0
--tserver_master_addrs=127.27.243.254:35261
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.194.keytab
--principal=kudu/127.27.243.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:44005
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:09:03.644107 6001 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:09:03.644320 6001 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:09:03.644354 6001 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:09:03.645727 6001 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:09:03.645783 6001 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:09:03.645831 6001 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.243.194
I20260811 08:09:03.647533 6001 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:44005
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435717191469-28623-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435717191469-28623-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.194.keytab
--principal=kudu/127.27.243.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.243.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435717191469-28623-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.243.194
--webserver_port=0
--tserver_master_addrs=127.27.243.254:35261
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6001
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.243.194
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435717191469-28623-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:09:03.647789 6001 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:09:03.648013 6001 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:09:03.653203 6008 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:09:03.653213 6011 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:09:03.653229 6007 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:09:03.653370 6001 server_base.cc:1034] running on GCE node
I20260811 08:09:03.653676 6001 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:09:03.653892 6001 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:09:03.655032 6001 hybrid_clock.cc:648] HybridClock initialized: now 1786435743655019 us; error 29 us; skew 500 ppm
Aug 11 08:09:03 dist-test-slave-7lbf krb5kdc[5590](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435743, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:09:03.657724 6001 init.cc:377] Logged in from keytab as kudu/127.27.243.194@KRBTEST.COM (short username kudu)
I20260811 08:09:03.658190 6001 webserver.cc:460] Webserver started at http://127.27.243.194:44611/ using document root <none> and password file <none>
I20260811 08:09:03.658433 6001 fs_manager.cc:359] Metadata directory not provided
I20260811 08:09:03.658483 6001 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:09:03.658622 6001 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:09:03.659723 6001 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435717191469-28623-0/minicluster-data/ts-1/data/instance:
uuid: "582462049eed424e83db4a0b328343f3"
format_stamp: "Formatted at 2026-08-11 08:09:03 on dist-test-slave-7lbf"
server_key: "caa04c2f87ce28e348fa4c90dae43b73"
server_key_iv: "d3448c602abe45f1d345c918f7e386e0"
server_key_version: "encryptionkey@0"
I20260811 08:09:03.660118 6001 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435717191469-28623-0/minicluster-data/ts-1/wal/instance:
uuid: "582462049eed424e83db4a0b328343f3"
format_stamp: "Formatted at 2026-08-11 08:09:03 on dist-test-slave-7lbf"
server_key: "caa04c2f87ce28e348fa4c90dae43b73"
server_key_iv: "d3448c602abe45f1d345c918f7e386e0"
server_key_version: "encryptionkey@0"
I20260811 08:09:03.661489 6001 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 08:09:03.662307 6023 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:03.662482 6001 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 08:09:03.662575 6001 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435717191469-28623-0/minicluster-data/ts-1/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435717191469-28623-0/minicluster-data/ts-1/wal
uuid: "582462049eed424e83db4a0b328343f3"
format_stamp: "Formatted at 2026-08-11 08:09:03 on dist-test-slave-7lbf"
server_key: "caa04c2f87ce28e348fa4c90dae43b73"
server_key_iv: "d3448c602abe45f1d345c918f7e386e0"
server_key_version: "encryptionkey@0"
I20260811 08:09:03.662642 6001 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435717191469-28623-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435717191469-28623-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435717191469-28623-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:09:03.681870 6001 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:09:03.683864 6001 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:09:03.683998 6001 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:09:03.684185 6001 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:09:03.684492 6001 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:09:03.684530 6001 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:03.684558 6001 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:09:03.684576 6001 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:03.690434 6001 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.194:44613
I20260811 08:09:03.690521 6215 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.194:44613 every 8 connection(s)
I20260811 08:09:03.690841 6001 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435717191469-28623-0/minicluster-data/ts-1/data/info.pb
Aug 11 08:09:03 dist-test-slave-7lbf krb5kdc[5590](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435743, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.194@KRBTEST.COM for kudu/127.27.243.254@KRBTEST.COM
I20260811 08:09:03.697676 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 6001
I20260811 08:09:03.697762 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435717191469-28623-0/minicluster-data/ts-1/wal/instance
I20260811 08:09:03.697969 28623 external_mini_cluster.cc:1428] Setting key e08a6605ade402c962d066baf0ce1159
I20260811 08:09:03.699959 5739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:03.691549 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.194:50507 (local address 127.27.243.254:35261)
0811 08:09:03.691594 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:03.691596 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:03.691788 (+ 192us) server_negotiation.cc:407] Connection header received
0811 08:09:03.692709 (+ 921us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:03.692710 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:03.692721 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:03.692769 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:03.693357 (+ 588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:03.693932 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:03.694927 (+ 995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:03.695120 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:03.695175 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:03.697127 (+ 1952us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:09:03.697128 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:09:03.697128 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:09:03.697135 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:09:03.698554 (+ 1419us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:03.699041 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:03.699042 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:03.699042 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:03.699106 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:03.699376 (+ 270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:03.699376 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:03.699376 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:03.699478 (+ 102us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:09:03.699522 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0811 08:09:03.699826 (+ 304us) server_negotiation.cc:299] Negotiation successful
0811 08:09:03.699896 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 08:09:03.700181 6219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:03.691518 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:35261 (local address 127.27.243.194:50507)
0811 08:09:03.691671 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:03.691709 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:03.692619 (+ 910us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:03.692833 (+ 214us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:03.692836 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:03.693091 (+ 255us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:09:03.693285 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:03.693290 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:03.693999 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:03.693999 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:03.694845 (+ 846us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:03.694848 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:03.695182 (+ 334us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:03.695183 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:03.695282 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:03.695707 (+ 425us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:09:03.695715 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:09:03.697044 (+ 1329us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:09:03.698639 (+ 1595us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:09:03.698647 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:09:03.698649 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:09:03.698955 (+ 306us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:09:03.699167 (+ 212us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:09:03.699168 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:09:03.699168 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:09:03.699313 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:09:03.699528 (+ 215us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:09:03.699533 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:09:03.699689 (+ 156us) client_negotiation.cc:769] Sending connection context
0811 08:09:03.699796 (+ 107us) client_negotiation.cc:240] Negotiation successful
0811 08:09:03.699961 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":87,"threads_started":1}
I20260811 08:09:03.700654 6216 heartbeater.cc:347] Connected to a master server at 127.27.243.254:35261
I20260811 08:09:03.700753 6216 heartbeater.cc:464] Registering TS with master...
I20260811 08:09:03.700927 6216 heartbeater.cc:511] Master 127.27.243.254:35261 requested a full tablet report, sending...
I20260811 08:09:03.701294 5669 ts_manager.cc:194] Registered new tserver with Master: 582462049eed424e83db4a0b328343f3 (127.27.243.194:44613)
I20260811 08:09:03.701691 5669 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.243.194@KRBTEST.COM'} at 127.27.243.194:50507
WARNING: no policy specified for kudu/127.27.243.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.243.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.243.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.195.keytab.
Entry for principal kudu/127.27.243.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.195.keytab.
I20260811 08:09:03.722091 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435717191469-28623-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435717191469-28623-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435717191469-28623-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435717191469-28623-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.243.195:0
--local_ip_for_outbound_sockets=127.27.243.195
--webserver_interface=127.27.243.195
--webserver_port=0
--tserver_master_addrs=127.27.243.254:35261
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.195.keytab
--principal=kudu/127.27.243.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:44005
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:09:03.805737 6226 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:09:03.805956 6226 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:09:03.805989 6226 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:09:03.807124 6226 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:09:03.807164 6226 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:09:03.807197 6226 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.243.195
I20260811 08:09:03.808645 6226 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:44005
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435717191469-28623-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435717191469-28623-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.195.keytab
--principal=kudu/127.27.243.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.243.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435717191469-28623-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.243.195
--webserver_port=0
--tserver_master_addrs=127.27.243.254:35261
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6226
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.243.195
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435717191469-28623-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:09:03.808871 6226 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:09:03.809085 6226 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:09:03.813804 6241 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:09:03.813804 6234 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:09:03.813838 6235 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:09:03.814132 6226 server_base.cc:1034] running on GCE node
I20260811 08:09:03.814360 6226 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:09:03.814574 6226 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:09:03.815711 6226 hybrid_clock.cc:648] HybridClock initialized: now 1786435743815694 us; error 32 us; skew 500 ppm
Aug 11 08:09:03 dist-test-slave-7lbf krb5kdc[5590](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435743, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:09:03.818249 6226 init.cc:377] Logged in from keytab as kudu/127.27.243.195@KRBTEST.COM (short username kudu)
I20260811 08:09:03.818630 6226 webserver.cc:460] Webserver started at http://127.27.243.195:33891/ using document root <none> and password file <none>
I20260811 08:09:03.818801 6226 fs_manager.cc:359] Metadata directory not provided
I20260811 08:09:03.818856 6226 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:09:03.818951 6226 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:09:03.819962 6226 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435717191469-28623-0/minicluster-data/ts-2/data/instance:
uuid: "66a94fccafe94ff58b7adf997fe601fb"
format_stamp: "Formatted at 2026-08-11 08:09:03 on dist-test-slave-7lbf"
server_key: "44f958084b1617e58689db15ec7b917e"
server_key_iv: "388000fd636293b5d292fde3ea616b55"
server_key_version: "encryptionkey@0"
I20260811 08:09:03.820255 6226 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435717191469-28623-0/minicluster-data/ts-2/wal/instance:
uuid: "66a94fccafe94ff58b7adf997fe601fb"
format_stamp: "Formatted at 2026-08-11 08:09:03 on dist-test-slave-7lbf"
server_key: "44f958084b1617e58689db15ec7b917e"
server_key_iv: "388000fd636293b5d292fde3ea616b55"
server_key_version: "encryptionkey@0"
I20260811 08:09:03.821429 6226 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 08:09:03.822214 6252 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:03.822409 6226 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 08:09:03.822499 6226 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435717191469-28623-0/minicluster-data/ts-2/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435717191469-28623-0/minicluster-data/ts-2/wal
uuid: "66a94fccafe94ff58b7adf997fe601fb"
format_stamp: "Formatted at 2026-08-11 08:09:03 on dist-test-slave-7lbf"
server_key: "44f958084b1617e58689db15ec7b917e"
server_key_iv: "388000fd636293b5d292fde3ea616b55"
server_key_version: "encryptionkey@0"
I20260811 08:09:03.822554 6226 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435717191469-28623-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435717191469-28623-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435717191469-28623-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:09:03.834388 6226 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:09:03.836450 6226 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:09:03.836561 6226 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:09:03.836750 6226 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:09:03.837050 6226 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:09:03.837085 6226 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:03.837105 6226 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:09:03.837116 6226 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:03.843144 6226 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.195:34975
I20260811 08:09:03.843206 6448 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.195:34975 every 8 connection(s)
I20260811 08:09:03.843494 6226 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435717191469-28623-0/minicluster-data/ts-2/data/info.pb
I20260811 08:09:03.847111 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 6226
I20260811 08:09:03.847183 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435717191469-28623-0/minicluster-data/ts-2/wal/instance
I20260811 08:09:03.847321 28623 external_mini_cluster.cc:1428] Setting key 6ed37222613c3dcfaca3f13fc651bb54
Aug 11 08:09:03 dist-test-slave-7lbf krb5kdc[5590](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435743, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.195@KRBTEST.COM for kudu/127.27.243.254@KRBTEST.COM
I20260811 08:09:03.852577 5739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:03.844202 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.195:51993 (local address 127.27.243.254:35261)
0811 08:09:03.844259 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:03.844260 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:03.844463 (+ 203us) server_negotiation.cc:407] Connection header received
0811 08:09:03.845422 (+ 959us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:03.845423 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:03.845434 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:03.845486 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:03.846130 (+ 644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:03.846712 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:03.848040 (+ 1328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:03.848300 (+ 260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:03.848356 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:03.850375 (+ 2019us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:09:03.850376 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:09:03.850377 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:09:03.850384 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:09:03.851484 (+ 1100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:03.851852 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:03.851852 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:03.851853 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:03.851906 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:03.852117 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:03.852117 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:03.852117 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:03.852209 (+ 92us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:09:03.852253 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0811 08:09:03.852458 (+ 205us) server_negotiation.cc:299] Negotiation successful
0811 08:09:03.852516 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 08:09:03.852762 6455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:03.844184 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:35261 (local address 127.27.243.195:51993)
0811 08:09:03.844342 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:03.844378 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:03.845328 (+ 950us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:03.845570 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:03.845574 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:03.845841 (+ 267us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:09:03.846031 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:03.846035 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:03.846811 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:03.846812 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:03.847971 (+ 1159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:03.847974 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:03.848372 (+ 398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:03.848373 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:03.848477 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:03.848938 (+ 461us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:09:03.848946 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:09:03.850286 (+ 1340us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:09:03.851552 (+ 1266us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:09:03.851559 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:09:03.851561 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:09:03.851770 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:09:03.851963 (+ 193us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:09:03.851964 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:09:03.851964 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:09:03.852069 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:09:03.852250 (+ 181us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:09:03.852253 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:09:03.852364 (+ 111us) client_negotiation.cc:769] Sending connection context
0811 08:09:03.852441 (+ 77us) client_negotiation.cc:240] Negotiation successful
0811 08:09:03.852557 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":84,"threads_started":1}
I20260811 08:09:03.853212 6450 heartbeater.cc:347] Connected to a master server at 127.27.243.254:35261
I20260811 08:09:03.853302 6450 heartbeater.cc:464] Registering TS with master...
I20260811 08:09:03.853459 6450 heartbeater.cc:511] Master 127.27.243.254:35261 requested a full tablet report, sending...
I20260811 08:09:03.853878 5669 ts_manager.cc:194] Registered new tserver with Master: 66a94fccafe94ff58b7adf997fe601fb (127.27.243.195:34975)
I20260811 08:09:03.854254 5669 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.243.195@KRBTEST.COM'} at 127.27.243.195:51993
I20260811 08:09:03.858768 28623 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435717191469-28623-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435717191469-28623-0/krb5kdc/test-admin.keytab.
Aug 11 08:09:03 dist-test-slave-7lbf krb5kdc[5590](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435743, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:09:03.874145 28623 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260811 08:09:03.875748 6461 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:09:03.875023 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55036 (local address 127.27.243.193:38167)
0811 08:09:03.875186 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:03.875190 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:03.875201 (+ 11us) server_negotiation.cc:407] Connection header received
0811 08:09:03.875230 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:03.875231 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:03.875245 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:03.875321 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:03.875664 (+ 343us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55036: BlockingRecv error: recv got EOF from 127.0.0.1:55036 (error 108)
Metrics: {"server-negotiator.queue_time_us":128,"thread_start_us":78,"threads_started":1}
W20260811 08:09:03.875880 28623 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435717191469-28623-0/krb5kdc/krb5cc' of type FILE
Aug 11 08:09:03 dist-test-slave-7lbf krb5kdc[5590](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435743, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:09:03.876866 28623 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 11 08:09:03 dist-test-slave-7lbf krb5kdc[5590](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435743, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:09:03.877730 28623 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 11 08:09:03 dist-test-slave-7lbf krb5kdc[5590](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435743, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.243.193@KRBTEST.COM
I20260811 08:09:03.885490 6461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:03.878246 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55040 (local address 127.27.243.193:38167)
0811 08:09:03.878337 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:03.878339 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:03.878347 (+ 8us) server_negotiation.cc:407] Connection header received
0811 08:09:03.878370 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:03.878371 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:03.878382 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:03.878430 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:03.878784 (+ 354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:03.879530 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:03.880291 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:03.880646 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:03.880711 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:03.882968 (+ 2257us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:09:03.882977 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:09:03.882977 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:09:03.882984 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:09:03.884488 (+ 1504us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:03.884810 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:03.884813 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:03.884813 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:03.884865 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:03.885037 (+ 172us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:03.885037 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:03.885037 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:03.885166 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:09:03.885267 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0811 08:09:03.885319 (+ 52us) server_negotiation.cc:299] Negotiation successful
0811 08:09:03.885382 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
W20260811 08:09:03.887355 6461 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:09:03.886797 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55056 (local address 127.27.243.193:38167)
0811 08:09:03.886833 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:03.886835 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:03.886871 (+ 36us) server_negotiation.cc:407] Connection header received
0811 08:09:03.886918 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:03.886919 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:03.886928 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:03.886969 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:03.887320 (+ 351us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55056: BlockingRecv error: recv got EOF from 127.0.0.1:55056 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260811 08:09:03.887449 28623 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435717191469-28623-0/krb5kdc/krb5cc' of type FILE
Aug 11 08:09:03 dist-test-slave-7lbf krb5kdc[5590](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435743, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:09:03.888386 28623 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 11 08:09:03 dist-test-slave-7lbf krb5kdc[5590](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435743, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:09:03.889173 28623 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 11 08:09:03 dist-test-slave-7lbf krb5kdc[5590](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435743, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.243.193@KRBTEST.COM
I20260811 08:09:03.895908 6461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:03.889711 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55072 (local address 127.27.243.193:38167)
0811 08:09:03.889760 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:03.889762 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:03.889805 (+ 43us) server_negotiation.cc:407] Connection header received
0811 08:09:03.889912 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:03.889913 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:03.889923 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:03.889966 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:03.890289 (+ 323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:03.890771 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:03.891455 (+ 684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:03.891645 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:03.891690 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:03.893642 (+ 1952us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:09:03.893643 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:09:03.893644 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:09:03.893651 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:09:03.894895 (+ 1244us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:03.895199 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:03.895201 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:03.895201 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:03.895250 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:03.895441 (+ 191us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:03.895442 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:03.895442 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:03.895536 (+ 94us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:09:03.895620 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0811 08:09:03.895722 (+ 102us) server_negotiation.cc:299] Negotiation successful
0811 08:09:03.895805 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
W20260811 08:09:03.897468 6461 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:09:03.896941 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55080 (local address 127.27.243.193:38167)
0811 08:09:03.896994 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:03.896996 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:03.897061 (+ 65us) server_negotiation.cc:407] Connection header received
0811 08:09:03.897110 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:03.897111 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:03.897120 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:03.897164 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:03.897422 (+ 258us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55080: BlockingRecv error: recv got EOF from 127.0.0.1:55080 (error 108)
Metrics: {"server-negotiator.queue_time_us":31}
W20260811 08:09:03.897542 28623 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435717191469-28623-0/krb5kdc/krb5cc' of type FILE
Aug 11 08:09:03 dist-test-slave-7lbf krb5kdc[5590](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435743, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:09:03.898486 28623 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 11 08:09:03 dist-test-slave-7lbf krb5kdc[5590](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435743, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:09:03.899338 28623 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 11 08:09:03 dist-test-slave-7lbf krb5kdc[5590](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435743, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.243.193@KRBTEST.COM
I20260811 08:09:03.905850 6461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:03.899836 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55084 (local address 127.27.243.193:38167)
0811 08:09:03.899975 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:03.899976 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:03.899984 (+ 8us) server_negotiation.cc:407] Connection header received
0811 08:09:03.900002 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:03.900003 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:03.900010 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:03.900064 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:03.900410 (+ 346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:03.900925 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:03.901640 (+ 715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:03.901827 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:03.901910 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:03.903761 (+ 1851us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:09:03.903762 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:09:03.903762 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:09:03.903768 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:09:03.904983 (+ 1215us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:03.905272 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:03.905273 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:03.905273 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:03.905326 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:03.905464 (+ 138us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:03.905464 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:03.905464 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:03.905586 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:09:03.905650 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0811 08:09:03.905730 (+ 80us) server_negotiation.cc:299] Negotiation successful
0811 08:09:03.905786 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":116}
I20260811 08:09:03.906387 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 5782
I20260811 08:09:03.923722 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 6001
I20260811 08:09:03.944199 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 6226
I20260811 08:09:03.959395 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 5611
2026-08-11T08:09:03Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (2029 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:09:04 dist-test-slave-7lbf krb5kdc[6486](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:09:04 dist-test-slave-7lbf krb5kdc[6486](info): set up 2 sockets
Aug 11 08:09:04 dist-test-slave-7lbf krb5kdc[6486](info): commencing operation
krb5kdc: starting...
W20260811 08:09:05.140523 28623 mini_kdc.cc:121] Time spent starting KDC: real 1.154s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/krb5kdc/test-user.keytab.
Aug 11 08:09:05 dist-test-slave-7lbf krb5kdc[6486](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435745, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:09:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:09:05Z Disabled control of system clock
WARNING: no policy specified for oryx/127.27.243.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.27.243.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.27.243.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/krb5kdc/oryx_127.27.243.254.keytab.
Entry for principal oryx/127.27.243.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/krb5kdc/oryx_127.27.243.254.keytab.
I20260811 08:09:05.256263 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.243.254:43189
--webserver_interface=127.27.243.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/krb5kdc/oryx_127.27.243.254.keytab
--principal=oryx/127.27.243.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:37793
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.243.254:43189
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:09:05.337561 6512 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:09:05.337766 6512 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:09:05.337787 6512 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:09:05.338925 6512 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:09:05.338966 6512 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:09:05.338979 6512 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:09:05.338990 6512 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:09:05.339001 6512 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:09:05.340451 6512 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:37793
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.243.254:43189
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/krb5kdc/oryx_127.27.243.254.keytab
--principal=oryx/127.27.243.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.243.254:43189
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.243.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6512
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:09:05.340677 6512 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:09:05.340917 6512 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 08:09:05.345635 6512 server_base.cc:1034] running on GCE node
W20260811 08:09:05.345626 6528 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:09:05.345628 6522 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:09:05.345875 6523 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:09:05.346131 6512 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:09:05.346408 6512 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:09:05.347590 6512 hybrid_clock.cc:648] HybridClock initialized: now 1786435745347571 us; error 34 us; skew 500 ppm
Aug 11 08:09:05 dist-test-slave-7lbf krb5kdc[6486](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435745, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.243.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:09:05.350109 6512 init.cc:377] Logged in from keytab as oryx/127.27.243.254@KRBTEST.COM (short username oryx)
I20260811 08:09:05.350502 6512 webserver.cc:460] Webserver started at http://127.27.243.254:38671/ using document root <none> and password file <none>
I20260811 08:09:05.350729 6512 fs_manager.cc:359] Metadata directory not provided
I20260811 08:09:05.350781 6512 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:09:05.350914 6512 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:09:05.351928 6512 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/master-0/data/instance:
uuid: "1e9672280b3347719b31d040efc4c7ee"
format_stamp: "Formatted at 2026-08-11 08:09:05 on dist-test-slave-7lbf"
server_key: "5899e99c9f4d23d20448cb7b2eec4351"
server_key_iv: "1613b64c1ad4722ac601264ceb0ddce8"
server_key_version: "encryptionkey@0"
I20260811 08:09:05.352257 6512 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/master-0/wal/instance:
uuid: "1e9672280b3347719b31d040efc4c7ee"
format_stamp: "Formatted at 2026-08-11 08:09:05 on dist-test-slave-7lbf"
server_key: "5899e99c9f4d23d20448cb7b2eec4351"
server_key_iv: "1613b64c1ad4722ac601264ceb0ddce8"
server_key_version: "encryptionkey@0"
I20260811 08:09:05.353470 6512 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 08:09:05.354225 6538 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:05.354394 6512 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 08:09:05.354480 6512 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/master-0/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/master-0/wal
uuid: "1e9672280b3347719b31d040efc4c7ee"
format_stamp: "Formatted at 2026-08-11 08:09:05 on dist-test-slave-7lbf"
server_key: "5899e99c9f4d23d20448cb7b2eec4351"
server_key_iv: "1613b64c1ad4722ac601264ceb0ddce8"
server_key_version: "encryptionkey@0"
I20260811 08:09:05.354539 6512 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:09:05.380724 6512 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:09:05.382928 6512 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:09:05.383071 6512 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:09:05.386955 6512 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.254:43189
I20260811 08:09:05.386994 6621 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.254:43189 every 8 connection(s)
I20260811 08:09:05.387320 6512 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
I20260811 08:09:05.388320 6622 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:09:05.390681 6622 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1e9672280b3347719b31d040efc4c7ee: Bootstrap starting.
I20260811 08:09:05.391250 6622 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1e9672280b3347719b31d040efc4c7ee: Neither blocks nor log segments found. Creating new log.
I20260811 08:09:05.391314 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 6512
I20260811 08:09:05.391433 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/master-0/wal/instance
I20260811 08:09:05.391544 6622 log.cc:824] T 00000000000000000000000000000000 P 1e9672280b3347719b31d040efc4c7ee: Log is configured to *not* fsync() on all Append() calls
I20260811 08:09:05.391614 28623 external_mini_cluster.cc:1428] Setting key 72b3c3b6b56709f82e62e15104c6697b
I20260811 08:09:05.392369 6622 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1e9672280b3347719b31d040efc4c7ee: No bootstrap required, opened a new log
I20260811 08:09:05.394655 6622 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1e9672280b3347719b31d040efc4c7ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e9672280b3347719b31d040efc4c7ee" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 43189 } }
I20260811 08:09:05.394833 6622 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1e9672280b3347719b31d040efc4c7ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:09:05.394873 6622 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1e9672280b3347719b31d040efc4c7ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e9672280b3347719b31d040efc4c7ee, State: Initialized, Role: FOLLOWER
I20260811 08:09:05.394999 6622 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1e9672280b3347719b31d040efc4c7ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e9672280b3347719b31d040efc4c7ee" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 43189 } }
I20260811 08:09:05.395087 6622 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1e9672280b3347719b31d040efc4c7ee [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:09:05.395121 6622 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1e9672280b3347719b31d040efc4c7ee [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:09:05.395165 6622 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1e9672280b3347719b31d040efc4c7ee [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:09:05.395816 6622 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1e9672280b3347719b31d040efc4c7ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e9672280b3347719b31d040efc4c7ee" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 43189 } }
I20260811 08:09:05.395920 6622 leader_election.cc:302] T 00000000000000000000000000000000 P 1e9672280b3347719b31d040efc4c7ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1e9672280b3347719b31d040efc4c7ee; no voters:
I20260811 08:09:05.396071 6622 leader_election.cc:288] T 00000000000000000000000000000000 P 1e9672280b3347719b31d040efc4c7ee [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:09:05.396112 6631 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1e9672280b3347719b31d040efc4c7ee [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:09:05.396304 6622 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1e9672280b3347719b31d040efc4c7ee [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:09:05.396297 6631 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1e9672280b3347719b31d040efc4c7ee [term 1 LEADER]: Becoming Leader. State: Replica: 1e9672280b3347719b31d040efc4c7ee, State: Running, Role: LEADER
I20260811 08:09:05.396458 6631 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1e9672280b3347719b31d040efc4c7ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e9672280b3347719b31d040efc4c7ee" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 43189 } }
I20260811 08:09:05.396839 6631 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1e9672280b3347719b31d040efc4c7ee [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1e9672280b3347719b31d040efc4c7ee" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e9672280b3347719b31d040efc4c7ee" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 43189 } } }
I20260811 08:09:05.396871 6634 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1e9672280b3347719b31d040efc4c7ee [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1e9672280b3347719b31d040efc4c7ee. Latest consensus state: current_term: 1 leader_uuid: "1e9672280b3347719b31d040efc4c7ee" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e9672280b3347719b31d040efc4c7ee" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 43189 } } }
I20260811 08:09:05.396993 6631 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1e9672280b3347719b31d040efc4c7ee [sys.catalog]: This master's current role is: LEADER
I20260811 08:09:05.397042 6634 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1e9672280b3347719b31d040efc4c7ee [sys.catalog]: This master's current role is: LEADER
I20260811 08:09:05.397287 6640 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:09:05.397855 6640 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 11 08:09:05 dist-test-slave-7lbf krb5kdc[6486](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435745, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.27.243.254@KRBTEST.COM
I20260811 08:09:05.402277 6629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:05.392106 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33656 (local address 127.27.243.254:43189)
0811 08:09:05.392267 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:05.392277 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:05.392304 (+ 27us) server_negotiation.cc:407] Connection header received
0811 08:09:05.392751 (+ 447us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:05.392758 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:05.392808 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:05.392935 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:05.393682 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:05.394595 (+ 913us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:05.395593 (+ 998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:05.396073 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:05.396182 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:05.398986 (+ 2804us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:09:05.398990 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:09:05.398990 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:09:05.399000 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:09:05.400473 (+ 1473us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:05.400875 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:05.400877 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:05.400877 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:05.400981 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:05.401173 (+ 192us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:05.401173 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:05.401173 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:05.401386 (+ 213us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:09:05.401569 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0811 08:09:05.401729 (+ 160us) server_negotiation.cc:299] Negotiation successful
0811 08:09:05.401994 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":112,"thread_start_us":69,"threads_started":1}
I20260811 08:09:05.402593 6640 catalog_manager.cc:1347] Generated new cluster ID: 2e14b5917f2040f497e9ee9cf3e0af5e
I20260811 08:09:05.402647 6640 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:09:05.413338 6640 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:09:05.413888 6640 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:09:05.425870 6640 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1e9672280b3347719b31d040efc4c7ee: Generated new TSK 0
I20260811 08:09:05.426035 6640 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.27.243.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.27.243.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.27.243.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/krb5kdc/oryx_127.27.243.193.keytab.
Entry for principal oryx/127.27.243.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/krb5kdc/oryx_127.27.243.193.keytab.
I20260811 08:09:05.457868 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.243.193:0
--local_ip_for_outbound_sockets=127.27.243.193
--webserver_interface=127.27.243.193
--webserver_port=0
--tserver_master_addrs=127.27.243.254:43189
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/krb5kdc/oryx_127.27.243.193.keytab
--principal=oryx/127.27.243.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:37793
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:09:05.538139 6670 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:09:05.538340 6670 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:09:05.538362 6670 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:09:05.539466 6670 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:09:05.539506 6670 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:09:05.539533 6670 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.243.193
I20260811 08:09:05.540968 6670 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:37793
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/krb5kdc/oryx_127.27.243.193.keytab
--principal=oryx/127.27.243.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.243.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.243.193
--webserver_port=0
--tserver_master_addrs=127.27.243.254:43189
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6670
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.243.193
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:09:05.541188 6670 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:09:05.541400 6670 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:09:05.546198 6684 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:09:05.546213 6681 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:09:05.546257 6679 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:09:05.546501 6670 server_base.cc:1034] running on GCE node
I20260811 08:09:05.546681 6670 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:09:05.546868 6670 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:09:05.548003 6670 hybrid_clock.cc:648] HybridClock initialized: now 1786435745547990 us; error 28 us; skew 500 ppm
Aug 11 08:09:05 dist-test-slave-7lbf krb5kdc[6486](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435745, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.243.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:09:05.550503 6670 init.cc:377] Logged in from keytab as oryx/127.27.243.193@KRBTEST.COM (short username oryx)
I20260811 08:09:05.550985 6670 webserver.cc:460] Webserver started at http://127.27.243.193:44293/ using document root <none> and password file <none>
I20260811 08:09:05.551178 6670 fs_manager.cc:359] Metadata directory not provided
I20260811 08:09:05.551225 6670 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:09:05.551348 6670 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:09:05.552333 6670 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/ts-0/data/instance:
uuid: "2af48f4f9fd64006b6205f420d6e7d74"
format_stamp: "Formatted at 2026-08-11 08:09:05 on dist-test-slave-7lbf"
server_key: "0ea4b2ae8c675743a8b6dcb3feeb07ef"
server_key_iv: "153b0e1b8afc79800f6bd921cf0571b3"
server_key_version: "encryptionkey@0"
I20260811 08:09:05.552661 6670 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/ts-0/wal/instance:
uuid: "2af48f4f9fd64006b6205f420d6e7d74"
format_stamp: "Formatted at 2026-08-11 08:09:05 on dist-test-slave-7lbf"
server_key: "0ea4b2ae8c675743a8b6dcb3feeb07ef"
server_key_iv: "153b0e1b8afc79800f6bd921cf0571b3"
server_key_version: "encryptionkey@0"
I20260811 08:09:05.553972 6670 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 08:09:05.554668 6692 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:05.554822 6670 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 08:09:05.554910 6670 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/ts-0/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/ts-0/wal
uuid: "2af48f4f9fd64006b6205f420d6e7d74"
format_stamp: "Formatted at 2026-08-11 08:09:05 on dist-test-slave-7lbf"
server_key: "0ea4b2ae8c675743a8b6dcb3feeb07ef"
server_key_iv: "153b0e1b8afc79800f6bd921cf0571b3"
server_key_version: "encryptionkey@0"
I20260811 08:09:05.554970 6670 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:09:05.561625 6670 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:09:05.563556 6670 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:09:05.563683 6670 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:09:05.563875 6670 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:09:05.564136 6670 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:09:05.564169 6670 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:05.564196 6670 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:09:05.564218 6670 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:05.569741 6670 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.193:44819
I20260811 08:09:05.569787 6877 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.193:44819 every 8 connection(s)
I20260811 08:09:05.570081 6670 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/ts-0/data/info.pb
I20260811 08:09:05.572435 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 6670
I20260811 08:09:05.572541 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/ts-0/wal/instance
I20260811 08:09:05.572715 28623 external_mini_cluster.cc:1428] Setting key 248e9884a64d7d69829cf699d4c12dc5
Aug 11 08:09:05 dist-test-slave-7lbf krb5kdc[6486](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435745, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.243.193@KRBTEST.COM for oryx/127.27.243.254@KRBTEST.COM
I20260811 08:09:05.579511 6629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:05.570743 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.193:51811 (local address 127.27.243.254:43189)
0811 08:09:05.570795 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:05.570798 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:05.571005 (+ 207us) server_negotiation.cc:407] Connection header received
0811 08:09:05.571450 (+ 445us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:05.571451 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:05.571461 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:05.571511 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:05.572448 (+ 937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:05.573108 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:05.574442 (+ 1334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:05.574646 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:05.574703 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:05.576739 (+ 2036us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:09:05.576741 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:09:05.576741 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:09:05.576749 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:09:05.578270 (+ 1521us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:05.578643 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:05.578645 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:05.578645 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:05.578708 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:05.578911 (+ 203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:05.578912 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:05.578913 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:05.579046 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:09:05.579115 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 08:09:05.579326 (+ 211us) server_negotiation.cc:299] Negotiation successful
0811 08:09:05.579418 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 08:09:05.579561 6882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:05.570719 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:43189 (local address 127.27.243.193:51811)
0811 08:09:05.570892 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:05.570925 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:05.571369 (+ 444us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:05.571571 (+ 202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:05.571574 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:05.572130 (+ 556us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:09:05.572358 (+ 228us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:05.572366 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:05.573202 (+ 836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:05.573203 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:05.574355 (+ 1152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:05.574358 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:05.574721 (+ 363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:05.574722 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:05.574862 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:05.575346 (+ 484us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:09:05.575357 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:09:05.576644 (+ 1287us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:09:05.578361 (+ 1717us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:09:05.578368 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:09:05.578370 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:09:05.578576 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:09:05.578767 (+ 191us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:09:05.578767 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:09:05.578767 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:09:05.578857 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:09:05.579102 (+ 245us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:09:05.579105 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:09:05.579208 (+ 103us) client_negotiation.cc:769] Sending connection context
0811 08:09:05.579281 (+ 73us) client_negotiation.cc:240] Negotiation successful
0811 08:09:05.579407 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":94,"threads_started":1}
I20260811 08:09:05.580030 6878 heartbeater.cc:347] Connected to a master server at 127.27.243.254:43189
I20260811 08:09:05.580118 6878 heartbeater.cc:464] Registering TS with master...
I20260811 08:09:05.580277 6878 heartbeater.cc:511] Master 127.27.243.254:43189 requested a full tablet report, sending...
I20260811 08:09:05.580778 6567 ts_manager.cc:194] Registered new tserver with Master: 2af48f4f9fd64006b6205f420d6e7d74 (127.27.243.193:44819)
I20260811 08:09:05.581355 6567 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.27.243.193@KRBTEST.COM'} at 127.27.243.193:51811
WARNING: no policy specified for oryx/127.27.243.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.27.243.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.27.243.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/krb5kdc/oryx_127.27.243.194.keytab.
Entry for principal oryx/127.27.243.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/krb5kdc/oryx_127.27.243.194.keytab.
W20260811 08:09:06.234056 28623 mini_kdc.cc:262] Time spent creating service keytab for oryx/127.27.243.194: real 0.661s user 0.002s sys 0.001s
I20260811 08:09:06.234441 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.243.194:0
--local_ip_for_outbound_sockets=127.27.243.194
--webserver_interface=127.27.243.194
--webserver_port=0
--tserver_master_addrs=127.27.243.254:43189
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/krb5kdc/oryx_127.27.243.194.keytab
--principal=oryx/127.27.243.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:37793
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:09:06.318208 6887 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:09:06.318408 6887 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:09:06.318430 6887 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:09:06.319545 6887 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:09:06.319587 6887 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:09:06.319613 6887 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.243.194
I20260811 08:09:06.321098 6887 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:37793
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/krb5kdc/oryx_127.27.243.194.keytab
--principal=oryx/127.27.243.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.243.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.243.194
--webserver_port=0
--tserver_master_addrs=127.27.243.254:43189
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6887
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.243.194
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:09:06.321316 6887 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:09:06.321614 6887 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:09:06.326539 6902 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:09:06.326574 6899 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:09:06.326574 6898 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:09:06.326893 6887 server_base.cc:1034] running on GCE node
I20260811 08:09:06.327127 6887 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:09:06.327355 6887 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:09:06.328500 6887 hybrid_clock.cc:648] HybridClock initialized: now 1786435746328489 us; error 42 us; skew 500 ppm
Aug 11 08:09:06 dist-test-slave-7lbf krb5kdc[6486](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435746, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.243.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:09:06.331028 6887 init.cc:377] Logged in from keytab as oryx/127.27.243.194@KRBTEST.COM (short username oryx)
I20260811 08:09:06.331449 6887 webserver.cc:460] Webserver started at http://127.27.243.194:45677/ using document root <none> and password file <none>
I20260811 08:09:06.331662 6887 fs_manager.cc:359] Metadata directory not provided
I20260811 08:09:06.331712 6887 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:09:06.331835 6887 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:09:06.332857 6887 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/ts-1/data/instance:
uuid: "354d5113c37743aa8300abdb229b7106"
format_stamp: "Formatted at 2026-08-11 08:09:06 on dist-test-slave-7lbf"
server_key: "06d7c854ef398ccd5b6efcdfea001650"
server_key_iv: "f31467a1aedb0eac741f0449f118c50c"
server_key_version: "encryptionkey@0"
I20260811 08:09:06.333194 6887 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/ts-1/wal/instance:
uuid: "354d5113c37743aa8300abdb229b7106"
format_stamp: "Formatted at 2026-08-11 08:09:06 on dist-test-slave-7lbf"
server_key: "06d7c854ef398ccd5b6efcdfea001650"
server_key_iv: "f31467a1aedb0eac741f0449f118c50c"
server_key_version: "encryptionkey@0"
I20260811 08:09:06.334571 6887 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 08:09:06.335248 6912 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:06.335404 6887 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 08:09:06.335489 6887 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/ts-1/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/ts-1/wal
uuid: "354d5113c37743aa8300abdb229b7106"
format_stamp: "Formatted at 2026-08-11 08:09:06 on dist-test-slave-7lbf"
server_key: "06d7c854ef398ccd5b6efcdfea001650"
server_key_iv: "f31467a1aedb0eac741f0449f118c50c"
server_key_version: "encryptionkey@0"
I20260811 08:09:06.335549 6887 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:09:06.355960 6887 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:09:06.357893 6887 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:09:06.358034 6887 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:09:06.358245 6887 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:09:06.358557 6887 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:09:06.358593 6887 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:06.358621 6887 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:09:06.358644 6887 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:06.365345 6887 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.194:41905
I20260811 08:09:06.365432 7101 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.194:41905 every 8 connection(s)
I20260811 08:09:06.365767 6887 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/ts-1/data/info.pb
I20260811 08:09:06.370748 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 6887
I20260811 08:09:06.370901 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/ts-1/wal/instance
I20260811 08:09:06.371104 28623 external_mini_cluster.cc:1428] Setting key 2cfde27ec513a6e77144d6f5c02a3c7a
Aug 11 08:09:06 dist-test-slave-7lbf krb5kdc[6486](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435746, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.243.194@KRBTEST.COM for oryx/127.27.243.254@KRBTEST.COM
I20260811 08:09:06.376067 7106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:06.366515 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.194:47105 (local address 127.27.243.254:43189)
0811 08:09:06.366656 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:06.366659 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:06.366835 (+ 176us) server_negotiation.cc:407] Connection header received
0811 08:09:06.367358 (+ 523us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:06.367360 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:06.367376 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:06.367510 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:06.368426 (+ 916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:06.368961 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:06.370298 (+ 1337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:06.370507 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:06.370589 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:06.372931 (+ 2342us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:09:06.372933 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:09:06.372933 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:09:06.372940 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:09:06.374522 (+ 1582us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:06.375038 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:06.375039 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:06.375039 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:06.375107 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:06.375402 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:06.375403 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:06.375403 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:06.375517 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:09:06.375571 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 08:09:06.375910 (+ 339us) server_negotiation.cc:299] Negotiation successful
0811 08:09:06.375993 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":119,"thread_start_us":69,"threads_started":1}
I20260811 08:09:06.376242 7104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:06.366445 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:43189 (local address 127.27.243.194:47105)
0811 08:09:06.366603 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:06.366646 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:06.367248 (+ 602us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:06.367566 (+ 318us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:06.367569 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:06.368144 (+ 575us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:09:06.368337 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:06.368342 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:06.369085 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:06.369087 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:06.370204 (+ 1117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:06.370208 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:06.370623 (+ 415us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:06.370624 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:06.370778 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:06.371259 (+ 481us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:09:06.371269 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:09:06.372834 (+ 1565us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:09:06.374617 (+ 1783us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:09:06.374625 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:09:06.374626 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:09:06.374948 (+ 322us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:09:06.375162 (+ 214us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:09:06.375163 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:09:06.375163 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:09:06.375312 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:09:06.375576 (+ 264us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:09:06.375583 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:09:06.375741 (+ 158us) client_negotiation.cc:769] Sending connection context
0811 08:09:06.375858 (+ 117us) client_negotiation.cc:240] Negotiation successful
0811 08:09:06.376025 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":75,"threads_started":1}
I20260811 08:09:06.376749 7102 heartbeater.cc:347] Connected to a master server at 127.27.243.254:43189
I20260811 08:09:06.376860 7102 heartbeater.cc:464] Registering TS with master...
I20260811 08:09:06.377063 7102 heartbeater.cc:511] Master 127.27.243.254:43189 requested a full tablet report, sending...
I20260811 08:09:06.377565 6567 ts_manager.cc:194] Registered new tserver with Master: 354d5113c37743aa8300abdb229b7106 (127.27.243.194:41905)
I20260811 08:09:06.377988 6567 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.27.243.194@KRBTEST.COM'} at 127.27.243.194:47105
WARNING: no policy specified for oryx/127.27.243.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.27.243.195@KRBTEST.COM" created.
I20260811 08:09:06.582424 6878 heartbeater.cc:503] Master 127.27.243.254:43189 was elected leader, sending a full tablet report...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.27.243.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/krb5kdc/oryx_127.27.243.195.keytab.
Entry for principal oryx/127.27.243.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/krb5kdc/oryx_127.27.243.195.keytab.
W20260811 08:09:07.154546 28623 mini_kdc.cc:262] Time spent creating service keytab for oryx/127.27.243.195: real 0.783s user 0.000s sys 0.004s
I20260811 08:09:07.154937 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.243.195:0
--local_ip_for_outbound_sockets=127.27.243.195
--webserver_interface=127.27.243.195
--webserver_port=0
--tserver_master_addrs=127.27.243.254:43189
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/krb5kdc/oryx_127.27.243.195.keytab
--principal=oryx/127.27.243.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:37793
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:09:07.239938 7112 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:09:07.240140 7112 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:09:07.240163 7112 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:09:07.241321 7112 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:09:07.241374 7112 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:09:07.241400 7112 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.243.195
I20260811 08:09:07.242918 7112 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:37793
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/krb5kdc/oryx_127.27.243.195.keytab
--principal=oryx/127.27.243.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.243.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.243.195
--webserver_port=0
--tserver_master_addrs=127.27.243.254:43189
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7112
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.243.195
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:09:07.243167 7112 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:09:07.243395 7112 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:09:07.248392 7122 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:09:07.248396 7124 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:09:07.248353 7119 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:09:07.248541 7112 server_base.cc:1034] running on GCE node
I20260811 08:09:07.248792 7112 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:09:07.249034 7112 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:09:07.250164 7112 hybrid_clock.cc:648] HybridClock initialized: now 1786435747250149 us; error 33 us; skew 500 ppm
Aug 11 08:09:07 dist-test-slave-7lbf krb5kdc[6486](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435747, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.243.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:09:07.252797 7112 init.cc:377] Logged in from keytab as oryx/127.27.243.195@KRBTEST.COM (short username oryx)
I20260811 08:09:07.253212 7112 webserver.cc:460] Webserver started at http://127.27.243.195:40285/ using document root <none> and password file <none>
I20260811 08:09:07.253423 7112 fs_manager.cc:359] Metadata directory not provided
I20260811 08:09:07.253473 7112 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:09:07.253638 7112 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:09:07.254787 7112 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/ts-2/data/instance:
uuid: "bd9c6cd01570488cac503f339622298c"
format_stamp: "Formatted at 2026-08-11 08:09:07 on dist-test-slave-7lbf"
server_key: "e103b8a6b29f04b035df1cff188e5e60"
server_key_iv: "14041c8cb45621ae44cac1eda4c0b2e6"
server_key_version: "encryptionkey@0"
I20260811 08:09:07.255168 7112 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/ts-2/wal/instance:
uuid: "bd9c6cd01570488cac503f339622298c"
format_stamp: "Formatted at 2026-08-11 08:09:07 on dist-test-slave-7lbf"
server_key: "e103b8a6b29f04b035df1cff188e5e60"
server_key_iv: "14041c8cb45621ae44cac1eda4c0b2e6"
server_key_version: "encryptionkey@0"
I20260811 08:09:07.256563 7112 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 08:09:07.257265 7140 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:07.257534 7112 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 08:09:07.257645 7112 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/ts-2/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/ts-2/wal
uuid: "bd9c6cd01570488cac503f339622298c"
format_stamp: "Formatted at 2026-08-11 08:09:07 on dist-test-slave-7lbf"
server_key: "e103b8a6b29f04b035df1cff188e5e60"
server_key_iv: "14041c8cb45621ae44cac1eda4c0b2e6"
server_key_version: "encryptionkey@0"
I20260811 08:09:07.257727 7112 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:09:07.267830 7112 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:09:07.269953 7112 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:09:07.270112 7112 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:09:07.270345 7112 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:09:07.270707 7112 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:09:07.270756 7112 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:07.270798 7112 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:09:07.270826 7112 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:07.277127 7112 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.195:43703
I20260811 08:09:07.277170 7332 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.195:43703 every 8 connection(s)
I20260811 08:09:07.277498 7112 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/ts-2/data/info.pb
I20260811 08:09:07.280673 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 7112
I20260811 08:09:07.280788 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/ts-2/wal/instance
I20260811 08:09:07.280974 28623 external_mini_cluster.cc:1428] Setting key cb29928c98b52e9a1ff536d532a4744a
Aug 11 08:09:07 dist-test-slave-7lbf krb5kdc[6486](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435747, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.243.195@KRBTEST.COM for oryx/127.27.243.254@KRBTEST.COM
I20260811 08:09:07.287225 7335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:07.278274 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.195:36003 (local address 127.27.243.254:43189)
0811 08:09:07.278391 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:07.278393 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:07.278622 (+ 229us) server_negotiation.cc:407] Connection header received
0811 08:09:07.279287 (+ 665us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:07.279289 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:07.279305 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:07.279372 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:07.280302 (+ 930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:07.281019 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:07.282421 (+ 1402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:07.282624 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:07.282680 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:07.284791 (+ 2111us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:09:07.284793 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:09:07.284793 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:09:07.284834 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:09:07.286105 (+ 1271us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:07.286461 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:07.286462 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:07.286462 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:07.286511 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:07.286709 (+ 198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:07.286709 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:07.286709 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:07.286835 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:09:07.286883 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0811 08:09:07.287090 (+ 207us) server_negotiation.cc:299] Negotiation successful
0811 08:09:07.287154 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93,"thread_start_us":59,"threads_started":1}
I20260811 08:09:07.287424 7336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:07.278261 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:43189 (local address 127.27.243.195:36003)
0811 08:09:07.278477 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:07.278522 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:07.279168 (+ 646us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:07.279446 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:07.279450 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:07.280004 (+ 554us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:09:07.280197 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:07.280201 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:07.281117 (+ 916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:07.281119 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:07.282335 (+ 1216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:07.282338 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:07.282729 (+ 391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:07.282731 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:07.282891 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:07.283344 (+ 453us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:09:07.283355 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:09:07.284701 (+ 1346us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:09:07.286174 (+ 1473us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:09:07.286181 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:09:07.286183 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:09:07.286400 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:09:07.286554 (+ 154us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:09:07.286554 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:09:07.286555 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:09:07.286664 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:09:07.286880 (+ 216us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:09:07.286884 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:09:07.286996 (+ 112us) client_negotiation.cc:769] Sending connection context
0811 08:09:07.287074 (+ 78us) client_negotiation.cc:240] Negotiation successful
0811 08:09:07.287207 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":113,"threads_started":1}
I20260811 08:09:07.287930 7333 heartbeater.cc:347] Connected to a master server at 127.27.243.254:43189
I20260811 08:09:07.288019 7333 heartbeater.cc:464] Registering TS with master...
I20260811 08:09:07.288187 7333 heartbeater.cc:511] Master 127.27.243.254:43189 requested a full tablet report, sending...
I20260811 08:09:07.288532 6567 ts_manager.cc:194] Registered new tserver with Master: bd9c6cd01570488cac503f339622298c (127.27.243.195:43703)
I20260811 08:09:07.289256 6567 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.27.243.195@KRBTEST.COM'} at 127.27.243.195:36003
I20260811 08:09:07.292550 28623 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.27.243.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.27.243.253@KRBTEST.COM" created.
I20260811 08:09:07.379045 7102 heartbeater.cc:503] Master 127.27.243.254:43189 was elected leader, sending a full tablet report...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.27.243.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/krb5kdc/oryx_127.27.243.253.keytab.
Entry for principal oryx/127.27.243.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/krb5kdc/oryx_127.27.243.253.keytab.
W20260811 08:09:07.443740 28623 mini_kdc.cc:262] Time spent creating service keytab for oryx/127.27.243.253: real 0.150s user 0.001s sys 0.003s
I20260811 08:09:07.444142 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.243.253:41319
--webserver_interface=127.27.243.253
--webserver_port=0
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/krb5kdc/oryx_127.27.243.253.keytab
--principal=oryx/127.27.243.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:37793
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.243.254:43189,127.27.243.253:41319
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:09:07.526121 7341 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:09:07.526315 7341 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:09:07.526337 7341 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:09:07.527419 7341 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:09:07.527454 7341 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:09:07.527467 7341 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:09:07.527478 7341 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:09:07.527489 7341 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:09:07.528923 7341 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:37793
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.27.243.254:43189,127.27.243.253:41319
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/krb5kdc/oryx_127.27.243.253.keytab
--principal=oryx/127.27.243.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.243.253:41319
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.27.243.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7341
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
W20260811 08:09:07.529026 7341 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.27.243.254:43189,127.27.243.253:41319'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260811 08:09:07.529176 7341 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:09:07.529393 7341 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:09:07.534333 7356 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:09:07.534391 7350 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:09:07.534420 7351 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:09:07.534551 7341 server_base.cc:1034] running on GCE node
I20260811 08:09:07.534773 7341 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:09:07.535017 7341 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:09:07.536155 7341 hybrid_clock.cc:648] HybridClock initialized: now 1786435747536146 us; error 28 us; skew 500 ppm
Aug 11 08:09:07 dist-test-slave-7lbf krb5kdc[6486](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435747, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.243.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:09:07.538656 7341 init.cc:377] Logged in from keytab as oryx/127.27.243.253@KRBTEST.COM (short username oryx)
I20260811 08:09:07.539099 7341 webserver.cc:460] Webserver started at http://127.27.243.253:35781/ using document root <none> and password file <none>
I20260811 08:09:07.539300 7341 fs_manager.cc:359] Metadata directory not provided
I20260811 08:09:07.539356 7341 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:09:07.539485 7341 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:09:07.540491 7341 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/master-1/data/instance:
uuid: "e7239e9050e74949bd7be2f23f82fc50"
format_stamp: "Formatted at 2026-08-11 08:09:07 on dist-test-slave-7lbf"
server_key: "e0725be499248c967c9d6fd3c2753325"
server_key_iv: "25f501c85011dd41e09638b219c6116c"
server_key_version: "encryptionkey@0"
I20260811 08:09:07.540822 7341 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/master-1/wal/instance:
uuid: "e7239e9050e74949bd7be2f23f82fc50"
format_stamp: "Formatted at 2026-08-11 08:09:07 on dist-test-slave-7lbf"
server_key: "e0725be499248c967c9d6fd3c2753325"
server_key_iv: "25f501c85011dd41e09638b219c6116c"
server_key_version: "encryptionkey@0"
I20260811 08:09:07.542145 7341 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260811 08:09:07.542845 7368 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:07.543000 7341 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 08:09:07.543083 7341 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/master-1/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/master-1/wal
uuid: "e7239e9050e74949bd7be2f23f82fc50"
format_stamp: "Formatted at 2026-08-11 08:09:07 on dist-test-slave-7lbf"
server_key: "e0725be499248c967c9d6fd3c2753325"
server_key_iv: "25f501c85011dd41e09638b219c6116c"
server_key_version: "encryptionkey@0"
I20260811 08:09:07.543148 7341 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:09:07.553426 7341 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:09:07.555433 7341 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:09:07.555560 7341 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:09:07.559522 7341 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.253:41319
I20260811 08:09:07.559563 7469 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.253:41319 every 8 connection(s)
I20260811 08:09:07.559877 7341 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/master-1/data/info.pb
I20260811 08:09:07.560822 7470 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:09:07.562460 7470 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.243.254" port: 43189 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 08:09:07 dist-test-slave-7lbf krb5kdc[6486](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435747, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.243.253@KRBTEST.COM for oryx/127.27.243.254@KRBTEST.COM
I20260811 08:09:07.569703 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 7341
I20260811 08:09:07.571115 7335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:07.563135 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33664 (local address 127.27.243.254:43189)
0811 08:09:07.563189 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:07.563191 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:07.563358 (+ 167us) server_negotiation.cc:407] Connection header received
0811 08:09:07.563809 (+ 451us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:07.563811 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:07.563820 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:07.563867 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:07.564465 (+ 598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:07.564985 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:07.565982 (+ 997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:07.566181 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:07.566235 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:07.568199 (+ 1964us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:09:07.568201 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:09:07.568201 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:09:07.568208 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:09:07.569506 (+ 1298us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:07.569966 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:07.569967 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:07.569968 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:07.570033 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:07.570369 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:07.570371 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:07.570371 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:07.570562 (+ 191us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:09:07.570605 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0811 08:09:07.570917 (+ 312us) server_negotiation.cc:299] Negotiation successful
0811 08:09:07.571017 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 08:09:07.571159 7474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:07.563086 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:43189 (local address 127.0.0.1:33664)
0811 08:09:07.563242 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:07.563282 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:07.563711 (+ 429us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:07.563928 (+ 217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:07.563931 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:07.564156 (+ 225us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:09:07.564340 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:07.564358 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:07.565057 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:07.565057 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:07.565910 (+ 853us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:07.565913 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:07.566241 (+ 328us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:07.566242 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:07.566333 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:07.566757 (+ 424us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:09:07.566765 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:09:07.568111 (+ 1346us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:09:07.569601 (+ 1490us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:09:07.569607 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:09:07.569609 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:09:07.569880 (+ 271us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:09:07.570111 (+ 231us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:09:07.570112 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:09:07.570112 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:09:07.570261 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:09:07.570653 (+ 392us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:09:07.570658 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:09:07.570771 (+ 113us) client_negotiation.cc:769] Sending connection context
0811 08:09:07.570862 (+ 91us) client_negotiation.cc:240] Negotiation successful
0811 08:09:07.570999 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":69,"threads_started":1}
I20260811 08:09:07.571825 7470 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.243.253" port: 41319 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 08:09:07 dist-test-slave-7lbf krb5kdc[6486](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435745, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.27.243.253@KRBTEST.COM
Aug 11 08:09:07 dist-test-slave-7lbf krb5kdc[6486](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435747, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.243.253@KRBTEST.COM for oryx/127.27.243.253@KRBTEST.COM
I20260811 08:09:07.578492 7478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:07.570276 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34800 (local address 127.27.243.253:41319)
0811 08:09:07.570440 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:07.570445 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:07.570512 (+ 67us) server_negotiation.cc:407] Connection header received
0811 08:09:07.570575 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:07.570577 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:07.570591 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:07.570654 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:07.571299 (+ 645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:07.572154 (+ 855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:07.572978 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:07.573288 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:07.573346 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:07.575687 (+ 2341us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:09:07.575695 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:09:07.575696 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:09:07.575704 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:09:07.577331 (+ 1627us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:07.577707 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:07.577711 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:07.577712 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:07.577770 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:07.577956 (+ 186us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:07.577956 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:07.577957 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:07.578113 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:09:07.578272 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0811 08:09:07.578336 (+ 64us) server_negotiation.cc:299] Negotiation successful
0811 08:09:07.578407 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":138,"thread_start_us":69,"threads_started":1}
I20260811 08:09:07.579092 7474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:07.572060 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.253:41319 (local address 127.0.0.1:34810)
0811 08:09:07.572103 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:07.572113 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:07.572156 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:07.572357 (+ 201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:07.572358 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:07.572495 (+ 137us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:09:07.572543 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:07.572545 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:07.573191 (+ 646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:07.573192 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:07.573735 (+ 543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:07.573737 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:07.574070 (+ 333us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:07.574071 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:07.574129 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:07.574475 (+ 346us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:09:07.574478 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:09:07.576040 (+ 1562us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:09:07.578066 (+ 2026us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:09:07.578067 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:09:07.578067 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:09:07.578272 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:09:07.578483 (+ 211us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:09:07.578484 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:09:07.578484 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:09:07.578549 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:09:07.578803 (+ 254us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:09:07.578803 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:09:07.578840 (+ 37us) client_negotiation.cc:769] Sending connection context
0811 08:09:07.578909 (+ 69us) client_negotiation.cc:240] Negotiation successful
0811 08:09:07.578999 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":25}
I20260811 08:09:07.579186 7481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:07.572110 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34810 (local address 127.27.243.253:41319)
0811 08:09:07.572256 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:07.572258 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:07.572262 (+ 4us) server_negotiation.cc:407] Connection header received
0811 08:09:07.572276 (+ 14us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:07.572276 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:07.572285 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:07.572340 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:07.572609 (+ 269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:07.573110 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:07.573813 (+ 703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:07.574006 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:07.574065 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:07.576127 (+ 2062us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:09:07.576128 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:09:07.576128 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:09:07.576135 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:09:07.577996 (+ 1861us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:07.578348 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:07.578349 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:07.578349 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:07.578415 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:07.578615 (+ 200us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:07.578616 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:07.578617 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:07.578740 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:09:07.578801 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 08:09:07.578933 (+ 132us) server_negotiation.cc:299] Negotiation successful
0811 08:09:07.579051 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":54,"server-negotiator.queue_time_us":130,"thread_start_us":85,"threads_started":1}
I20260811 08:09:07.580341 7470 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e7239e9050e74949bd7be2f23f82fc50: Bootstrap starting.
I20260811 08:09:07.580878 7470 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e7239e9050e74949bd7be2f23f82fc50: Neither blocks nor log segments found. Creating new log.
I20260811 08:09:07.581110 7470 log.cc:824] T 00000000000000000000000000000000 P e7239e9050e74949bd7be2f23f82fc50: Log is configured to *not* fsync() on all Append() calls
I20260811 08:09:07.581800 7470 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e7239e9050e74949bd7be2f23f82fc50: No bootstrap required, opened a new log
I20260811 08:09:07.583074 7470 raft_consensus.cc:348] T 00000000000000000000000000000000 P e7239e9050e74949bd7be2f23f82fc50 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e9672280b3347719b31d040efc4c7ee" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 43189 } } peers { permanent_uuid: "e7239e9050e74949bd7be2f23f82fc50" member_type: VOTER last_known_addr { host: "127.27.243.253" port: 41319 } }
I20260811 08:09:07.583189 7470 raft_consensus.cc:374] T 00000000000000000000000000000000 P e7239e9050e74949bd7be2f23f82fc50 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:09:07.583209 7470 raft_consensus.cc:729] T 00000000000000000000000000000000 P e7239e9050e74949bd7be2f23f82fc50 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7239e9050e74949bd7be2f23f82fc50, State: Initialized, Role: FOLLOWER
I20260811 08:09:07.583316 7470 consensus_queue.cc:260] T 00000000000000000000000000000000 P e7239e9050e74949bd7be2f23f82fc50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e9672280b3347719b31d040efc4c7ee" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 43189 } } peers { permanent_uuid: "e7239e9050e74949bd7be2f23f82fc50" member_type: VOTER last_known_addr { host: "127.27.243.253" port: 41319 } }
I20260811 08:09:07.583634 7470 sys_catalog.cc:564] T 00000000000000000000000000000000 P e7239e9050e74949bd7be2f23f82fc50 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:09:07.583627 7486 sys_catalog.cc:455] T 00000000000000000000000000000000 P e7239e9050e74949bd7be2f23f82fc50 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e9672280b3347719b31d040efc4c7ee" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 43189 } } peers { permanent_uuid: "e7239e9050e74949bd7be2f23f82fc50" member_type: VOTER last_known_addr { host: "127.27.243.253" port: 41319 } } }
I20260811 08:09:07.583757 7486 sys_catalog.cc:458] T 00000000000000000000000000000000 P e7239e9050e74949bd7be2f23f82fc50 [sys.catalog]: This master's current role is: FOLLOWER
W20260811 08:09:07.585623 7507 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e7239e9050e74949bd7be2f23f82fc50: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 08:09:07.585691 7507 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 08:09:07.587074 7341 master_runner.cc:428] Detected that this master e7239e9050e74949bd7be2f23f82fc50 is joining an existing cluster
I20260811 08:09:07.587119 7341 master_runner.cc:432] Initiating AddMaster RPC to add 127.27.243.253:41319
I20260811 08:09:07.594732 7517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:07.588094 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.253:41319 (local address 127.0.0.1:34812)
0811 08:09:07.588217 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:07.588227 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:07.588296 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:07.588441 (+ 145us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:07.588441 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:07.588696 (+ 255us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:09:07.588779 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:07.588782 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:07.589704 (+ 922us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:07.589705 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:07.590571 (+ 866us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:07.590574 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:07.591011 (+ 437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:07.591012 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:07.591073 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:07.591486 (+ 413us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:09:07.591491 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:09:07.591917 (+ 426us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:09:07.593596 (+ 1679us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:09:07.593596 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:09:07.593597 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:09:07.593776 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:09:07.593968 (+ 192us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:09:07.593969 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:09:07.593969 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:09:07.594030 (+ 61us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:09:07.594388 (+ 358us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:09:07.594389 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:09:07.594428 (+ 39us) client_negotiation.cc:769] Sending connection context
0811 08:09:07.594496 (+ 68us) client_negotiation.cc:240] Negotiation successful
0811 08:09:07.594604 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":109,"mutex_wait_us":3,"thread_start_us":82,"threads_started":1}
I20260811 08:09:07.594777 7481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:07.588045 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34812 (local address 127.27.243.253:41319)
0811 08:09:07.588082 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:07.588083 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:07.588318 (+ 235us) server_negotiation.cc:407] Connection header received
0811 08:09:07.588342 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:07.588343 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:07.588354 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:07.588409 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:07.588878 (+ 469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:07.589626 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:07.590664 (+ 1038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:07.590902 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:07.590977 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:07.592013 (+ 1036us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:09:07.592014 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:09:07.592015 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:09:07.592021 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:09:07.593466 (+ 1445us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:07.593849 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:07.593850 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:07.593851 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:07.593908 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:07.594212 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:07.594213 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:07.594213 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:07.594318 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:09:07.594384 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0811 08:09:07.594523 (+ 139us) server_negotiation.cc:299] Negotiation successful
0811 08:09:07.594662 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":72,"server-negotiator.queue_time_us":18}
I20260811 08:09:07.595971 7514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:07.588038 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:43189 (local address 127.0.0.1:33674)
0811 08:09:07.588216 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:07.588227 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:07.588298 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:07.588465 (+ 167us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:07.588465 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:07.588698 (+ 233us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:09:07.588788 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:07.588790 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:07.590671 (+ 1881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:07.590672 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:07.591482 (+ 810us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:07.591485 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:07.591965 (+ 480us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:07.591966 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:07.592032 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:07.592692 (+ 660us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:09:07.592697 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:09:07.593069 (+ 372us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:09:07.594874 (+ 1805us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:09:07.594875 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:09:07.594875 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:09:07.595080 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:09:07.595291 (+ 211us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:09:07.595292 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:09:07.595292 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:09:07.595355 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:09:07.595634 (+ 279us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:09:07.595635 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:09:07.595697 (+ 62us) client_negotiation.cc:769] Sending connection context
0811 08:09:07.595756 (+ 59us) client_negotiation.cc:240] Negotiation successful
0811 08:09:07.595863 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157,"mutex_wait_us":14,"thread_start_us":88,"threads_started":1}
I20260811 08:09:07.595991 7335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:07.588067 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33674 (local address 127.27.243.254:43189)
0811 08:09:07.588110 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:07.588112 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:07.588297 (+ 185us) server_negotiation.cc:407] Connection header received
0811 08:09:07.588389 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:07.588390 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:07.588401 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:07.588454 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:07.588859 (+ 405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:07.589634 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:07.591573 (+ 1939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:07.591866 (+ 293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:07.591944 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:07.593173 (+ 1229us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:09:07.593175 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:09:07.593175 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:09:07.593182 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:09:07.594770 (+ 1588us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:07.595167 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:07.595169 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:07.595169 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:07.595224 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:07.595421 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:07.595422 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:07.595422 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:07.595550 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:09:07.595591 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0811 08:09:07.595797 (+ 206us) server_negotiation.cc:299] Negotiation successful
0811 08:09:07.595876 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
Aug 11 08:09:07 dist-test-slave-7lbf krb5kdc[6486](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435745, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.243.254@KRBTEST.COM for oryx/127.27.243.253@KRBTEST.COM
I20260811 08:09:07.605084 7481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:07.598286 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34814 (local address 127.27.243.253:41319)
0811 08:09:07.598330 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:07.598331 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:07.598513 (+ 182us) server_negotiation.cc:407] Connection header received
0811 08:09:07.598597 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:07.598598 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:07.598607 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:07.598652 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:07.599150 (+ 498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:07.599596 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:07.600694 (+ 1098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:07.600881 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:07.600938 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:07.602912 (+ 1974us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:09:07.602913 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:09:07.602914 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:09:07.602920 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:09:07.604071 (+ 1151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:07.604415 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:07.604416 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:07.604416 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:07.604461 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:07.604622 (+ 161us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:07.604623 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:07.604623 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:07.604713 (+ 90us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:09:07.604765 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 08:09:07.604929 (+ 164us) server_negotiation.cc:299] Negotiation successful
0811 08:09:07.604998 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 08:09:07.605098 7520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:07.598209 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.253:41319 (local address 127.0.0.1:34814)
0811 08:09:07.598395 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:07.598447 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:07.598524 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:07.598667 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:07.598670 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:07.599008 (+ 338us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:09:07.599071 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:07.599073 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:07.599668 (+ 595us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:07.599669 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:07.600595 (+ 926us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:07.600597 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:07.600952 (+ 355us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:07.600953 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:07.601045 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:07.601422 (+ 377us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:09:07.601426 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:09:07.602835 (+ 1409us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:09:07.604147 (+ 1312us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:09:07.604155 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:09:07.604157 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:09:07.604346 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:09:07.604516 (+ 170us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:09:07.604517 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:09:07.604517 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:09:07.604574 (+ 57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:09:07.604768 (+ 194us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:09:07.604775 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:09:07.604826 (+ 51us) client_negotiation.cc:769] Sending connection context
0811 08:09:07.604899 (+ 73us) client_negotiation.cc:240] Negotiation successful
0811 08:09:07.605003 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":100,"threads_started":1}
I20260811 08:09:07.605675 6567 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.27.243.253:41319: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "e7239e9050e74949bd7be2f23f82fc50"
member_type: NON_VOTER
last_known_addr {
host: "127.27.243.253"
port: 41319
}
attrs {
promote: true
}
}
dest_uuid: "1e9672280b3347719b31d040efc4c7ee"
cas_config_opid_index: -1
I20260811 08:09:07.606078 6567 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1e9672280b3347719b31d040efc4c7ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "1e9672280b3347719b31d040efc4c7ee" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 43189 } } peers { permanent_uuid: "e7239e9050e74949bd7be2f23f82fc50" member_type: NON_VOTER last_known_addr { host: "127.27.243.253" port: 41319 } attrs { promote: true } }
I20260811 08:09:07.606613 7527 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 1e9672280b3347719b31d040efc4c7ee [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER e7239e9050e74949bd7be2f23f82fc50 (127.27.243.253) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "1e9672280b3347719b31d040efc4c7ee" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 43189 } } peers { permanent_uuid: "e7239e9050e74949bd7be2f23f82fc50" member_type: NON_VOTER last_known_addr { host: "127.27.243.253" port: 41319 } attrs { promote: true } } }
I20260811 08:09:07.606915 7425 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e7239e9050e74949bd7be2f23f82fc50 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:09:07.607506 7527 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.27.243.253:41319
I20260811 08:09:07.607626 7527 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1e9672280b3347719b31d040efc4c7ee [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "1e9672280b3347719b31d040efc4c7ee" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "1e9672280b3347719b31d040efc4c7ee" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 43189 } } peers { permanent_uuid: "e7239e9050e74949bd7be2f23f82fc50" member_type: NON_VOTER last_known_addr { host: "127.27.243.253" port: 41319 } attrs { promote: true } } }
I20260811 08:09:07.607759 7527 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1e9672280b3347719b31d040efc4c7ee [sys.catalog]: This master's current role is: LEADER
I20260811 08:09:07.607827 7425 raft_consensus.cc:1261] T 00000000000000000000000000000000 P e7239e9050e74949bd7be2f23f82fc50 [term 1 FOLLOWER]: Refusing update from remote peer 1e9672280b3347719b31d040efc4c7ee: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260811 08:09:07.607860 7341 master.cc:537] Master@127.27.243.253:41319 shutting down...
I20260811 08:09:07.608389 7528 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 1e9672280b3347719b31d040efc4c7ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7239e9050e74949bd7be2f23f82fc50" member_type: NON_VOTER last_known_addr { host: "127.27.243.253" port: 41319 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 08:09:07.609306 6548 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
W20260811 08:09:07.609720 6548 consensus_peers.cc:487] T 00000000000000000000000000000000 P 1e9672280b3347719b31d040efc4c7ee -> Peer e7239e9050e74949bd7be2f23f82fc50 (127.27.243.253:41319): Couldn't send request to peer e7239e9050e74949bd7be2f23f82fc50. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260811 08:09:07.610615 7341 raft_consensus.cc:2229] T 00000000000000000000000000000000 P e7239e9050e74949bd7be2f23f82fc50 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:09:07.610702 7341 raft_consensus.cc:2258] T 00000000000000000000000000000000 P e7239e9050e74949bd7be2f23f82fc50 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:09:07.610754 7341 tablet_replica.cc:330] T 00000000000000000000000000000000 P e7239e9050e74949bd7be2f23f82fc50: stopping tablet replica
I20260811 08:09:07.623147 7341 master.cc:552] Master@127.27.243.253:41319 shutdown complete.
I20260811 08:09:07.623193 7341 master_runner.cc:305] Clearing existing system tablet
I20260811 08:09:07.623315 7341 fs_manager.cc:359] Metadata directory not provided
I20260811 08:09:07.623356 7341 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:09:07.623939 7341 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.001s sys 0.000s
I20260811 08:09:07.624449 7533 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:07.624563 7341 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:09:07.624614 7341 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:07.624631 7341 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/master-1/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/master-1/wal
uuid: "e7239e9050e74949bd7be2f23f82fc50"
format_stamp: "Formatted at 2026-08-11 08:09:07 on dist-test-slave-7lbf"
server_key: "e0725be499248c967c9d6fd3c2753325"
server_key_iv: "25f501c85011dd41e09638b219c6116c"
server_key_version: "encryptionkey@0"
I20260811 08:09:07.625340 7341 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P e7239e9050e74949bd7be2f23f82fc50: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:09:07.626822 7341 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P e7239e9050e74949bd7be2f23f82fc50: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260811 08:09:07.626900 7341 log.cc:1196] T 00000000000000000000000000000000 P e7239e9050e74949bd7be2f23f82fc50: Deleting WAL directory at /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260811 08:09:07.627104 7341 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P e7239e9050e74949bd7be2f23f82fc50: Deleting consensus metadata
I20260811 08:09:07.627238 7341 master_runner.cc:315] Copying system tablet from 127.27.243.254:43189
I20260811 08:09:07.627828 7341 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P e7239e9050e74949bd7be2f23f82fc50: tablet copy: Beginning tablet copy session from remote peer at address 127.27.243.254:43189
I20260811 08:09:07.634145 7335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:07.628263 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54876 (local address 127.27.243.254:43189)
0811 08:09:07.628336 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:07.628338 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:07.628463 (+ 125us) server_negotiation.cc:407] Connection header received
0811 08:09:07.628535 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:07.628536 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:07.628548 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:07.628610 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:07.628949 (+ 339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:07.629642 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:07.630405 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:07.630622 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:07.630686 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:07.631625 (+ 939us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:09:07.631626 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:09:07.631627 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:09:07.631634 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:09:07.632959 (+ 1325us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:07.633291 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:07.633292 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:07.633292 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:07.633354 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:07.633593 (+ 239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:07.633594 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:07.633594 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:07.633711 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:09:07.633779 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 08:09:07.633958 (+ 179us) server_negotiation.cc:299] Negotiation successful
0811 08:09:07.634049 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260811 08:09:07.634158 7549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:07.628214 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:43189 (local address 127.0.0.1:54876)
0811 08:09:07.628389 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:07.628400 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:07.628467 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:07.628615 (+ 148us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:07.628616 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:07.628812 (+ 196us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:09:07.628873 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:07.628875 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:07.629748 (+ 873us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:07.629749 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:07.630318 (+ 569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:07.630321 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:07.630691 (+ 370us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:07.630692 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:07.630758 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:07.631220 (+ 462us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:09:07.631225 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:09:07.631532 (+ 307us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:09:07.633042 (+ 1510us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:09:07.633043 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:09:07.633044 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:09:07.633223 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:09:07.633412 (+ 189us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:09:07.633413 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:09:07.633414 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:09:07.633476 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:09:07.633777 (+ 301us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:09:07.633778 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:09:07.633827 (+ 49us) client_negotiation.cc:769] Sending connection context
0811 08:09:07.633929 (+ 102us) client_negotiation.cc:240] Negotiation successful
0811 08:09:07.634041 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":86,"threads_started":1}
I20260811 08:09:07.634490 6599 tablet_copy_service.cc:140] P 1e9672280b3347719b31d040efc4c7ee: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer e7239e9050e74949bd7be2f23f82fc50 ({username='oryx', principal='oryx/127.27.243.253@KRBTEST.COM'} at 127.0.0.1:54876)
I20260811 08:09:07.634605 6599 tablet_copy_service.cc:161] P 1e9672280b3347719b31d040efc4c7ee: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer e7239e9050e74949bd7be2f23f82fc50 at {username='oryx', principal='oryx/127.27.243.253@KRBTEST.COM'} at 127.0.0.1:54876: session id = e7239e9050e74949bd7be2f23f82fc50-00000000000000000000000000000000
I20260811 08:09:07.635331 6599 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 1e9672280b3347719b31d040efc4c7ee: Tablet Copy: opened 0 blocks and 1 log segments
I20260811 08:09:07.635922 7341 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260811 08:09:07.636811 7341 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P e7239e9050e74949bd7be2f23f82fc50: tablet copy: Starting download of 0 data blocks...
I20260811 08:09:07.636948 7341 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P e7239e9050e74949bd7be2f23f82fc50: tablet copy: Starting download of 1 WAL segments...
I20260811 08:09:07.637816 7341 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P e7239e9050e74949bd7be2f23f82fc50: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260811 08:09:07.638633 6599 tablet_copy_service.cc:342] P 1e9672280b3347719b31d040efc4c7ee: Request end of tablet copy session e7239e9050e74949bd7be2f23f82fc50-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.27.243.253@KRBTEST.COM'} at 127.0.0.1:54876
I20260811 08:09:07.638689 6599 tablet_copy_service.cc:433] P 1e9672280b3347719b31d040efc4c7ee: ending tablet copy session e7239e9050e74949bd7be2f23f82fc50-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer e7239e9050e74949bd7be2f23f82fc50
I20260811 08:09:07.641099 7341 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:09:07.642215 7554 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:09:07.642170 7550 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:09:07.642191 7551 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:09:07.642457 7341 server_base.cc:1034] running on GCE node
I20260811 08:09:07.642553 7341 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:09:07.642695 7341 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:09:07.643828 7341 hybrid_clock.cc:648] HybridClock initialized: now 1786435747643812 us; error 32 us; skew 500 ppm
Aug 11 08:09:07 dist-test-slave-7lbf krb5kdc[6486](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435747, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.243.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:09:07.645232 7341 init.cc:377] Logged in from keytab as oryx/127.27.243.253@KRBTEST.COM (short username oryx)
I20260811 08:09:07.645479 7341 webserver.cc:460] Webserver started at http://127.27.243.253:39871/ using document root <none> and password file <none>
I20260811 08:09:07.645613 7341 fs_manager.cc:359] Metadata directory not provided
I20260811 08:09:07.645644 7341 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:09:07.646188 7341 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.000s sys 0.001s
I20260811 08:09:07.646654 7565 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:07.646785 7341 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:07.646854 7341 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/master-1/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/master-1/wal
uuid: "e7239e9050e74949bd7be2f23f82fc50"
format_stamp: "Formatted at 2026-08-11 08:09:07 on dist-test-slave-7lbf"
server_key: "e0725be499248c967c9d6fd3c2753325"
server_key_iv: "25f501c85011dd41e09638b219c6116c"
server_key_version: "encryptionkey@0"
I20260811 08:09:07.646914 7341 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:09:07.661195 7341 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:09:07.662993 7341 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:09:07.666599 7341 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.253:41319
I20260811 08:09:07.666898 7650 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.253:41319 every 8 connection(s)
I20260811 08:09:07.667058 7341 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/master-1/data/info.pb
I20260811 08:09:07.667810 7653 sys_catalog.cc:263] Verifying existing consensus state
I20260811 08:09:07.668215 7653 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e7239e9050e74949bd7be2f23f82fc50: Bootstrap starting.
I20260811 08:09:07.670670 7653 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e7239e9050e74949bd7be2f23f82fc50: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 08:09:07.670869 7653 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e7239e9050e74949bd7be2f23f82fc50: Bootstrap complete.
I20260811 08:09:07.671053 7653 raft_consensus.cc:348] T 00000000000000000000000000000000 P e7239e9050e74949bd7be2f23f82fc50 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "1e9672280b3347719b31d040efc4c7ee" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 43189 } } peers { permanent_uuid: "e7239e9050e74949bd7be2f23f82fc50" member_type: NON_VOTER last_known_addr { host: "127.27.243.253" port: 41319 } attrs { promote: true } }
I20260811 08:09:07.671123 7653 raft_consensus.cc:729] T 00000000000000000000000000000000 P e7239e9050e74949bd7be2f23f82fc50 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e7239e9050e74949bd7be2f23f82fc50, State: Initialized, Role: LEARNER
I20260811 08:09:07.671159 7653 consensus_queue.cc:260] T 00000000000000000000000000000000 P e7239e9050e74949bd7be2f23f82fc50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "1e9672280b3347719b31d040efc4c7ee" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 43189 } } peers { permanent_uuid: "e7239e9050e74949bd7be2f23f82fc50" member_type: NON_VOTER last_known_addr { host: "127.27.243.253" port: 41319 } attrs { promote: true } }
I20260811 08:09:07.671331 7653 sys_catalog.cc:564] T 00000000000000000000000000000000 P e7239e9050e74949bd7be2f23f82fc50 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:09:07.671324 7656 sys_catalog.cc:455] T 00000000000000000000000000000000 P e7239e9050e74949bd7be2f23f82fc50 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "1e9672280b3347719b31d040efc4c7ee" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 43189 } } peers { permanent_uuid: "e7239e9050e74949bd7be2f23f82fc50" member_type: NON_VOTER last_known_addr { host: "127.27.243.253" port: 41319 } attrs { promote: true } } }
I20260811 08:09:07.671408 7656 sys_catalog.cc:458] T 00000000000000000000000000000000 P e7239e9050e74949bd7be2f23f82fc50 [sys.catalog]: This master's current role is: LEARNER
I20260811 08:09:07.672657 7671 catalog_manager.cc:1259] Loaded cluster ID: 2e14b5917f2040f497e9ee9cf3e0af5e
I20260811 08:09:07.672700 7671 catalog_manager.cc:1552] T 00000000000000000000000000000000 P e7239e9050e74949bd7be2f23f82fc50: loading cluster ID for follower catalog manager: success
I20260811 08:09:07.673905 7671 catalog_manager.cc:1574] T 00000000000000000000000000000000 P e7239e9050e74949bd7be2f23f82fc50: acquiring CA information for follower catalog manager: success
I20260811 08:09:07.674175 7671 catalog_manager.cc:1602] T 00000000000000000000000000000000 P e7239e9050e74949bd7be2f23f82fc50: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 08:09:07.687279 7672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:07.680131 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49566 (local address 127.27.243.253:41319)
0811 08:09:07.680223 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:07.680225 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:07.680258 (+ 33us) server_negotiation.cc:407] Connection header received
0811 08:09:07.680279 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:07.680279 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:07.680287 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:07.680344 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:07.681076 (+ 732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:07.681750 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:07.682753 (+ 1003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:07.682995 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:07.683051 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:07.684470 (+ 1419us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:09:07.684471 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:09:07.684472 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:09:07.684478 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:09:07.686036 (+ 1558us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:07.686478 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:07.686478 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:07.686479 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:07.686532 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:07.686750 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:07.686751 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:07.686751 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:07.686900 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:09:07.686978 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 08:09:07.687139 (+ 161us) server_negotiation.cc:299] Negotiation successful
0811 08:09:07.687199 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75,"thread_start_us":43,"threads_started":1}
WARNING: no policy specified for oryx/127.27.243.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.27.243.252@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.27.243.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/krb5kdc/oryx_127.27.243.252.keytab.
Entry for principal oryx/127.27.243.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/krb5kdc/oryx_127.27.243.252.keytab.
I20260811 08:09:07.718132 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.243.252:45529
--webserver_interface=127.27.243.252
--webserver_port=0
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/krb5kdc/oryx_127.27.243.252.keytab
--principal=oryx/127.27.243.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:37793
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.243.254:43189,127.27.243.253:41319,127.27.243.252:45529
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:09:07.807832 7678 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:09:07.808038 7678 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:09:07.808058 7678 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:09:07.809121 7678 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:09:07.809154 7678 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:09:07.809165 7678 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:09:07.809177 7678 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:09:07.809197 7678 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:09:07.810685 7678 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:37793
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.27.243.254:43189,127.27.243.253:41319,127.27.243.252:45529
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/krb5kdc/oryx_127.27.243.252.keytab
--principal=oryx/127.27.243.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.243.252:45529
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.27.243.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7678
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:09:07.810889 7678 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:09:07.811060 7678 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:09:07.815521 7699 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:09:07.815552 7688 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:09:07.815574 7691 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:09:07.815732 7678 server_base.cc:1034] running on GCE node
I20260811 08:09:07.815972 7678 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:09:07.816234 7678 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:09:07.817378 7678 hybrid_clock.cc:648] HybridClock initialized: now 1786435747817365 us; error 30 us; skew 500 ppm
Aug 11 08:09:07 dist-test-slave-7lbf krb5kdc[6486](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435747, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.243.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:09:07.819743 7678 init.cc:377] Logged in from keytab as oryx/127.27.243.252@KRBTEST.COM (short username oryx)
I20260811 08:09:07.820150 7678 webserver.cc:460] Webserver started at http://127.27.243.252:44133/ using document root <none> and password file <none>
I20260811 08:09:07.820372 7678 fs_manager.cc:359] Metadata directory not provided
I20260811 08:09:07.820420 7678 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:09:07.820544 7678 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:09:07.821607 7678 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/master-2/data/instance:
uuid: "50172d9ed73e463c9f5d4a120c34be6d"
format_stamp: "Formatted at 2026-08-11 08:09:07 on dist-test-slave-7lbf"
server_key: "a109d14bf36ea9c4f36a5245cb71b21e"
server_key_iv: "a86d409f333982efdfa89406167532c3"
server_key_version: "encryptionkey@0"
I20260811 08:09:07.821950 7678 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/master-2/wal/instance:
uuid: "50172d9ed73e463c9f5d4a120c34be6d"
format_stamp: "Formatted at 2026-08-11 08:09:07 on dist-test-slave-7lbf"
server_key: "a109d14bf36ea9c4f36a5245cb71b21e"
server_key_iv: "a86d409f333982efdfa89406167532c3"
server_key_version: "encryptionkey@0"
I20260811 08:09:07.823200 7678 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:09:07.823853 7712 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:07.824003 7678 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:07.824082 7678 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/master-2/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/master-2/wal
uuid: "50172d9ed73e463c9f5d4a120c34be6d"
format_stamp: "Formatted at 2026-08-11 08:09:07 on dist-test-slave-7lbf"
server_key: "a109d14bf36ea9c4f36a5245cb71b21e"
server_key_iv: "a86d409f333982efdfa89406167532c3"
server_key_version: "encryptionkey@0"
I20260811 08:09:07.824146 7678 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:09:07.835176 7678 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:09:07.836704 7678 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:09:07.836822 7678 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:09:07.840584 7678 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.252:45529
I20260811 08:09:07.840624 7802 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.252:45529 every 8 connection(s)
I20260811 08:09:07.840919 7678 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/master-2/data/info.pb
I20260811 08:09:07.841948 7803 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:09:07.843484 7803 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.243.254" port: 43189 } has no permanent_uuid. Determining permanent_uuid...
I20260811 08:09:07.843787 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 7678
Aug 11 08:09:07 dist-test-slave-7lbf krb5kdc[6486](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435747, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.243.252@KRBTEST.COM for oryx/127.27.243.254@KRBTEST.COM
Aug 11 08:09:07 dist-test-slave-7lbf krb5kdc[6486](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435745, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.27.243.252@KRBTEST.COM
I20260811 08:09:07.853564 7335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:07.844202 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54884 (local address 127.27.243.254:43189)
0811 08:09:07.844251 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:07.844252 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:07.844481 (+ 229us) server_negotiation.cc:407] Connection header received
0811 08:09:07.844969 (+ 488us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:07.844971 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:07.844985 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:07.845046 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:07.845764 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:07.846596 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:07.847878 (+ 1282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:07.848164 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:07.848238 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:07.850497 (+ 2259us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:09:07.850499 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:09:07.850499 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:09:07.850507 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:09:07.852138 (+ 1631us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:07.852551 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:07.852553 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:07.852553 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:07.852617 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:07.852915 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:07.852916 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:07.852916 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:07.853023 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:09:07.853084 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 08:09:07.853368 (+ 284us) server_negotiation.cc:299] Negotiation successful
0811 08:09:07.853446 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260811 08:09:07.853711 7807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:07.844101 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:43189 (local address 127.0.0.1:54884)
0811 08:09:07.844344 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:07.844391 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:07.844864 (+ 473us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:07.845068 (+ 204us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:07.845071 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:07.845391 (+ 320us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:09:07.845653 (+ 262us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:07.845660 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:07.846721 (+ 1061us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:07.846722 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:07.847727 (+ 1005us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:07.847730 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:07.848261 (+ 531us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:07.848262 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:07.848365 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:07.848825 (+ 460us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:09:07.848835 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:09:07.850413 (+ 1578us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:09:07.852227 (+ 1814us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:09:07.852233 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:09:07.852235 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:09:07.852475 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:09:07.852701 (+ 226us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:09:07.852703 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:09:07.852703 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:09:07.852845 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:09:07.853087 (+ 242us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:09:07.853093 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:09:07.853228 (+ 135us) client_negotiation.cc:769] Sending connection context
0811 08:09:07.853336 (+ 108us) client_negotiation.cc:240] Negotiation successful
0811 08:09:07.853468 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":198,"thread_start_us":87,"threads_started":1}
I20260811 08:09:07.854080 7810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:07.844378 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52772 (local address 127.27.243.252:45529)
0811 08:09:07.844533 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:07.844537 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:07.844565 (+ 28us) server_negotiation.cc:407] Connection header received
0811 08:09:07.844877 (+ 312us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:07.844887 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:07.844913 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:07.845023 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:07.845772 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:07.846957 (+ 1185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:07.848002 (+ 1045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:07.848418 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:07.848473 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:07.851068 (+ 2595us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:09:07.851077 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:09:07.851077 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:09:07.851084 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:09:07.852707 (+ 1623us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:07.853076 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:07.853079 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:07.853079 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:07.853136 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:07.853324 (+ 188us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:07.853325 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:07.853325 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:07.853482 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:09:07.853900 (+ 418us) server_negotiation.cc:1035] Waiting for connection context
0811 08:09:07.853951 (+ 51us) server_negotiation.cc:299] Negotiation successful
0811 08:09:07.854014 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":127,"thread_start_us":69,"threads_started":1}
I20260811 08:09:07.854511 7803 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.243.253" port: 41319 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 08:09:07 dist-test-slave-7lbf krb5kdc[6486](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435747, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.243.252@KRBTEST.COM for oryx/127.27.243.253@KRBTEST.COM
I20260811 08:09:07.860424 7807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:07.854750 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.253:41319 (local address 127.0.0.1:49572)
0811 08:09:07.854782 (+ 32us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:07.854792 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:07.854879 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:07.854997 (+ 118us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:07.854998 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:07.855119 (+ 121us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:09:07.855147 (+ 28us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:07.855148 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:07.855768 (+ 620us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:07.855769 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:07.856267 (+ 498us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:07.856269 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:07.856680 (+ 411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:07.856681 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:07.856749 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:07.857111 (+ 362us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:09:07.857115 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:09:07.858338 (+ 1223us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:09:07.859550 (+ 1212us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:09:07.859551 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:09:07.859551 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:09:07.859697 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:09:07.859883 (+ 186us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:09:07.859883 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:09:07.859884 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:09:07.859936 (+ 52us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:09:07.860141 (+ 205us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:09:07.860142 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:09:07.860191 (+ 49us) client_negotiation.cc:769] Sending connection context
0811 08:09:07.860249 (+ 58us) client_negotiation.cc:240] Negotiation successful
0811 08:09:07.860335 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":18}
I20260811 08:09:07.860445 7672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:07.854815 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49572 (local address 127.27.243.253:41319)
0811 08:09:07.854860 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:07.854862 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:07.854870 (+ 8us) server_negotiation.cc:407] Connection header received
0811 08:09:07.854928 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:07.854930 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:07.854942 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:07.854994 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:07.855217 (+ 223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:07.855703 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:07.856339 (+ 636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:07.856591 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:07.856663 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:07.858414 (+ 1751us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:09:07.858415 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:09:07.858415 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:09:07.858423 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:09:07.859481 (+ 1058us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:07.859755 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:07.859755 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:07.859756 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:07.859809 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:07.859985 (+ 176us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:07.859986 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:07.859986 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:07.860089 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:09:07.860143 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 08:09:07.860278 (+ 135us) server_negotiation.cc:299] Negotiation successful
0811 08:09:07.860361 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 08:09:07.860888 7803 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.243.252" port: 45529 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 08:09:07 dist-test-slave-7lbf krb5kdc[6486](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435747, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.243.252@KRBTEST.COM for oryx/127.27.243.252@KRBTEST.COM
I20260811 08:09:07.866506 7807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:07.861097 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.252:45529 (local address 127.0.0.1:52786)
0811 08:09:07.861146 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:07.861156 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:07.861202 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:07.861288 (+ 86us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:07.861289 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:07.861391 (+ 102us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:09:07.861416 (+ 25us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:07.861417 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:07.862178 (+ 761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:07.862179 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:07.862651 (+ 472us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:07.862652 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:07.863023 (+ 371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:07.863024 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:07.863059 (+ 35us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:07.863350 (+ 291us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:09:07.863354 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:09:07.864408 (+ 1054us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:09:07.865774 (+ 1366us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:09:07.865775 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:09:07.865775 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:09:07.865939 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:09:07.866089 (+ 150us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:09:07.866089 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:09:07.866089 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:09:07.866132 (+ 43us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:09:07.866293 (+ 161us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:09:07.866293 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:09:07.866324 (+ 31us) client_negotiation.cc:769] Sending connection context
0811 08:09:07.866362 (+ 38us) client_negotiation.cc:240] Negotiation successful
0811 08:09:07.866430 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260811 08:09:07.866573 7810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:07.861129 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52786 (local address 127.27.243.252:45529)
0811 08:09:07.861165 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:07.861166 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:07.861191 (+ 25us) server_negotiation.cc:407] Connection header received
0811 08:09:07.861238 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:07.861239 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:07.861247 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:07.861285 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:07.861459 (+ 174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:07.862030 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:07.862747 (+ 717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:07.862958 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:07.863017 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:07.864479 (+ 1462us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:09:07.864480 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:09:07.864480 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:09:07.864486 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:09:07.865685 (+ 1199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:07.865999 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:07.866000 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:07.866000 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:07.866045 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:07.866171 (+ 126us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:07.866171 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:07.866172 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:07.866255 (+ 83us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:09:07.866295 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0811 08:09:07.866384 (+ 89us) server_negotiation.cc:299] Negotiation successful
0811 08:09:07.866473 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":33,"server-negotiator.queue_time_us":18}
I20260811 08:09:07.867960 7803 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 50172d9ed73e463c9f5d4a120c34be6d: Bootstrap starting.
I20260811 08:09:07.868799 7803 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 50172d9ed73e463c9f5d4a120c34be6d: Neither blocks nor log segments found. Creating new log.
I20260811 08:09:07.869059 7803 log.cc:824] T 00000000000000000000000000000000 P 50172d9ed73e463c9f5d4a120c34be6d: Log is configured to *not* fsync() on all Append() calls
I20260811 08:09:07.869791 7803 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 50172d9ed73e463c9f5d4a120c34be6d: No bootstrap required, opened a new log
I20260811 08:09:07.871304 7803 raft_consensus.cc:348] T 00000000000000000000000000000000 P 50172d9ed73e463c9f5d4a120c34be6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e9672280b3347719b31d040efc4c7ee" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 43189 } } peers { permanent_uuid: "e7239e9050e74949bd7be2f23f82fc50" member_type: VOTER last_known_addr { host: "127.27.243.253" port: 41319 } } peers { permanent_uuid: "50172d9ed73e463c9f5d4a120c34be6d" member_type: VOTER last_known_addr { host: "127.27.243.252" port: 45529 } }
I20260811 08:09:07.871426 7803 raft_consensus.cc:374] T 00000000000000000000000000000000 P 50172d9ed73e463c9f5d4a120c34be6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:09:07.871447 7803 raft_consensus.cc:729] T 00000000000000000000000000000000 P 50172d9ed73e463c9f5d4a120c34be6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50172d9ed73e463c9f5d4a120c34be6d, State: Initialized, Role: FOLLOWER
I20260811 08:09:07.871629 7803 consensus_queue.cc:260] T 00000000000000000000000000000000 P 50172d9ed73e463c9f5d4a120c34be6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e9672280b3347719b31d040efc4c7ee" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 43189 } } peers { permanent_uuid: "e7239e9050e74949bd7be2f23f82fc50" member_type: VOTER last_known_addr { host: "127.27.243.253" port: 41319 } } peers { permanent_uuid: "50172d9ed73e463c9f5d4a120c34be6d" member_type: VOTER last_known_addr { host: "127.27.243.252" port: 45529 } }
I20260811 08:09:07.871927 7803 sys_catalog.cc:564] T 00000000000000000000000000000000 P 50172d9ed73e463c9f5d4a120c34be6d [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:09:07.871896 7812 sys_catalog.cc:455] T 00000000000000000000000000000000 P 50172d9ed73e463c9f5d4a120c34be6d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e9672280b3347719b31d040efc4c7ee" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 43189 } } peers { permanent_uuid: "e7239e9050e74949bd7be2f23f82fc50" member_type: VOTER last_known_addr { host: "127.27.243.253" port: 41319 } } peers { permanent_uuid: "50172d9ed73e463c9f5d4a120c34be6d" member_type: VOTER last_known_addr { host: "127.27.243.252" port: 45529 } } }
I20260811 08:09:07.871973 7812 sys_catalog.cc:458] T 00000000000000000000000000000000 P 50172d9ed73e463c9f5d4a120c34be6d [sys.catalog]: This master's current role is: FOLLOWER
W20260811 08:09:07.873461 7836 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 50172d9ed73e463c9f5d4a120c34be6d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 08:09:07.873545 7836 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 08:09:07.875767 7678 master_runner.cc:428] Detected that this master 50172d9ed73e463c9f5d4a120c34be6d is joining an existing cluster
I20260811 08:09:07.875829 7678 master_runner.cc:432] Initiating AddMaster RPC to add 127.27.243.252:45529
I20260811 08:09:07.883252 7672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:07.876956 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49574 (local address 127.27.243.253:41319)
0811 08:09:07.877006 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:07.877008 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:07.877502 (+ 494us) server_negotiation.cc:407] Connection header received
0811 08:09:07.877634 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:07.877635 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:07.877645 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:07.877673 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:07.878158 (+ 485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:07.878774 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:07.879502 (+ 728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:07.879774 (+ 272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:07.879835 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:07.880981 (+ 1146us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:09:07.880983 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:09:07.880983 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:09:07.880989 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:09:07.882224 (+ 1235us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:07.882590 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:07.882591 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:07.882591 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:07.882634 (+ 43us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:07.882825 (+ 191us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:07.882826 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:07.882826 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:07.882928 (+ 102us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:09:07.882973 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0811 08:09:07.883130 (+ 157us) server_negotiation.cc:299] Negotiation successful
0811 08:09:07.883189 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260811 08:09:07.883363 7844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:07.877118 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.253:41319 (local address 127.0.0.1:49574)
0811 08:09:07.877443 (+ 325us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:07.877453 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:07.877557 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:07.877734 (+ 177us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:07.877735 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:07.878001 (+ 266us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:09:07.878074 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:07.878076 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:07.878851 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:07.878852 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:07.879429 (+ 577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:07.879430 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:07.879857 (+ 427us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:07.879858 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:07.879918 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:07.880484 (+ 566us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:09:07.880488 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:09:07.880904 (+ 416us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:09:07.882299 (+ 1395us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:09:07.882300 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:09:07.882300 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:09:07.882524 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:09:07.882684 (+ 160us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:09:07.882685 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:09:07.882685 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:09:07.882751 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:09:07.882981 (+ 230us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:09:07.882982 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:09:07.883025 (+ 43us) client_negotiation.cc:769] Sending connection context
0811 08:09:07.883103 (+ 78us) client_negotiation.cc:240] Negotiation successful
0811 08:09:07.883199 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":310,"thread_start_us":89,"threads_started":1}
I20260811 08:09:07.888751 7810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:07.877363 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52788 (local address 127.27.243.252:45529)
0811 08:09:07.877396 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:07.877398 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:07.883483 (+ 6085us) server_negotiation.cc:407] Connection header received
0811 08:09:07.883561 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:07.883562 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:07.883571 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:07.883595 (+ 24us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:07.884080 (+ 485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:07.884515 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:07.885464 (+ 949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:07.885728 (+ 264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:07.885778 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:07.886579 (+ 801us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:09:07.886580 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:09:07.886580 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:09:07.886585 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:09:07.887721 (+ 1136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:07.888062 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:07.888063 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:07.888063 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:07.888104 (+ 41us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:07.888254 (+ 150us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:07.888255 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:07.888255 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:07.888359 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:09:07.888404 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0811 08:09:07.888540 (+ 136us) server_negotiation.cc:299] Negotiation successful
0811 08:09:07.888658 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":63,"server-negotiator.queue_time_us":18}
I20260811 08:09:07.888751 7844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:07.877322 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.252:45529 (local address 127.0.0.1:52788)
0811 08:09:07.883428 (+ 6106us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:07.883437 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:07.883503 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:07.883814 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:07.883814 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:07.883969 (+ 155us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:09:07.884020 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:07.884022 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:07.884587 (+ 565us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:07.884588 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:07.885377 (+ 789us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:07.885380 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:07.885788 (+ 408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:07.885796 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:07.885861 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:07.886175 (+ 314us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:09:07.886179 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:09:07.886501 (+ 322us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:09:07.887796 (+ 1295us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:09:07.887797 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:09:07.887798 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:09:07.888001 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:09:07.888139 (+ 138us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:09:07.888140 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:09:07.888140 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:09:07.888206 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:09:07.888411 (+ 205us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:09:07.888412 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:09:07.888452 (+ 40us) client_negotiation.cc:769] Sending connection context
0811 08:09:07.888524 (+ 72us) client_negotiation.cc:240] Negotiation successful
0811 08:09:07.888617 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6096,"thread_start_us":61,"threads_started":1}
I20260811 08:09:07.904819 7843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:07.876863 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:43189 (local address 127.0.0.1:54888)
0811 08:09:07.877258 (+ 395us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:07.877267 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:07.877360 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:07.877532 (+ 172us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:07.877532 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:07.877692 (+ 160us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:09:07.877766 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:07.877767 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:07.878567 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:07.878568 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:07.879494 (+ 926us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:07.879497 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:07.879938 (+ 441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:07.879939 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:07.880012 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:07.902055 (+ 22043us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:09:07.902060 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:09:07.902399 (+ 339us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:09:07.903828 (+ 1429us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:09:07.903829 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:09:07.903830 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:09:07.904000 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:09:07.904187 (+ 187us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:09:07.904188 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:09:07.904188 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:09:07.904244 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:09:07.904469 (+ 225us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:09:07.904471 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:09:07.904533 (+ 62us) client_negotiation.cc:769] Sending connection context
0811 08:09:07.904590 (+ 57us) client_negotiation.cc:240] Negotiation successful
0811 08:09:07.904706 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":375,"thread_start_us":89,"threads_started":1}
I20260811 08:09:07.904804 7335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:07.876940 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54888 (local address 127.27.243.254:43189)
0811 08:09:07.877059 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:07.877061 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:07.877320 (+ 259us) server_negotiation.cc:407] Connection header received
0811 08:09:07.877442 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:07.877443 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:07.877454 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:07.877503 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:07.877834 (+ 331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:07.878481 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:07.879583 (+ 1102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:07.879870 (+ 287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:07.879926 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:07.902510 (+ 22584us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:09:07.902512 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:09:07.902513 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:09:07.902523 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:09:07.903748 (+ 1225us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:07.904071 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:07.904072 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:07.904073 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:07.904130 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:07.904292 (+ 162us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:07.904293 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:07.904294 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:07.904410 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:09:07.904467 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 08:09:07.904623 (+ 156us) server_negotiation.cc:299] Negotiation successful
0811 08:09:07.904704 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260811 08:09:07.905442 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 6670
Aug 11 08:09:07 dist-test-slave-7lbf krb5kdc[6486](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435745, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.243.254@KRBTEST.COM for oryx/127.27.243.252@KRBTEST.COM
I20260811 08:09:07.938978 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.243.193:44819
--local_ip_for_outbound_sockets=127.27.243.193
--tserver_master_addrs=127.27.243.254:43189
--webserver_port=44293
--webserver_interface=127.27.243.193
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/krb5kdc/oryx_127.27.243.193.keytab
--principal=oryx/127.27.243.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:37793
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.27.243.254:43189,127.27.243.253:41319
--tserver_master_addrs=127.27.243.254:43189,127.27.243.253:41319,127.27.243.252:45529 with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 08:09:07.941807 7520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:07.933172 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.252:45529 (local address 127.0.0.1:52790)
0811 08:09:07.933267 (+ 95us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:07.933282 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:07.933339 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:07.934455 (+ 1116us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:07.934457 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:07.934651 (+ 194us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:09:07.934712 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:07.934714 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:07.935636 (+ 922us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:07.935637 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:07.936430 (+ 793us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:07.936434 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:07.936922 (+ 488us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:07.936923 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:07.937008 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:07.937442 (+ 434us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:09:07.937447 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:09:07.939078 (+ 1631us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:09:07.940689 (+ 1611us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:09:07.940691 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:09:07.940691 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:09:07.940913 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:09:07.941124 (+ 211us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:09:07.941125 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:09:07.941125 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:09:07.941189 (+ 64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:09:07.941447 (+ 258us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:09:07.941448 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:09:07.941496 (+ 48us) client_negotiation.cc:769] Sending connection context
0811 08:09:07.941599 (+ 103us) client_negotiation.cc:240] Negotiation successful
0811 08:09:07.941708 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":68}
I20260811 08:09:07.941804 7810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:07.934244 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52790 (local address 127.27.243.252:45529)
0811 08:09:07.934285 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:07.934287 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:07.934296 (+ 9us) server_negotiation.cc:407] Connection header received
0811 08:09:07.934337 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:07.934338 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:07.934348 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:07.934407 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:07.934797 (+ 390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:07.935549 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:07.936524 (+ 975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:07.936836 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:07.936906 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:07.939172 (+ 2266us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:09:07.939174 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:09:07.939174 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:09:07.939180 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:09:07.940607 (+ 1427us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:07.940992 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:07.940994 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:07.940994 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:07.941059 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:07.941249 (+ 190us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:07.941250 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:07.941250 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:07.941378 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:09:07.941445 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 08:09:07.941634 (+ 189us) server_negotiation.cc:299] Negotiation successful
0811 08:09:07.941707 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 08:09:07.942565 6567 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.27.243.252:45529: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "50172d9ed73e463c9f5d4a120c34be6d"
member_type: NON_VOTER
last_known_addr {
host: "127.27.243.252"
port: 45529
}
attrs {
promote: true
}
}
dest_uuid: "1e9672280b3347719b31d040efc4c7ee"
cas_config_opid_index: 5
I20260811 08:09:07.942814 6567 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1e9672280b3347719b31d040efc4c7ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "1e9672280b3347719b31d040efc4c7ee" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 43189 } } peers { permanent_uuid: "e7239e9050e74949bd7be2f23f82fc50" member_type: NON_VOTER last_known_addr { host: "127.27.243.253" port: 41319 } attrs { promote: true } } peers { permanent_uuid: "50172d9ed73e463c9f5d4a120c34be6d" member_type: NON_VOTER last_known_addr { host: "127.27.243.252" port: 45529 } attrs { promote: true } }
I20260811 08:09:07.943487 7760 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 50172d9ed73e463c9f5d4a120c34be6d [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:09:07.944164 7760 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 50172d9ed73e463c9f5d4a120c34be6d [term 1 FOLLOWER]: Refusing update from remote peer 1e9672280b3347719b31d040efc4c7ee: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260811 08:09:07.944401 7527 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 1e9672280b3347719b31d040efc4c7ee [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 50172d9ed73e463c9f5d4a120c34be6d (127.27.243.252) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "1e9672280b3347719b31d040efc4c7ee" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 43189 } } peers { permanent_uuid: "e7239e9050e74949bd7be2f23f82fc50" member_type: NON_VOTER last_known_addr { host: "127.27.243.253" port: 41319 } attrs { promote: true } } peers { permanent_uuid: "50172d9ed73e463c9f5d4a120c34be6d" member_type: NON_VOTER last_known_addr { host: "127.27.243.252" port: 45529 } attrs { promote: true } } }
I20260811 08:09:07.945369 7527 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.27.243.252:45529
I20260811 08:09:07.945456 7527 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1e9672280b3347719b31d040efc4c7ee [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "1e9672280b3347719b31d040efc4c7ee" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "1e9672280b3347719b31d040efc4c7ee" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 43189 } } peers { permanent_uuid: "e7239e9050e74949bd7be2f23f82fc50" member_type: NON_VOTER last_known_addr { host: "127.27.243.253" port: 41319 } attrs { promote: true } } peers { permanent_uuid: "50172d9ed73e463c9f5d4a120c34be6d" member_type: NON_VOTER last_known_addr { host: "127.27.243.252" port: 45529 } attrs { promote: true } } }
I20260811 08:09:07.945535 7527 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1e9672280b3347719b31d040efc4c7ee [sys.catalog]: This master's current role is: LEADER
I20260811 08:09:07.945789 7678 master.cc:537] Master@127.27.243.252:45529 shutting down...
I20260811 08:09:07.945919 7528 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 1e9672280b3347719b31d040efc4c7ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "50172d9ed73e463c9f5d4a120c34be6d" member_type: NON_VOTER last_known_addr { host: "127.27.243.252" port: 45529 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 08:09:07.946578 6548 consensus_peers.cc:487] T 00000000000000000000000000000000 P 1e9672280b3347719b31d040efc4c7ee -> Peer 50172d9ed73e463c9f5d4a120c34be6d (127.27.243.252:45529): Couldn't send request to peer 50172d9ed73e463c9f5d4a120c34be6d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260811 08:09:07.948820 7678 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 50172d9ed73e463c9f5d4a120c34be6d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:09:07.948916 7678 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 50172d9ed73e463c9f5d4a120c34be6d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:09:07.948971 7678 tablet_replica.cc:330] T 00000000000000000000000000000000 P 50172d9ed73e463c9f5d4a120c34be6d: stopping tablet replica
I20260811 08:09:07.950189 7520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:07.943251 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.253:41319 (local address 127.0.0.1:49586)
0811 08:09:07.943282 (+ 31us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:07.943293 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:07.943330 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:07.944754 (+ 1424us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:07.944755 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:07.944757 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:09:07.944794 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:07.944796 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:07.947392 (+ 2596us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:07.947394 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:07.949043 (+ 1649us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:07.949046 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:07.949977 (+ 931us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:07.949978 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:07.950026 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:07.950044 (+ 18us) client_negotiation.cc:769] Sending connection context
0811 08:09:07.950087 (+ 43us) client_negotiation.cc:240] Negotiation successful
0811 08:09:07.950125 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16}
I20260811 08:09:07.950207 7672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:07.944343 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49586 (local address 127.27.243.253:41319)
0811 08:09:07.944398 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:07.944400 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:07.944410 (+ 10us) server_negotiation.cc:407] Connection header received
0811 08:09:07.944437 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:07.944438 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:07.944461 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:07.944526 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:09:07.944882 (+ 356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:07.945597 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:07.949251 (+ 3654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:07.949824 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:07.949866 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:07.949929 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 08:09:07.950111 (+ 182us) server_negotiation.cc:299] Negotiation successful
0811 08:09:07.950152 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260811 08:09:07.950681 7609 raft_consensus.cc:1261] T 00000000000000000000000000000000 P e7239e9050e74949bd7be2f23f82fc50 [term 1 LEARNER]: Refusing update from remote peer 1e9672280b3347719b31d040efc4c7ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260811 08:09:07.950866 7528 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 1e9672280b3347719b31d040efc4c7ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7239e9050e74949bd7be2f23f82fc50" member_type: NON_VOTER last_known_addr { host: "127.27.243.253" port: 41319 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260811 08:09:07.951510 7609 raft_consensus.cc:2932] T 00000000000000000000000000000000 P e7239e9050e74949bd7be2f23f82fc50 [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 50172d9ed73e463c9f5d4a120c34be6d (127.27.243.252) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "1e9672280b3347719b31d040efc4c7ee" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 43189 } } peers { permanent_uuid: "e7239e9050e74949bd7be2f23f82fc50" member_type: NON_VOTER last_known_addr { host: "127.27.243.253" port: 41319 } attrs { promote: true } } peers { permanent_uuid: "50172d9ed73e463c9f5d4a120c34be6d" member_type: NON_VOTER last_known_addr { host: "127.27.243.252" port: 45529 } attrs { promote: true } } }
I20260811 08:09:07.952679 7853 sys_catalog.cc:455] T 00000000000000000000000000000000 P e7239e9050e74949bd7be2f23f82fc50 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "1e9672280b3347719b31d040efc4c7ee" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "1e9672280b3347719b31d040efc4c7ee" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 43189 } } peers { permanent_uuid: "e7239e9050e74949bd7be2f23f82fc50" member_type: NON_VOTER last_known_addr { host: "127.27.243.253" port: 41319 } attrs { promote: true } } peers { permanent_uuid: "50172d9ed73e463c9f5d4a120c34be6d" member_type: NON_VOTER last_known_addr { host: "127.27.243.252" port: 45529 } attrs { promote: true } } }
I20260811 08:09:07.952756 7528 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 1e9672280b3347719b31d040efc4c7ee: attempting to promote NON_VOTER e7239e9050e74949bd7be2f23f82fc50 to VOTER
I20260811 08:09:07.952836 7853 sys_catalog.cc:458] T 00000000000000000000000000000000 P e7239e9050e74949bd7be2f23f82fc50 [sys.catalog]: This master's current role is: LEARNER
I20260811 08:09:07.952829 7656 sys_catalog.cc:455] T 00000000000000000000000000000000 P e7239e9050e74949bd7be2f23f82fc50 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1e9672280b3347719b31d040efc4c7ee. Latest consensus state: current_term: 1 leader_uuid: "1e9672280b3347719b31d040efc4c7ee" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "1e9672280b3347719b31d040efc4c7ee" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 43189 } } peers { permanent_uuid: "e7239e9050e74949bd7be2f23f82fc50" member_type: NON_VOTER last_known_addr { host: "127.27.243.253" port: 41319 } attrs { promote: true } } peers { permanent_uuid: "50172d9ed73e463c9f5d4a120c34be6d" member_type: NON_VOTER last_known_addr { host: "127.27.243.252" port: 45529 } attrs { promote: true } } }
I20260811 08:09:07.952972 7656 sys_catalog.cc:458] T 00000000000000000000000000000000 P e7239e9050e74949bd7be2f23f82fc50 [sys.catalog]: This master's current role is: LEARNER
I20260811 08:09:07.952953 7528 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1e9672280b3347719b31d040efc4c7ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "1e9672280b3347719b31d040efc4c7ee" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 43189 } } peers { permanent_uuid: "e7239e9050e74949bd7be2f23f82fc50" member_type: VOTER last_known_addr { host: "127.27.243.253" port: 41319 } attrs { promote: false } } peers { permanent_uuid: "50172d9ed73e463c9f5d4a120c34be6d" member_type: NON_VOTER last_known_addr { host: "127.27.243.252" port: 45529 } attrs { promote: true } }
I20260811 08:09:07.953532 7520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:07.953392 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.252:45529 (local address 127.0.0.1:52802)
0811 08:09:07.953440 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:07.953484 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.252:45529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260811 08:09:07.953586 7609 raft_consensus.cc:1261] T 00000000000000000000000000000000 P e7239e9050e74949bd7be2f23f82fc50 [term 1 LEARNER]: Refusing update from remote peer 1e9672280b3347719b31d040efc4c7ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260811 08:09:07.953778 7527 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 1e9672280b3347719b31d040efc4c7ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7239e9050e74949bd7be2f23f82fc50" member_type: VOTER last_known_addr { host: "127.27.243.253" port: 41319 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260811 08:09:07.954025 7520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:07.953942 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.252:45529 (local address 127.0.0.1:52816)
0811 08:09:07.953974 (+ 32us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:07.954001 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.252:45529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":15}
W20260811 08:09:07.954186 6548 consensus_peers.cc:487] T 00000000000000000000000000000000 P 1e9672280b3347719b31d040efc4c7ee -> Peer 50172d9ed73e463c9f5d4a120c34be6d (127.27.243.252:45529): Couldn't send request to peer 50172d9ed73e463c9f5d4a120c34be6d. Status: Network error: Client connection negotiation failed: client connection to 127.27.243.252:45529: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260811 08:09:07.954396 7528 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 1e9672280b3347719b31d040efc4c7ee [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, e7239e9050e74949bd7be2f23f82fc50 (127.27.243.253) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "1e9672280b3347719b31d040efc4c7ee" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 43189 } } peers { permanent_uuid: "e7239e9050e74949bd7be2f23f82fc50" member_type: VOTER last_known_addr { host: "127.27.243.253" port: 41319 } attrs { promote: false } } peers { permanent_uuid: "50172d9ed73e463c9f5d4a120c34be6d" member_type: NON_VOTER last_known_addr { host: "127.27.243.252" port: 45529 } attrs { promote: true } } }
I20260811 08:09:07.954557 7609 raft_consensus.cc:2932] T 00000000000000000000000000000000 P e7239e9050e74949bd7be2f23f82fc50 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, e7239e9050e74949bd7be2f23f82fc50 (127.27.243.253) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "1e9672280b3347719b31d040efc4c7ee" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 43189 } } peers { permanent_uuid: "e7239e9050e74949bd7be2f23f82fc50" member_type: VOTER last_known_addr { host: "127.27.243.253" port: 41319 } attrs { promote: false } } peers { permanent_uuid: "50172d9ed73e463c9f5d4a120c34be6d" member_type: NON_VOTER last_known_addr { host: "127.27.243.252" port: 45529 } attrs { promote: true } } }
I20260811 08:09:07.955250 7528 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1e9672280b3347719b31d040efc4c7ee [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "1e9672280b3347719b31d040efc4c7ee" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "1e9672280b3347719b31d040efc4c7ee" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 43189 } } peers { permanent_uuid: "e7239e9050e74949bd7be2f23f82fc50" member_type: VOTER last_known_addr { host: "127.27.243.253" port: 41319 } attrs { promote: false } } peers { permanent_uuid: "50172d9ed73e463c9f5d4a120c34be6d" member_type: NON_VOTER last_known_addr { host: "127.27.243.252" port: 45529 } attrs { promote: true } } }
I20260811 08:09:07.955322 7528 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1e9672280b3347719b31d040efc4c7ee [sys.catalog]: This master's current role is: LEADER
I20260811 08:09:07.955461 7528 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1e9672280b3347719b31d040efc4c7ee [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "1e9672280b3347719b31d040efc4c7ee" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "1e9672280b3347719b31d040efc4c7ee" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 43189 } } peers { permanent_uuid: "e7239e9050e74949bd7be2f23f82fc50" member_type: VOTER last_known_addr { host: "127.27.243.253" port: 41319 } attrs { promote: false } } peers { permanent_uuid: "50172d9ed73e463c9f5d4a120c34be6d" member_type: NON_VOTER last_known_addr { host: "127.27.243.252" port: 45529 } attrs { promote: true } } }
I20260811 08:09:07.955523 7528 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1e9672280b3347719b31d040efc4c7ee [sys.catalog]: This master's current role is: LEADER
I20260811 08:09:07.955718 7853 sys_catalog.cc:455] T 00000000000000000000000000000000 P e7239e9050e74949bd7be2f23f82fc50 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "1e9672280b3347719b31d040efc4c7ee" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "1e9672280b3347719b31d040efc4c7ee" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 43189 } } peers { permanent_uuid: "e7239e9050e74949bd7be2f23f82fc50" member_type: VOTER last_known_addr { host: "127.27.243.253" port: 41319 } attrs { promote: false } } peers { permanent_uuid: "50172d9ed73e463c9f5d4a120c34be6d" member_type: NON_VOTER last_known_addr { host: "127.27.243.252" port: 45529 } attrs { promote: true } } }
I20260811 08:09:07.955783 7853 sys_catalog.cc:458] T 00000000000000000000000000000000 P e7239e9050e74949bd7be2f23f82fc50 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 08:09:07.962793 7678 master.cc:552] Master@127.27.243.252:45529 shutdown complete.
I20260811 08:09:07.962836 7678 master_runner.cc:305] Clearing existing system tablet
I20260811 08:09:07.962957 7678 fs_manager.cc:359] Metadata directory not provided
I20260811 08:09:07.963001 7678 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:09:07.963577 7678 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.000s sys 0.001s
I20260811 08:09:07.964020 7860 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:07.964234 7678 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:09:07.964293 7678 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:07.964318 7678 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/master-2/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/master-2/wal
uuid: "50172d9ed73e463c9f5d4a120c34be6d"
format_stamp: "Formatted at 2026-08-11 08:09:07 on dist-test-slave-7lbf"
server_key: "a109d14bf36ea9c4f36a5245cb71b21e"
server_key_iv: "a86d409f333982efdfa89406167532c3"
server_key_version: "encryptionkey@0"
I20260811 08:09:07.964908 7678 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 50172d9ed73e463c9f5d4a120c34be6d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:09:07.966118 7678 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 50172d9ed73e463c9f5d4a120c34be6d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260811 08:09:07.966182 7678 log.cc:1196] T 00000000000000000000000000000000 P 50172d9ed73e463c9f5d4a120c34be6d: Deleting WAL directory at /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260811 08:09:07.966380 7678 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 50172d9ed73e463c9f5d4a120c34be6d: Deleting consensus metadata
I20260811 08:09:07.966521 7678 master_runner.cc:315] Copying system tablet from 127.27.243.254:43189
I20260811 08:09:07.967109 7678 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 50172d9ed73e463c9f5d4a120c34be6d: tablet copy: Beginning tablet copy session from remote peer at address 127.27.243.254:43189
I20260811 08:09:07.972923 7335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:07.967433 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54894 (local address 127.27.243.254:43189)
0811 08:09:07.967476 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:07.967478 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:07.967576 (+ 98us) server_negotiation.cc:407] Connection header received
0811 08:09:07.967637 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:07.967637 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:07.967647 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:07.967694 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:07.967992 (+ 298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:07.968477 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:07.969158 (+ 681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:07.969355 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:07.969409 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:07.970330 (+ 921us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:09:07.970332 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:09:07.970332 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:09:07.970339 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:09:07.971682 (+ 1343us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:07.972094 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:07.972096 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:07.972096 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:07.972154 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:07.972317 (+ 163us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:07.972318 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:07.972318 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:07.972428 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:09:07.972485 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 08:09:07.972737 (+ 252us) server_negotiation.cc:299] Negotiation successful
0811 08:09:07.972805 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 08:09:07.972942 7872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:07.967378 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:43189 (local address 127.0.0.1:54894)
0811 08:09:07.967510 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:07.967520 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:07.967578 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:07.967697 (+ 119us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:07.967698 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:07.967869 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:09:07.967922 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:07.967923 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:07.968548 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:07.968549 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:07.969084 (+ 535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:07.969086 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:07.969423 (+ 337us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:07.969424 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:07.969492 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:07.969949 (+ 457us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:09:07.969955 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:09:07.970247 (+ 292us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:09:07.971773 (+ 1526us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:09:07.971774 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:09:07.971774 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:09:07.972009 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:09:07.972207 (+ 198us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:09:07.972208 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:09:07.972209 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:09:07.972267 (+ 58us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:09:07.972593 (+ 326us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:09:07.972594 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:09:07.972641 (+ 47us) client_negotiation.cc:769] Sending connection context
0811 08:09:07.972699 (+ 58us) client_negotiation.cc:240] Negotiation successful
0811 08:09:07.972840 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":79,"threads_started":1}
I20260811 08:09:07.973438 6599 tablet_copy_service.cc:140] P 1e9672280b3347719b31d040efc4c7ee: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 50172d9ed73e463c9f5d4a120c34be6d ({username='oryx', principal='oryx/127.27.243.252@KRBTEST.COM'} at 127.0.0.1:54894)
I20260811 08:09:07.973502 6599 tablet_copy_service.cc:161] P 1e9672280b3347719b31d040efc4c7ee: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 50172d9ed73e463c9f5d4a120c34be6d at {username='oryx', principal='oryx/127.27.243.252@KRBTEST.COM'} at 127.0.0.1:54894: session id = 50172d9ed73e463c9f5d4a120c34be6d-00000000000000000000000000000000
I20260811 08:09:07.973940 6599 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 1e9672280b3347719b31d040efc4c7ee: Tablet Copy: opened 0 blocks and 1 log segments
I20260811 08:09:07.974355 7678 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260811 08:09:07.975201 7678 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 50172d9ed73e463c9f5d4a120c34be6d: tablet copy: Starting download of 0 data blocks...
I20260811 08:09:07.975332 7678 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 50172d9ed73e463c9f5d4a120c34be6d: tablet copy: Starting download of 1 WAL segments...
I20260811 08:09:07.976004 7678 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 50172d9ed73e463c9f5d4a120c34be6d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260811 08:09:07.976696 6599 tablet_copy_service.cc:342] P 1e9672280b3347719b31d040efc4c7ee: Request end of tablet copy session 50172d9ed73e463c9f5d4a120c34be6d-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.27.243.252@KRBTEST.COM'} at 127.0.0.1:54894
I20260811 08:09:07.976748 6599 tablet_copy_service.cc:433] P 1e9672280b3347719b31d040efc4c7ee: ending tablet copy session 50172d9ed73e463c9f5d4a120c34be6d-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 50172d9ed73e463c9f5d4a120c34be6d
I20260811 08:09:07.979198 7678 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:09:07.980270 7879 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:09:07.980285 7873 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:09:07.981657 7678 server_base.cc:1034] running on GCE node
W20260811 08:09:07.986228 7874 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:09:07.986394 7678 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:09:07.986532 7678 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:09:07.987641 7678 hybrid_clock.cc:648] HybridClock initialized: now 1786435747987636 us; error 23 us; skew 500 ppm
Aug 11 08:09:07 dist-test-slave-7lbf krb5kdc[6486](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435747, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.243.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:09:07.988826 7678 init.cc:377] Logged in from keytab as oryx/127.27.243.252@KRBTEST.COM (short username oryx)
I20260811 08:09:07.989081 7678 webserver.cc:460] Webserver started at http://127.27.243.252:37961/ using document root <none> and password file <none>
I20260811 08:09:07.989194 7678 fs_manager.cc:359] Metadata directory not provided
I20260811 08:09:07.989228 7678 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:09:07.989814 7678 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.000s sys 0.001s
I20260811 08:09:07.990286 7892 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:07.990404 7678 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:07.990450 7678 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/master-2/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/master-2/wal
uuid: "50172d9ed73e463c9f5d4a120c34be6d"
format_stamp: "Formatted at 2026-08-11 08:09:07 on dist-test-slave-7lbf"
server_key: "a109d14bf36ea9c4f36a5245cb71b21e"
server_key_iv: "a86d409f333982efdfa89406167532c3"
server_key_version: "encryptionkey@0"
I20260811 08:09:07.990507 7678 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:09:08.001408 7678 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:09:08.002944 7678 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:09:08.005882 7678 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.252:45529
I20260811 08:09:08.006196 7678 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/master-2/data/info.pb
I20260811 08:09:08.006963 7975 sys_catalog.cc:263] Verifying existing consensus state
I20260811 08:09:08.007364 7975 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 50172d9ed73e463c9f5d4a120c34be6d: Bootstrap starting.
I20260811 08:09:08.009617 7975 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 50172d9ed73e463c9f5d4a120c34be6d: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 08:09:08.009800 7975 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 50172d9ed73e463c9f5d4a120c34be6d: Bootstrap complete.
I20260811 08:09:08.009987 7975 raft_consensus.cc:348] T 00000000000000000000000000000000 P 50172d9ed73e463c9f5d4a120c34be6d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "1e9672280b3347719b31d040efc4c7ee" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 43189 } } peers { permanent_uuid: "e7239e9050e74949bd7be2f23f82fc50" member_type: VOTER last_known_addr { host: "127.27.243.253" port: 41319 } attrs { promote: false } } peers { permanent_uuid: "50172d9ed73e463c9f5d4a120c34be6d" member_type: NON_VOTER last_known_addr { host: "127.27.243.252" port: 45529 } attrs { promote: true } }
I20260811 08:09:08.010059 7975 raft_consensus.cc:729] T 00000000000000000000000000000000 P 50172d9ed73e463c9f5d4a120c34be6d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 50172d9ed73e463c9f5d4a120c34be6d, State: Initialized, Role: LEARNER
I20260811 08:09:08.010097 7975 consensus_queue.cc:260] T 00000000000000000000000000000000 P 50172d9ed73e463c9f5d4a120c34be6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "1e9672280b3347719b31d040efc4c7ee" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 43189 } } peers { permanent_uuid: "e7239e9050e74949bd7be2f23f82fc50" member_type: VOTER last_known_addr { host: "127.27.243.253" port: 41319 } attrs { promote: false } } peers { permanent_uuid: "50172d9ed73e463c9f5d4a120c34be6d" member_type: NON_VOTER last_known_addr { host: "127.27.243.252" port: 45529 } attrs { promote: true } }
I20260811 08:09:08.010262 7975 sys_catalog.cc:564] T 00000000000000000000000000000000 P 50172d9ed73e463c9f5d4a120c34be6d [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:09:08.010263 7978 sys_catalog.cc:455] T 00000000000000000000000000000000 P 50172d9ed73e463c9f5d4a120c34be6d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "1e9672280b3347719b31d040efc4c7ee" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 43189 } } peers { permanent_uuid: "e7239e9050e74949bd7be2f23f82fc50" member_type: VOTER last_known_addr { host: "127.27.243.253" port: 41319 } attrs { promote: false } } peers { permanent_uuid: "50172d9ed73e463c9f5d4a120c34be6d" member_type: NON_VOTER last_known_addr { host: "127.27.243.252" port: 45529 } attrs { promote: true } } }
I20260811 08:09:08.010492 7978 sys_catalog.cc:458] T 00000000000000000000000000000000 P 50172d9ed73e463c9f5d4a120c34be6d [sys.catalog]: This master's current role is: LEARNER
I20260811 08:09:08.011667 7993 catalog_manager.cc:1259] Loaded cluster ID: 2e14b5917f2040f497e9ee9cf3e0af5e
I20260811 08:09:08.011749 7993 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 50172d9ed73e463c9f5d4a120c34be6d: loading cluster ID for follower catalog manager: success
I20260811 08:09:08.012807 7993 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 50172d9ed73e463c9f5d4a120c34be6d: acquiring CA information for follower catalog manager: success
I20260811 08:09:08.013070 7993 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 50172d9ed73e463c9f5d4a120c34be6d: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 08:09:08.013648 7974 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.252:45529 every 8 connection(s)
W20260811 08:09:08.055171 7846 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:09:08.055366 7846 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:09:08.055387 7846 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:09:08.056463 7846 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:09:08.056500 7846 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:09:08.056524 7846 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.243.193
I20260811 08:09:08.058015 7846 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:37793
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/krb5kdc/oryx_127.27.243.193.keytab
--principal=oryx/127.27.243.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.243.193:44819
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.243.193
--webserver_port=44293
--tserver_master_addrs=127.27.243.254:43189,127.27.243.253:41319,127.27.243.252:45529
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7846
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.243.193
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:09:08.058204 7846 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:09:08.058374 7846 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:09:08.063169 8004 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:09:08.063218 7999 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:09:08.063174 8001 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:09:08.063443 7846 server_base.cc:1034] running on GCE node
I20260811 08:09:08.063640 7846 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:09:08.063859 7846 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:09:08.065004 7846 hybrid_clock.cc:648] HybridClock initialized: now 1786435748064992 us; error 27 us; skew 500 ppm
Aug 11 08:09:08 dist-test-slave-7lbf krb5kdc[6486](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435748, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.243.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:09:08.067416 7846 init.cc:377] Logged in from keytab as oryx/127.27.243.193@KRBTEST.COM (short username oryx)
I20260811 08:09:08.067852 7846 webserver.cc:460] Webserver started at http://127.27.243.193:44293/ using document root <none> and password file <none>
I20260811 08:09:08.068048 7846 fs_manager.cc:359] Metadata directory not provided
I20260811 08:09:08.068102 7846 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:09:08.069460 7846 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:09:08.070096 8019 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:08.070253 7846 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 08:09:08.070335 7846 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/ts-0/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/ts-0/wal
uuid: "2af48f4f9fd64006b6205f420d6e7d74"
format_stamp: "Formatted at 2026-08-11 08:09:05 on dist-test-slave-7lbf"
server_key: "0ea4b2ae8c675743a8b6dcb3feeb07ef"
server_key_iv: "153b0e1b8afc79800f6bd921cf0571b3"
server_key_version: "encryptionkey@0"
I20260811 08:09:08.070701 7846 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:09:08.081848 7846 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:09:08.083474 7846 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:09:08.083603 7846 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:09:08.083812 7846 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:09:08.084091 7846 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:09:08.084127 7846 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:08.084147 7846 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:09:08.084158 7846 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:08.089970 7846 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.193:44819
I20260811 08:09:08.090011 8204 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.193:44819 every 8 connection(s)
I20260811 08:09:08.090340 7846 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/ts-0/data/info.pb
I20260811 08:09:08.094986 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 7846
I20260811 08:09:08.095134 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 6887
Aug 11 08:09:08 dist-test-slave-7lbf krb5kdc[6486](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435748, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.243.193@KRBTEST.COM for oryx/127.27.243.254@KRBTEST.COM
Aug 11 08:09:08 dist-test-slave-7lbf krb5kdc[6486](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435748, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.243.193@KRBTEST.COM for oryx/127.27.243.252@KRBTEST.COM
I20260811 08:09:08.104410 7335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:08.091196 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.193:44365 (local address 127.27.243.254:43189)
0811 08:09:08.091247 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:08.091249 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:08.091479 (+ 230us) server_negotiation.cc:407] Connection header received
0811 08:09:08.092543 (+ 1064us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:08.092545 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:08.092558 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:08.092613 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:08.093411 (+ 798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:08.094204 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:08.095545 (+ 1341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:08.095796 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:08.095831 (+ 35us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:08.099989 (+ 4158us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:09:08.099991 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:09:08.099991 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:09:08.099999 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:09:08.103175 (+ 3176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:08.103531 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:08.103532 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:08.103532 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:08.103588 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:08.103799 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:08.103800 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:08.103800 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:08.103915 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:09:08.103970 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 08:09:08.104221 (+ 251us) server_negotiation.cc:299] Negotiation successful
0811 08:09:08.104318 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 08:09:08.104687 8216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:08.091011 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:43189 (local address 127.27.243.193:44365)
0811 08:09:08.091333 (+ 322us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:08.091379 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:08.092434 (+ 1055us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:08.092672 (+ 238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:08.092675 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:08.093082 (+ 407us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:09:08.093293 (+ 211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:08.093300 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:08.094289 (+ 989us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:08.094290 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:08.095414 (+ 1124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:08.095418 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:08.095913 (+ 495us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:08.095913 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:08.096035 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:08.098503 (+ 2468us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:09:08.098514 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:09:08.099896 (+ 1382us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:09:08.103245 (+ 3349us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:09:08.103253 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:09:08.103255 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:09:08.103464 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:09:08.103640 (+ 176us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:09:08.103641 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:09:08.103641 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:09:08.103744 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:09:08.103969 (+ 225us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:09:08.103976 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:09:08.104105 (+ 129us) client_negotiation.cc:769] Sending connection context
0811 08:09:08.104195 (+ 90us) client_negotiation.cc:240] Negotiation successful
0811 08:09:08.104355 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":279,"mutex_wait_us":109,"thread_start_us":252,"threads_started":1}
I20260811 08:09:08.108883 8213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:08.091040 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.193:42853 (local address 127.27.243.252:45529)
0811 08:09:08.091165 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:08.091167 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:08.091504 (+ 337us) server_negotiation.cc:407] Connection header received
0811 08:09:08.092668 (+ 1164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:08.092669 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:08.092681 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:08.092754 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:08.093400 (+ 646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:08.094100 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:08.098028 (+ 3928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:08.098247 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:08.098318 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:08.101835 (+ 3517us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:09:08.101836 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:09:08.101837 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:09:08.101845 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:09:08.105185 (+ 3340us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:08.105474 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:08.105476 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:08.105476 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:08.105558 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:08.108374 (+ 2816us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:08.108375 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:08.108376 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:08.108502 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:09:08.108555 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 08:09:08.108701 (+ 146us) server_negotiation.cc:299] Negotiation successful
0811 08:09:08.108786 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":100,"thread_start_us":61,"threads_started":1}
I20260811 08:09:08.108894 8219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:08.091011 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.252:45529 (local address 127.27.243.193:42853)
0811 08:09:08.091394 (+ 383us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:08.091402 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:08.092439 (+ 1037us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:08.092775 (+ 336us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:08.092776 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:08.093083 (+ 307us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:09:08.093293 (+ 210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:08.093307 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:08.094202 (+ 895us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:08.094203 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:08.095399 (+ 1196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:08.095402 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:08.098319 (+ 2917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:08.098320 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:08.098382 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:08.100490 (+ 2108us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:09:08.100495 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:09:08.101745 (+ 1250us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:09:08.105258 (+ 3513us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:09:08.105259 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:09:08.105260 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:09:08.105414 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:09:08.108240 (+ 2826us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:09:08.108241 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:09:08.108241 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:09:08.108298 (+ 57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:09:08.108570 (+ 272us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:09:08.108571 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:09:08.108616 (+ 45us) client_negotiation.cc:769] Sending connection context
0811 08:09:08.108669 (+ 53us) client_negotiation.cc:240] Negotiation successful
0811 08:09:08.108774 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":360,"mutex_wait_us":73,"thread_start_us":295,"threads_started":1}
I20260811 08:09:08.109251 8205 heartbeater.cc:347] Connected to a master server at 127.27.243.252:45529
I20260811 08:09:08.109364 8205 heartbeater.cc:464] Registering TS with master...
I20260811 08:09:08.109582 8205 heartbeater.cc:511] Master 127.27.243.252:45529 requested a full tablet report, sending...
I20260811 08:09:08.110110 7916 ts_manager.cc:194] Registered new tserver with Master: 2af48f4f9fd64006b6205f420d6e7d74 (127.27.243.193:44819)
I20260811 08:09:08.112366 8209 heartbeater.cc:347] Connected to a master server at 127.27.243.254:43189
I20260811 08:09:08.112434 8209 heartbeater.cc:464] Registering TS with master...
I20260811 08:09:08.112504 8209 heartbeater.cc:511] Master 127.27.243.254:43189 requested a full tablet report, sending...
I20260811 08:09:08.112608 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.243.194:41905
--local_ip_for_outbound_sockets=127.27.243.194
--tserver_master_addrs=127.27.243.254:43189
--webserver_port=45677
--webserver_interface=127.27.243.194
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/krb5kdc/oryx_127.27.243.194.keytab
--principal=oryx/127.27.243.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:37793
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.27.243.254:43189,127.27.243.253:41319
--tserver_master_addrs=127.27.243.254:43189,127.27.243.253:41319,127.27.243.252:45529 with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 08:09:08.113759 6567 ts_manager.cc:194] Re-registered known tserver with Master: 2af48f4f9fd64006b6205f420d6e7d74 (127.27.243.193:44819)
Aug 11 08:09:08 dist-test-slave-7lbf krb5kdc[6486](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435748, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.243.193@KRBTEST.COM for oryx/127.27.243.253@KRBTEST.COM
I20260811 08:09:08.114223 6567 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.27.243.193@KRBTEST.COM'} at 127.27.243.193:44365
I20260811 08:09:08.117074 7672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:08.091605 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.193:57381 (local address 127.27.243.253:41319)
0811 08:09:08.091649 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:08.091651 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:08.091659 (+ 8us) server_negotiation.cc:407] Connection header received
0811 08:09:08.092566 (+ 907us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:08.092567 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:08.092578 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:08.092610 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:08.093389 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:08.094178 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:08.095542 (+ 1364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:08.095941 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:08.095991 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:08.114551 (+ 18560us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:09:08.114553 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:09:08.114553 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:09:08.114562 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:09:08.116015 (+ 1453us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:08.116368 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:08.116369 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:08.116370 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:08.116424 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:08.116587 (+ 163us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:08.116588 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:08.116588 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:08.116702 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:09:08.116759 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 08:09:08.116892 (+ 133us) server_negotiation.cc:299] Negotiation successful
0811 08:09:08.116977 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 08:09:08.117100 8220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:08.091480 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.253:41319 (local address 127.27.243.193:57381)
0811 08:09:08.091591 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:08.091599 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:08.092449 (+ 850us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:08.092696 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:08.092697 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:08.093043 (+ 346us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:09:08.093291 (+ 248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:08.093296 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:08.094266 (+ 970us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:08.094266 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:08.095413 (+ 1147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:08.095415 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:08.096086 (+ 671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:08.096088 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:08.096162 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:08.112625 (+ 16463us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:09:08.112630 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:09:08.114449 (+ 1819us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:09:08.116120 (+ 1671us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:09:08.116122 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:09:08.116122 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:09:08.116293 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:09:08.116477 (+ 184us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:09:08.116478 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:09:08.116478 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:09:08.116534 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:09:08.116756 (+ 222us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:09:08.116757 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:09:08.116802 (+ 45us) client_negotiation.cc:769] Sending connection context
0811 08:09:08.116863 (+ 61us) client_negotiation.cc:240] Negotiation successful
0811 08:09:08.116982 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":97,"mutex_wait_us":85,"thread_start_us":67,"threads_started":1}
I20260811 08:09:08.117468 8211 heartbeater.cc:347] Connected to a master server at 127.27.243.253:41319
I20260811 08:09:08.117543 8211 heartbeater.cc:464] Registering TS with master...
I20260811 08:09:08.117628 8211 heartbeater.cc:511] Master 127.27.243.253:41319 requested a full tablet report, sending...
I20260811 08:09:08.118050 7595 ts_manager.cc:194] Registered new tserver with Master: 2af48f4f9fd64006b6205f420d6e7d74 (127.27.243.193:44819)
W20260811 08:09:08.196000 8222 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:09:08.196190 8222 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:09:08.196213 8222 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:09:08.197371 8222 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:09:08.197409 8222 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:09:08.197434 8222 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.243.194
I20260811 08:09:08.198940 8222 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:37793
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/krb5kdc/oryx_127.27.243.194.keytab
--principal=oryx/127.27.243.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.243.194:41905
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.243.194
--webserver_port=45677
--tserver_master_addrs=127.27.243.254:43189,127.27.243.253:41319,127.27.243.252:45529
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8222
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.243.194
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:09:08.199131 8222 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:09:08.199303 8222 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:09:08.204082 8229 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:09:08.204113 8230 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:09:08.204115 8233 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:09:08.204293 8222 server_base.cc:1034] running on GCE node
I20260811 08:09:08.204512 8222 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:09:08.204726 8222 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:09:08.205888 8222 hybrid_clock.cc:648] HybridClock initialized: now 1786435748205876 us; error 24 us; skew 500 ppm
Aug 11 08:09:08 dist-test-slave-7lbf krb5kdc[6486](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435748, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.243.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:09:08.208226 8222 init.cc:377] Logged in from keytab as oryx/127.27.243.194@KRBTEST.COM (short username oryx)
I20260811 08:09:08.208652 8222 webserver.cc:460] Webserver started at http://127.27.243.194:45677/ using document root <none> and password file <none>
I20260811 08:09:08.208851 8222 fs_manager.cc:359] Metadata directory not provided
I20260811 08:09:08.208914 8222 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:09:08.210275 8222 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.000s
I20260811 08:09:08.210845 8252 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:08.211007 8222 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 08:09:08.211091 8222 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/ts-1/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/ts-1/wal
uuid: "354d5113c37743aa8300abdb229b7106"
format_stamp: "Formatted at 2026-08-11 08:09:06 on dist-test-slave-7lbf"
server_key: "06d7c854ef398ccd5b6efcdfea001650"
server_key_iv: "f31467a1aedb0eac741f0449f118c50c"
server_key_version: "encryptionkey@0"
I20260811 08:09:08.211447 8222 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:09:08.226783 8222 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:09:08.228929 8222 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:09:08.229065 8222 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:09:08.229283 8222 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:09:08.229650 8222 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:09:08.229687 8222 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:08.229717 8222 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:09:08.229734 8222 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:08.235597 8222 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.194:41905
I20260811 08:09:08.235670 8425 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.194:41905 every 8 connection(s)
I20260811 08:09:08.235984 8222 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/ts-1/data/info.pb
I20260811 08:09:08.238379 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 8222
I20260811 08:09:08.238543 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 7112
Aug 11 08:09:08 dist-test-slave-7lbf krb5kdc[6486](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435748, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.243.194@KRBTEST.COM for oryx/127.27.243.254@KRBTEST.COM
Aug 11 08:09:08 dist-test-slave-7lbf krb5kdc[6486](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435748, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.243.194@KRBTEST.COM for oryx/127.27.243.252@KRBTEST.COM
Aug 11 08:09:08 dist-test-slave-7lbf krb5kdc[6486](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435748, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.243.194@KRBTEST.COM for oryx/127.27.243.253@KRBTEST.COM
I20260811 08:09:08.252275 8213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:08.237028 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.194:50067 (local address 127.27.243.252:45529)
0811 08:09:08.237079 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:08.237080 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:08.237246 (+ 166us) server_negotiation.cc:407] Connection header received
0811 08:09:08.238027 (+ 781us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:08.238028 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:08.238044 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:08.238073 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:08.241775 (+ 3702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:08.242758 (+ 983us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:08.245104 (+ 2346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:08.245370 (+ 266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:08.245409 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:08.248858 (+ 3449us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:09:08.248859 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:09:08.248860 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:09:08.248866 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:09:08.250679 (+ 1813us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:08.251172 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:08.251173 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:08.251174 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:08.251235 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:08.251529 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:08.251530 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:08.251531 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:08.251669 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:09:08.251719 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0811 08:09:08.252094 (+ 375us) server_negotiation.cc:299] Negotiation successful
0811 08:09:08.252183 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260811 08:09:08.252966 8434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:08.236931 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.252:45529 (local address 127.27.243.194:50067)
0811 08:09:08.237179 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:08.237187 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:08.237915 (+ 728us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:08.238167 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:08.238171 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:08.238733 (+ 562us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:09:08.241575 (+ 2842us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:08.241585 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:08.242868 (+ 1283us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:08.242869 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:08.243675 (+ 806us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:08.243678 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:08.245483 (+ 1805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:08.245484 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:08.245550 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:08.247567 (+ 2017us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:09:08.247572 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:09:08.248773 (+ 1201us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:09:08.250766 (+ 1993us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:09:08.250775 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:09:08.250778 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:09:08.251080 (+ 302us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:09:08.251306 (+ 226us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:09:08.251306 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:09:08.251307 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:09:08.251447 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:09:08.251752 (+ 305us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:09:08.251758 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:09:08.251919 (+ 161us) client_negotiation.cc:769] Sending connection context
0811 08:09:08.252531 (+ 612us) client_negotiation.cc:240] Negotiation successful
0811 08:09:08.252722 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":226,"thread_start_us":59,"threads_started":1}
I20260811 08:09:08.252969 7672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:08.236680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.194:48209 (local address 127.27.243.253:41319)
0811 08:09:08.236738 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:08.236740 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:08.236954 (+ 214us) server_negotiation.cc:407] Connection header received
0811 08:09:08.238068 (+ 1114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:08.238069 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:08.238080 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:08.238126 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:08.243771 (+ 5645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:08.244341 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:08.245099 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:08.245410 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:08.245474 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:08.249803 (+ 4329us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:09:08.249805 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:09:08.249805 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:09:08.249814 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:09:08.251516 (+ 1702us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:08.251953 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:08.251954 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:08.251955 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:08.252020 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:08.252279 (+ 259us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:08.252280 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:08.252281 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:08.252449 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:09:08.252513 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0811 08:09:08.252772 (+ 259us) server_negotiation.cc:299] Negotiation successful
0811 08:09:08.252866 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 08:09:08.253011 7335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:08.236703 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.194:57527 (local address 127.27.243.254:43189)
0811 08:09:08.236764 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:08.236765 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:08.237131 (+ 366us) server_negotiation.cc:407] Connection header received
0811 08:09:08.238008 (+ 877us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:08.238010 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:08.238024 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:08.238072 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:08.241679 (+ 3607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:08.242302 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:08.243603 (+ 1301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:08.243985 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:08.244034 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:08.249837 (+ 5803us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:09:08.249839 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:09:08.249839 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:09:08.249848 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:09:08.251768 (+ 1920us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:08.252108 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:08.252109 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:08.252109 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:08.252168 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:08.252453 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:08.252454 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:08.252455 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:08.252587 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:09:08.252639 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 08:09:08.252851 (+ 212us) server_negotiation.cc:299] Negotiation successful
0811 08:09:08.252930 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260811 08:09:08.253571 8436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:08.236649 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:43189 (local address 127.27.243.194:57527)
0811 08:09:08.237064 (+ 415us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:08.237074 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:08.237909 (+ 835us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:08.238167 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:08.238171 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:08.241395 (+ 3224us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:09:08.241573 (+ 178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:08.241580 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:08.242417 (+ 837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:08.242418 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:08.243486 (+ 1068us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:08.243489 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:08.244153 (+ 664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:08.244155 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:08.244337 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:08.245940 (+ 1603us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:09:08.245952 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:09:08.247950 (+ 1998us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:09:08.251843 (+ 3893us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:09:08.251844 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:09:08.251845 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:09:08.252029 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:09:08.252229 (+ 200us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:09:08.252230 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:09:08.252230 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:09:08.252280 (+ 50us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:09:08.252672 (+ 392us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:09:08.252673 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:09:08.252735 (+ 62us) client_negotiation.cc:769] Sending connection context
0811 08:09:08.253350 (+ 615us) client_negotiation.cc:240] Negotiation successful
0811 08:09:08.253460 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":376,"mutex_wait_us":2,"thread_start_us":97,"threads_started":1}
I20260811 08:09:08.253707 8433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:08.236650 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.253:41319 (local address 127.27.243.194:48209)
0811 08:09:08.236820 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:08.236864 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:08.237903 (+ 1039us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:08.238167 (+ 264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:08.238171 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:08.241370 (+ 3199us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:09:08.241679 (+ 309us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:08.241681 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:08.244410 (+ 2729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:08.244411 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:08.245014 (+ 603us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:08.245015 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:08.245559 (+ 544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:08.245561 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:08.245657 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:08.248103 (+ 2446us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:09:08.248108 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:09:08.249666 (+ 1558us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:09:08.251619 (+ 1953us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:09:08.251621 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:09:08.251621 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:09:08.251853 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:09:08.252112 (+ 259us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:09:08.252113 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:09:08.252113 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:09:08.252186 (+ 73us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:09:08.252556 (+ 370us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:09:08.252557 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:09:08.252610 (+ 53us) client_negotiation.cc:769] Sending connection context
0811 08:09:08.253092 (+ 482us) client_negotiation.cc:240] Negotiation successful
0811 08:09:08.253204 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":96,"threads_started":1}
I20260811 08:09:08.253997 8428 heartbeater.cc:347] Connected to a master server at 127.27.243.252:45529
I20260811 08:09:08.254091 8428 heartbeater.cc:464] Registering TS with master...
I20260811 08:09:08.254392 8428 heartbeater.cc:511] Master 127.27.243.252:45529 requested a full tablet report, sending...
I20260811 08:09:08.254082 8430 heartbeater.cc:347] Connected to a master server at 127.27.243.253:41319
I20260811 08:09:08.254652 8430 heartbeater.cc:464] Registering TS with master...
I20260811 08:09:08.254732 8430 heartbeater.cc:511] Master 127.27.243.253:41319 requested a full tablet report, sending...
I20260811 08:09:08.254904 7916 ts_manager.cc:194] Registered new tserver with Master: 354d5113c37743aa8300abdb229b7106 (127.27.243.194:41905)
I20260811 08:09:08.255044 7595 ts_manager.cc:194] Registered new tserver with Master: 354d5113c37743aa8300abdb229b7106 (127.27.243.194:41905)
I20260811 08:09:08.259826 8429 heartbeater.cc:347] Connected to a master server at 127.27.243.254:43189
I20260811 08:09:08.259891 8429 heartbeater.cc:464] Registering TS with master...
I20260811 08:09:08.259949 8429 heartbeater.cc:511] Master 127.27.243.254:43189 requested a full tablet report, sending...
I20260811 08:09:08.260183 6567 ts_manager.cc:194] Re-registered known tserver with Master: 354d5113c37743aa8300abdb229b7106 (127.27.243.194:41905)
I20260811 08:09:08.260551 6567 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.27.243.194@KRBTEST.COM'} at 127.27.243.194:57527
I20260811 08:09:08.263793 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.243.195:43703
--local_ip_for_outbound_sockets=127.27.243.195
--tserver_master_addrs=127.27.243.254:43189
--webserver_port=40285
--webserver_interface=127.27.243.195
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/krb5kdc/oryx_127.27.243.195.keytab
--principal=oryx/127.27.243.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:37793
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.27.243.254:43189,127.27.243.253:41319
--tserver_master_addrs=127.27.243.254:43189,127.27.243.253:41319,127.27.243.252:45529 with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:09:08.347885 8437 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:09:08.348094 8437 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:09:08.348119 8437 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:09:08.349296 8437 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:09:08.349344 8437 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:09:08.349371 8437 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.243.195
I20260811 08:09:08.350901 8437 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:37793
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/krb5kdc/oryx_127.27.243.195.keytab
--principal=oryx/127.27.243.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.243.195:43703
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.243.195
--webserver_port=40285
--tserver_master_addrs=127.27.243.254:43189,127.27.243.253:41319,127.27.243.252:45529
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8437
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.243.195
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:09:08.351122 8437 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:09:08.351357 8437 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:09:08.356478 8445 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:09:08.356487 8448 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:09:08.356474 8444 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:09:08.356858 8437 server_base.cc:1034] running on GCE node
I20260811 08:09:08.357075 8437 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:09:08.357316 8437 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:09:08.358502 8437 hybrid_clock.cc:648] HybridClock initialized: now 1786435748358466 us; error 51 us; skew 500 ppm
Aug 11 08:09:08 dist-test-slave-7lbf krb5kdc[6486](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435748, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.243.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:09:08.364362 8437 init.cc:377] Logged in from keytab as oryx/127.27.243.195@KRBTEST.COM (short username oryx)
I20260811 08:09:08.364787 8437 webserver.cc:460] Webserver started at http://127.27.243.195:40285/ using document root <none> and password file <none>
I20260811 08:09:08.364976 8437 fs_manager.cc:359] Metadata directory not provided
I20260811 08:09:08.365026 8437 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:09:08.366372 8437 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:09:08.366901 8461 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:08.367069 8437 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:08.367156 8437 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/ts-2/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/ts-2/wal
uuid: "bd9c6cd01570488cac503f339622298c"
format_stamp: "Formatted at 2026-08-11 08:09:07 on dist-test-slave-7lbf"
server_key: "e103b8a6b29f04b035df1cff188e5e60"
server_key_iv: "14041c8cb45621ae44cac1eda4c0b2e6"
server_key_version: "encryptionkey@0"
I20260811 08:09:08.367480 8437 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:09:08.387497 8437 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:09:08.389400 8437 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:09:08.389562 8437 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:09:08.389815 8437 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:09:08.390139 8437 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:09:08.390177 8437 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:08.390198 8437 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:09:08.390209 8437 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:08.396004 8437 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.195:43703
I20260811 08:09:08.396063 8657 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.195:43703 every 8 connection(s)
I20260811 08:09:08.396412 8437 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/ts-2/data/info.pb
I20260811 08:09:08.399144 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 8437
I20260811 08:09:08.404786 7520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:08.401230 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.252:45529 (local address 127.0.0.1:52832)
0811 08:09:08.401273 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:08.401285 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:08.401360 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:08.401792 (+ 432us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:08.401793 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:08.401795 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:09:08.401840 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:08.401842 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:08.402725 (+ 883us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:08.402726 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:08.403775 (+ 1049us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:08.403779 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:08.404575 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:08.404576 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:08.404635 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:08.404639 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 08:09:08.404668 (+ 29us) client_negotiation.cc:240] Negotiation successful
0811 08:09:08.404713 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":22}
I20260811 08:09:08.405167 8680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:08.401320 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52832 (local address 127.27.243.252:45529)
0811 08:09:08.401621 (+ 301us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:08.401623 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:08.401631 (+ 8us) server_negotiation.cc:407] Connection header received
0811 08:09:08.401653 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:08.401654 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:08.401690 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:08.401898 (+ 208us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:09:08.401931 (+ 33us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:08.402627 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:08.403873 (+ 1246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:08.404471 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:08.404952 (+ 481us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:08.405029 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 08:09:08.405056 (+ 27us) server_negotiation.cc:299] Negotiation successful
0811 08:09:08.405097 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":273,"thread_start_us":168,"threads_started":1}
Aug 11 08:09:08 dist-test-slave-7lbf krb5kdc[6486](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435748, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.243.195@KRBTEST.COM for oryx/127.27.243.253@KRBTEST.COM
I20260811 08:09:08.405405 7935 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 50172d9ed73e463c9f5d4a120c34be6d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260811 08:09:08.405611 7978 sys_catalog.cc:455] T 00000000000000000000000000000000 P 50172d9ed73e463c9f5d4a120c34be6d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1e9672280b3347719b31d040efc4c7ee. Latest consensus state: current_term: 1 leader_uuid: "1e9672280b3347719b31d040efc4c7ee" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "1e9672280b3347719b31d040efc4c7ee" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 43189 } } peers { permanent_uuid: "e7239e9050e74949bd7be2f23f82fc50" member_type: VOTER last_known_addr { host: "127.27.243.253" port: 41319 } attrs { promote: false } } peers { permanent_uuid: "50172d9ed73e463c9f5d4a120c34be6d" member_type: NON_VOTER last_known_addr { host: "127.27.243.252" port: 45529 } attrs { promote: true } } }
I20260811 08:09:08.405719 7978 sys_catalog.cc:458] T 00000000000000000000000000000000 P 50172d9ed73e463c9f5d4a120c34be6d [sys.catalog]: This master's current role is: LEARNER
Aug 11 08:09:08 dist-test-slave-7lbf krb5kdc[6486](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435748, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.243.195@KRBTEST.COM for oryx/127.27.243.252@KRBTEST.COM
I20260811 08:09:08.409804 8678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:08.400507 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49596 (local address 127.27.243.253:41319)
0811 08:09:08.400690 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:08.400692 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:08.400699 (+ 7us) server_negotiation.cc:407] Connection header received
0811 08:09:08.400720 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:08.400721 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:08.400731 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:08.400790 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:08.401827 (+ 1037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:08.402557 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:08.403542 (+ 985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:08.403828 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:08.403884 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:08.406014 (+ 2130us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:09:08.406015 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:09:08.406015 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:09:08.406023 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:09:08.408358 (+ 2335us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:08.408713 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:08.408714 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:08.408714 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:08.408770 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:08.409024 (+ 254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:08.409024 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:08.409025 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:08.409194 (+ 169us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:09:08.409285 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0811 08:09:08.409465 (+ 180us) server_negotiation.cc:299] Negotiation successful
0811 08:09:08.409611 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":167,"thread_start_us":57,"threads_started":1}
I20260811 08:09:08.411147 8666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:08.397111 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.253:41319 (local address 127.27.243.195:37551)
0811 08:09:08.397345 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:08.397357 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:08.399273 (+ 1916us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:08.399565 (+ 292us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:08.399566 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:08.400089 (+ 523us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:09:08.400396 (+ 307us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:08.400402 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:08.401301 (+ 899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:08.401302 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:08.402658 (+ 1356us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:08.402660 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:08.403168 (+ 508us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:08.403168 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:08.403304 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:08.403967 (+ 663us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:09:08.403977 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:09:08.406251 (+ 2274us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:09:08.409503 (+ 3252us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:09:08.409537 (+ 34us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:09:08.409539 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:09:08.409795 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:09:08.410007 (+ 212us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:09:08.410008 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:09:08.410008 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:09:08.410145 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:09:08.410431 (+ 286us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:09:08.410439 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:09:08.410633 (+ 194us) client_negotiation.cc:769] Sending connection context
0811 08:09:08.410728 (+ 95us) client_negotiation.cc:240] Negotiation successful
0811 08:09:08.410904 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":172,"mutex_wait_us":1,"thread_start_us":104,"threads_started":1}
I20260811 08:09:08.411271 8213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:08.397724 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.195:58427 (local address 127.27.243.252:45529)
0811 08:09:08.397769 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:08.397770 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:08.397825 (+ 55us) server_negotiation.cc:407] Connection header received
0811 08:09:08.399620 (+ 1795us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:08.399622 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:08.399633 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:08.399661 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:08.400507 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:08.401533 (+ 1026us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:08.402888 (+ 1355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:08.403190 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:08.403227 (+ 37us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:08.406556 (+ 3329us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:09:08.406557 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:09:08.406557 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:09:08.406563 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:09:08.408921 (+ 2358us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:08.410331 (+ 1410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:08.410332 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:08.410333 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:08.410400 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:08.410684 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:08.410685 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:08.410686 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:08.410810 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:09:08.410861 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 08:09:08.411115 (+ 254us) server_negotiation.cc:299] Negotiation successful
0811 08:09:08.411188 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
Aug 11 08:09:08 dist-test-slave-7lbf krb5kdc[6486](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435748, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.243.195@KRBTEST.COM for oryx/127.27.243.254@KRBTEST.COM
I20260811 08:09:08.411585 7672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:08.397631 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.195:37551 (local address 127.27.243.253:41319)
0811 08:09:08.397682 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:08.397684 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:08.397695 (+ 11us) server_negotiation.cc:407] Connection header received
0811 08:09:08.399404 (+ 1709us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:08.399405 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:08.399419 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:08.399451 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:08.400507 (+ 1056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:08.401176 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:08.402742 (+ 1566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:08.403039 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:08.403080 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:08.406340 (+ 3260us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:09:08.406341 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:09:08.406341 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:09:08.406347 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:09:08.409245 (+ 2898us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:08.409879 (+ 634us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:08.409880 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:08.409881 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:08.409944 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:08.410221 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:08.410222 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:08.410222 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:08.410351 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:09:08.410404 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 08:09:08.411419 (+ 1015us) server_negotiation.cc:299] Negotiation successful
0811 08:09:08.411494 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 08:09:08.411623 8668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:08.397449 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.252:45529 (local address 127.27.243.195:58427)
0811 08:09:08.397655 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:08.397665 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:08.399532 (+ 1867us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:08.399728 (+ 196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:08.399729 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:08.400086 (+ 357us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:09:08.400397 (+ 311us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:08.400404 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:08.401630 (+ 1226us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:08.401631 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:08.402801 (+ 1170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:08.402802 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:08.403297 (+ 495us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:08.403298 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:08.403364 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:08.404318 (+ 954us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:09:08.404323 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:09:08.406255 (+ 1932us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:09:08.410068 (+ 3813us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:09:08.410068 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:09:08.410069 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:09:08.410252 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:09:08.410481 (+ 229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:09:08.410482 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:09:08.410483 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:09:08.410564 (+ 81us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:09:08.410897 (+ 333us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:09:08.410898 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:09:08.410996 (+ 98us) client_negotiation.cc:769] Sending connection context
0811 08:09:08.411394 (+ 398us) client_negotiation.cc:240] Negotiation successful
0811 08:09:08.411499 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":188,"mutex_wait_us":185,"thread_start_us":103,"threads_started":1}
I20260811 08:09:08.412109 8662 heartbeater.cc:347] Connected to a master server at 127.27.243.253:41319
I20260811 08:09:08.412101 8659 heartbeater.cc:347] Connected to a master server at 127.27.243.252:45529
I20260811 08:09:08.412202 8662 heartbeater.cc:464] Registering TS with master...
I20260811 08:09:08.412202 8659 heartbeater.cc:464] Registering TS with master...
I20260811 08:09:08.412416 8659 heartbeater.cc:511] Master 127.27.243.252:45529 requested a full tablet report, sending...
I20260811 08:09:08.412422 8662 heartbeater.cc:511] Master 127.27.243.253:41319 requested a full tablet report, sending...
I20260811 08:09:08.412829 7595 ts_manager.cc:194] Registered new tserver with Master: bd9c6cd01570488cac503f339622298c (127.27.243.195:43703)
I20260811 08:09:08.413064 7916 ts_manager.cc:194] Registered new tserver with Master: bd9c6cd01570488cac503f339622298c (127.27.243.195:43703)
I20260811 08:09:08.413751 8674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:08.400137 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54910 (local address 127.27.243.254:43189)
0811 08:09:08.406377 (+ 6240us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:08.406379 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:08.406386 (+ 7us) server_negotiation.cc:407] Connection header received
0811 08:09:08.406403 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:08.406403 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:08.406411 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:08.406467 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:08.407034 (+ 567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:08.407733 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:08.408715 (+ 982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:08.409024 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:08.409337 (+ 313us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:08.410560 (+ 1223us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:09:08.410561 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:09:08.410562 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:09:08.410568 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:09:08.412248 (+ 1680us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:08.412622 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:08.412622 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:08.412623 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:08.412687 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:08.412969 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:08.412970 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:08.412970 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:08.413092 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:09:08.413500 (+ 408us) server_negotiation.cc:1035] Waiting for connection context
0811 08:09:08.413562 (+ 62us) server_negotiation.cc:299] Negotiation successful
0811 08:09:08.413655 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6214,"thread_start_us":103,"threads_started":1}
I20260811 08:09:08.415593 7335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:08.397088 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.195:59793 (local address 127.27.243.254:43189)
0811 08:09:08.397147 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:08.397149 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:08.397412 (+ 263us) server_negotiation.cc:407] Connection header received
0811 08:09:08.399417 (+ 2005us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:08.399418 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:08.399431 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:08.399484 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:08.403543 (+ 4059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:08.404215 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:08.405735 (+ 1520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:08.405997 (+ 262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:08.406036 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:08.412870 (+ 6834us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:09:08.412872 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:09:08.412872 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:09:08.412879 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:09:08.414411 (+ 1532us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:08.414798 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:08.414800 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:08.414800 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:08.414861 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:08.415070 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:08.415071 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:08.415072 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:08.415179 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:09:08.415223 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0811 08:09:08.415441 (+ 218us) server_negotiation.cc:299] Negotiation successful
0811 08:09:08.415513 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 08:09:08.415752 8665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:08.397110 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:43189 (local address 127.27.243.195:59793)
0811 08:09:08.397289 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:08.397332 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:08.399267 (+ 1935us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:08.399557 (+ 290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:08.399562 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:08.402670 (+ 3108us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:09:08.402726 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:08.402728 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:08.404918 (+ 2190us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:08.404919 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:08.405640 (+ 721us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:08.405643 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:08.406108 (+ 465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:08.406109 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:08.406171 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:08.410380 (+ 4209us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:09:08.410385 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:09:08.412769 (+ 2384us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:09:08.414511 (+ 1742us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:09:08.414512 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:09:08.414512 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:09:08.414696 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:09:08.414925 (+ 229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:09:08.414926 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:09:08.414926 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:09:08.414992 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:09:08.415258 (+ 266us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:09:08.415258 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:09:08.415299 (+ 41us) client_negotiation.cc:769] Sending connection context
0811 08:09:08.415391 (+ 92us) client_negotiation.cc:240] Negotiation successful
0811 08:09:08.415490 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":91,"threads_started":1}
I20260811 08:09:08.416064 8660 heartbeater.cc:347] Connected to a master server at 127.27.243.254:43189
I20260811 08:09:08.416115 8660 heartbeater.cc:464] Registering TS with master...
I20260811 08:09:08.416173 8660 heartbeater.cc:511] Master 127.27.243.254:43189 requested a full tablet report, sending...
I20260811 08:09:08.416427 6566 ts_manager.cc:194] Re-registered known tserver with Master: bd9c6cd01570488cac503f339622298c (127.27.243.195:43703)
I20260811 08:09:08.416889 6566 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.27.243.195@KRBTEST.COM'} at 127.27.243.195:59793
I20260811 08:09:08.415262 6567 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54910:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 08:09:08.417207 6567 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 08:09:08.417315 8679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:08.400602 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52824 (local address 127.27.243.252:45529)
0811 08:09:08.400847 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:08.400849 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:08.406632 (+ 5783us) server_negotiation.cc:407] Connection header received
0811 08:09:08.406654 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:08.406655 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:08.406666 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:08.406718 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:08.407229 (+ 511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:08.407868 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:08.408844 (+ 976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:08.409126 (+ 282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:08.409165 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:08.414256 (+ 5091us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:09:08.414257 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:09:08.414257 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:09:08.414264 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:09:08.416202 (+ 1938us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:08.416543 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:08.416544 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:08.416544 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:08.416603 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:08.416777 (+ 174us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:08.416778 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:08.416778 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:08.416904 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:09:08.416985 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 08:09:08.417147 (+ 162us) server_negotiation.cc:299] Negotiation successful
0811 08:09:08.417216 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":230,"thread_start_us":43,"threads_started":1}
I20260811 08:09:08.417985 7854 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1e9672280b3347719b31d040efc4c7ee [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "1e9672280b3347719b31d040efc4c7ee" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "1e9672280b3347719b31d040efc4c7ee" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 43189 } } peers { permanent_uuid: "e7239e9050e74949bd7be2f23f82fc50" member_type: VOTER last_known_addr { host: "127.27.243.253" port: 41319 } attrs { promote: false } } peers { permanent_uuid: "50172d9ed73e463c9f5d4a120c34be6d" member_type: NON_VOTER last_known_addr { host: "127.27.243.252" port: 45529 } attrs { promote: true } } }
I20260811 08:09:08.418085 7854 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1e9672280b3347719b31d040efc4c7ee [sys.catalog]: This master's current role is: LEADER
I20260811 08:09:08.419381 7527 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 1e9672280b3347719b31d040efc4c7ee: attempting to promote NON_VOTER 50172d9ed73e463c9f5d4a120c34be6d to VOTER
I20260811 08:09:08.419505 7527 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1e9672280b3347719b31d040efc4c7ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "1e9672280b3347719b31d040efc4c7ee" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 43189 } } peers { permanent_uuid: "e7239e9050e74949bd7be2f23f82fc50" member_type: VOTER last_known_addr { host: "127.27.243.253" port: 41319 } attrs { promote: false } } peers { permanent_uuid: "50172d9ed73e463c9f5d4a120c34be6d" member_type: VOTER last_known_addr { host: "127.27.243.252" port: 45529 } attrs { promote: false } }
I20260811 08:09:08.419922 7609 raft_consensus.cc:1261] T 00000000000000000000000000000000 P e7239e9050e74949bd7be2f23f82fc50 [term 1 FOLLOWER]: Refusing update from remote peer 1e9672280b3347719b31d040efc4c7ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260811 08:09:08.420070 7934 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 50172d9ed73e463c9f5d4a120c34be6d [term 1 LEARNER]: Refusing update from remote peer 1e9672280b3347719b31d040efc4c7ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260811 08:09:08.420109 7855 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 1e9672280b3347719b31d040efc4c7ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7239e9050e74949bd7be2f23f82fc50" member_type: VOTER last_known_addr { host: "127.27.243.253" port: 41319 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260811 08:09:08.420292 7855 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 1e9672280b3347719b31d040efc4c7ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "50172d9ed73e463c9f5d4a120c34be6d" member_type: VOTER last_known_addr { host: "127.27.243.252" port: 45529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260811 08:09:08.420787 7528 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 1e9672280b3347719b31d040efc4c7ee [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 50172d9ed73e463c9f5d4a120c34be6d (127.27.243.252) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "1e9672280b3347719b31d040efc4c7ee" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 43189 } } peers { permanent_uuid: "e7239e9050e74949bd7be2f23f82fc50" member_type: VOTER last_known_addr { host: "127.27.243.253" port: 41319 } attrs { promote: false } } peers { permanent_uuid: "50172d9ed73e463c9f5d4a120c34be6d" member_type: VOTER last_known_addr { host: "127.27.243.252" port: 45529 } attrs { promote: false } } }
I20260811 08:09:08.421084 7934 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 50172d9ed73e463c9f5d4a120c34be6d [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 50172d9ed73e463c9f5d4a120c34be6d (127.27.243.252) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "1e9672280b3347719b31d040efc4c7ee" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 43189 } } peers { permanent_uuid: "e7239e9050e74949bd7be2f23f82fc50" member_type: VOTER last_known_addr { host: "127.27.243.253" port: 41319 } attrs { promote: false } } peers { permanent_uuid: "50172d9ed73e463c9f5d4a120c34be6d" member_type: VOTER last_known_addr { host: "127.27.243.252" port: 45529 } attrs { promote: false } } }
I20260811 08:09:08.421615 7609 raft_consensus.cc:2932] T 00000000000000000000000000000000 P e7239e9050e74949bd7be2f23f82fc50 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 50172d9ed73e463c9f5d4a120c34be6d (127.27.243.252) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "1e9672280b3347719b31d040efc4c7ee" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 43189 } } peers { permanent_uuid: "e7239e9050e74949bd7be2f23f82fc50" member_type: VOTER last_known_addr { host: "127.27.243.253" port: 41319 } attrs { promote: false } } peers { permanent_uuid: "50172d9ed73e463c9f5d4a120c34be6d" member_type: VOTER last_known_addr { host: "127.27.243.252" port: 45529 } attrs { promote: false } } }
I20260811 08:09:08.421720 7528 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1e9672280b3347719b31d040efc4c7ee [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "1e9672280b3347719b31d040efc4c7ee" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "1e9672280b3347719b31d040efc4c7ee" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 43189 } } peers { permanent_uuid: "e7239e9050e74949bd7be2f23f82fc50" member_type: VOTER last_known_addr { host: "127.27.243.253" port: 41319 } attrs { promote: false } } peers { permanent_uuid: "50172d9ed73e463c9f5d4a120c34be6d" member_type: VOTER last_known_addr { host: "127.27.243.252" port: 45529 } attrs { promote: false } } }
I20260811 08:09:08.421794 7528 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1e9672280b3347719b31d040efc4c7ee [sys.catalog]: This master's current role is: LEADER
I20260811 08:09:08.421839 7528 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1e9672280b3347719b31d040efc4c7ee [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "1e9672280b3347719b31d040efc4c7ee" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "1e9672280b3347719b31d040efc4c7ee" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 43189 } } peers { permanent_uuid: "e7239e9050e74949bd7be2f23f82fc50" member_type: VOTER last_known_addr { host: "127.27.243.253" port: 41319 } attrs { promote: false } } peers { permanent_uuid: "50172d9ed73e463c9f5d4a120c34be6d" member_type: VOTER last_known_addr { host: "127.27.243.252" port: 45529 } attrs { promote: false } } }
I20260811 08:09:08.421880 7528 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1e9672280b3347719b31d040efc4c7ee [sys.catalog]: This master's current role is: LEADER
I20260811 08:09:08.421916 7528 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1e9672280b3347719b31d040efc4c7ee [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "1e9672280b3347719b31d040efc4c7ee" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "1e9672280b3347719b31d040efc4c7ee" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 43189 } } peers { permanent_uuid: "e7239e9050e74949bd7be2f23f82fc50" member_type: VOTER last_known_addr { host: "127.27.243.253" port: 41319 } attrs { promote: false } } peers { permanent_uuid: "50172d9ed73e463c9f5d4a120c34be6d" member_type: VOTER last_known_addr { host: "127.27.243.252" port: 45529 } attrs { promote: false } } }
I20260811 08:09:08.421947 7528 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1e9672280b3347719b31d040efc4c7ee [sys.catalog]: This master's current role is: LEADER
I20260811 08:09:08.422190 7978 sys_catalog.cc:455] T 00000000000000000000000000000000 P 50172d9ed73e463c9f5d4a120c34be6d [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "1e9672280b3347719b31d040efc4c7ee" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "1e9672280b3347719b31d040efc4c7ee" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 43189 } } peers { permanent_uuid: "e7239e9050e74949bd7be2f23f82fc50" member_type: VOTER last_known_addr { host: "127.27.243.253" port: 41319 } attrs { promote: false } } peers { permanent_uuid: "50172d9ed73e463c9f5d4a120c34be6d" member_type: VOTER last_known_addr { host: "127.27.243.252" port: 45529 } attrs { promote: false } } }
I20260811 08:09:08.422269 7978 sys_catalog.cc:458] T 00000000000000000000000000000000 P 50172d9ed73e463c9f5d4a120c34be6d [sys.catalog]: This master's current role is: FOLLOWER
I20260811 08:09:08.422384 7853 sys_catalog.cc:455] T 00000000000000000000000000000000 P e7239e9050e74949bd7be2f23f82fc50 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "1e9672280b3347719b31d040efc4c7ee" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "1e9672280b3347719b31d040efc4c7ee" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 43189 } } peers { permanent_uuid: "e7239e9050e74949bd7be2f23f82fc50" member_type: VOTER last_known_addr { host: "127.27.243.253" port: 41319 } attrs { promote: false } } peers { permanent_uuid: "50172d9ed73e463c9f5d4a120c34be6d" member_type: VOTER last_known_addr { host: "127.27.243.252" port: 45529 } attrs { promote: false } } }
I20260811 08:09:08.422467 7853 sys_catalog.cc:458] T 00000000000000000000000000000000 P e7239e9050e74949bd7be2f23f82fc50 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 08:09:08.426512 7520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:08.423005 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.193:44819 (local address 127.0.0.1:46116)
0811 08:09:08.423099 (+ 94us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:08.423109 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:08.423147 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:08.423588 (+ 441us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:08.423589 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:08.423591 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:09:08.423630 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:08.423631 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:08.424582 (+ 951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:08.424583 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:08.425383 (+ 800us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:08.425385 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:08.426299 (+ 914us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:08.426300 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:08.426358 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:08.426362 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 08:09:08.426415 (+ 53us) client_negotiation.cc:240] Negotiation successful
0811 08:09:08.426450 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":78}
I20260811 08:09:08.426517 8693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:08.423238 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46116 (local address 127.27.243.193:44819)
0811 08:09:08.423433 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:08.423437 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:08.423449 (+ 12us) server_negotiation.cc:407] Connection header received
0811 08:09:08.423492 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:08.423494 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:08.423510 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:08.423592 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:09:08.423682 (+ 90us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:08.424524 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:08.425479 (+ 955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:08.426220 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:08.426327 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:08.426381 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 08:09:08.426428 (+ 47us) server_negotiation.cc:299] Negotiation successful
0811 08:09:08.426459 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":151,"thread_start_us":104,"threads_started":1}
I20260811 08:09:08.427028 8691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:08.423050 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.194:41905 (local address 127.0.0.1:46776)
0811 08:09:08.423185 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:08.423196 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:08.423245 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:08.423745 (+ 500us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:08.423746 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:08.423748 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:09:08.423800 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:08.423802 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:08.425000 (+ 1198us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:08.425001 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:08.426002 (+ 1001us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:08.426005 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:08.426820 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:08.426821 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:08.426880 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:08.426884 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 08:09:08.426913 (+ 29us) client_negotiation.cc:240] Negotiation successful
0811 08:09:08.426951 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"mutex_wait_us":56,"thread_start_us":76,"threads_started":1}
I20260811 08:09:08.427551 8095 tablet_service.cc:1467] Processing CreateTablet for tablet 19449772f7394ff28680fc414e9ece97 (DEFAULT_TABLE table=test-table [id=31c5a8363e184b7b82b30e71f36d297d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:09:08.427848 8692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:08.423104 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.195:43703 (local address 127.0.0.1:51622)
0811 08:09:08.423318 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:08.423328 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:08.423363 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:08.423741 (+ 378us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:08.423742 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:08.423744 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:09:08.423798 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:08.423800 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:08.425091 (+ 1291us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:08.425093 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:08.426227 (+ 1134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:08.426230 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:08.427645 (+ 1415us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:08.427646 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:08.427693 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:08.427696 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 08:09:08.427732 (+ 36us) client_negotiation.cc:240] Negotiation successful
0811 08:09:08.427768 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":202,"mutex_wait_us":3,"thread_start_us":84,"threads_started":1}
I20260811 08:09:08.427856 8696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:08.423427 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51622 (local address 127.27.243.195:43703)
0811 08:09:08.423593 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:08.423596 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:08.423604 (+ 8us) server_negotiation.cc:407] Connection header received
0811 08:09:08.423633 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:08.423635 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:08.423647 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:08.423914 (+ 267us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:09:08.423958 (+ 44us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:08.425017 (+ 1059us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:08.426902 (+ 1885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:08.427567 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:08.427664 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:08.427717 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 08:09:08.427743 (+ 26us) server_negotiation.cc:299] Negotiation successful
0811 08:09:08.427779 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":86,"threads_started":1}
I20260811 08:09:08.427949 8095 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 19449772f7394ff28680fc414e9ece97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:09:08.428442 8537 tablet_service.cc:1467] Processing CreateTablet for tablet 19449772f7394ff28680fc414e9ece97 (DEFAULT_TABLE table=test-table [id=31c5a8363e184b7b82b30e71f36d297d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:09:08.428716 8537 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 19449772f7394ff28680fc414e9ece97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:09:08.429968 8694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:08.423287 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46776 (local address 127.27.243.194:41905)
0811 08:09:08.423562 (+ 275us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:08.423566 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:08.423577 (+ 11us) server_negotiation.cc:407] Connection header received
0811 08:09:08.423619 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:08.423621 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:08.423637 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:08.423749 (+ 112us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:09:08.423854 (+ 105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:08.424908 (+ 1054us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:08.426073 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:08.426733 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:08.429691 (+ 2958us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:08.429758 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 08:09:08.429783 (+ 25us) server_negotiation.cc:299] Negotiation successful
0811 08:09:08.429893 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":242,"thread_start_us":112,"threads_started":1}
I20260811 08:09:08.430891 8697 tablet_bootstrap.cc:492] T 19449772f7394ff28680fc414e9ece97 P 2af48f4f9fd64006b6205f420d6e7d74: Bootstrap starting.
I20260811 08:09:08.431442 8317 tablet_service.cc:1467] Processing CreateTablet for tablet 19449772f7394ff28680fc414e9ece97 (DEFAULT_TABLE table=test-table [id=31c5a8363e184b7b82b30e71f36d297d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:09:08.431550 8699 tablet_bootstrap.cc:492] T 19449772f7394ff28680fc414e9ece97 P bd9c6cd01570488cac503f339622298c: Bootstrap starting.
I20260811 08:09:08.431697 8697 tablet_bootstrap.cc:654] T 19449772f7394ff28680fc414e9ece97 P 2af48f4f9fd64006b6205f420d6e7d74: Neither blocks nor log segments found. Creating new log.
I20260811 08:09:08.431789 8317 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 19449772f7394ff28680fc414e9ece97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:09:08.432041 8697 log.cc:824] T 19449772f7394ff28680fc414e9ece97 P 2af48f4f9fd64006b6205f420d6e7d74: Log is configured to *not* fsync() on all Append() calls
I20260811 08:09:08.432147 8699 tablet_bootstrap.cc:654] T 19449772f7394ff28680fc414e9ece97 P bd9c6cd01570488cac503f339622298c: Neither blocks nor log segments found. Creating new log.
I20260811 08:09:08.432458 8699 log.cc:824] T 19449772f7394ff28680fc414e9ece97 P bd9c6cd01570488cac503f339622298c: Log is configured to *not* fsync() on all Append() calls
I20260811 08:09:08.432919 8697 tablet_bootstrap.cc:492] T 19449772f7394ff28680fc414e9ece97 P 2af48f4f9fd64006b6205f420d6e7d74: No bootstrap required, opened a new log
I20260811 08:09:08.433168 8697 ts_tablet_manager.cc:1397] T 19449772f7394ff28680fc414e9ece97 P 2af48f4f9fd64006b6205f420d6e7d74: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 08:09:08.433193 8699 tablet_bootstrap.cc:492] T 19449772f7394ff28680fc414e9ece97 P bd9c6cd01570488cac503f339622298c: No bootstrap required, opened a new log
I20260811 08:09:08.433256 8699 ts_tablet_manager.cc:1397] T 19449772f7394ff28680fc414e9ece97 P bd9c6cd01570488cac503f339622298c: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 08:09:08.434994 8699 raft_consensus.cc:348] T 19449772f7394ff28680fc414e9ece97 P bd9c6cd01570488cac503f339622298c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af48f4f9fd64006b6205f420d6e7d74" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 44819 } } peers { permanent_uuid: "354d5113c37743aa8300abdb229b7106" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 41905 } } peers { permanent_uuid: "bd9c6cd01570488cac503f339622298c" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 43703 } }
I20260811 08:09:08.435120 8699 raft_consensus.cc:374] T 19449772f7394ff28680fc414e9ece97 P bd9c6cd01570488cac503f339622298c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:09:08.435153 8699 raft_consensus.cc:729] T 19449772f7394ff28680fc414e9ece97 P bd9c6cd01570488cac503f339622298c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd9c6cd01570488cac503f339622298c, State: Initialized, Role: FOLLOWER
I20260811 08:09:08.435259 8699 consensus_queue.cc:260] T 19449772f7394ff28680fc414e9ece97 P bd9c6cd01570488cac503f339622298c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af48f4f9fd64006b6205f420d6e7d74" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 44819 } } peers { permanent_uuid: "354d5113c37743aa8300abdb229b7106" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 41905 } } peers { permanent_uuid: "bd9c6cd01570488cac503f339622298c" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 43703 } }
I20260811 08:09:08.435467 8703 tablet_bootstrap.cc:492] T 19449772f7394ff28680fc414e9ece97 P 354d5113c37743aa8300abdb229b7106: Bootstrap starting.
I20260811 08:09:08.435549 8699 ts_tablet_manager.cc:1428] T 19449772f7394ff28680fc414e9ece97 P bd9c6cd01570488cac503f339622298c: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260811 08:09:08.435637 8660 heartbeater.cc:503] Master 127.27.243.254:43189 was elected leader, sending a full tablet report...
I20260811 08:09:08.435617 8697 raft_consensus.cc:348] T 19449772f7394ff28680fc414e9ece97 P 2af48f4f9fd64006b6205f420d6e7d74 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af48f4f9fd64006b6205f420d6e7d74" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 44819 } } peers { permanent_uuid: "354d5113c37743aa8300abdb229b7106" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 41905 } } peers { permanent_uuid: "bd9c6cd01570488cac503f339622298c" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 43703 } }
I20260811 08:09:08.435774 8697 raft_consensus.cc:374] T 19449772f7394ff28680fc414e9ece97 P 2af48f4f9fd64006b6205f420d6e7d74 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:09:08.435818 8697 raft_consensus.cc:729] T 19449772f7394ff28680fc414e9ece97 P 2af48f4f9fd64006b6205f420d6e7d74 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2af48f4f9fd64006b6205f420d6e7d74, State: Initialized, Role: FOLLOWER
I20260811 08:09:08.436268 8697 consensus_queue.cc:260] T 19449772f7394ff28680fc414e9ece97 P 2af48f4f9fd64006b6205f420d6e7d74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af48f4f9fd64006b6205f420d6e7d74" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 44819 } } peers { permanent_uuid: "354d5113c37743aa8300abdb229b7106" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 41905 } } peers { permanent_uuid: "bd9c6cd01570488cac503f339622298c" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 43703 } }
I20260811 08:09:08.436463 8703 tablet_bootstrap.cc:654] T 19449772f7394ff28680fc414e9ece97 P 354d5113c37743aa8300abdb229b7106: Neither blocks nor log segments found. Creating new log.
I20260811 08:09:08.436546 8697 ts_tablet_manager.cc:1428] T 19449772f7394ff28680fc414e9ece97 P 2af48f4f9fd64006b6205f420d6e7d74: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 08:09:08.436777 8209 heartbeater.cc:503] Master 127.27.243.254:43189 was elected leader, sending a full tablet report...
I20260811 08:09:08.437192 8703 log.cc:824] T 19449772f7394ff28680fc414e9ece97 P 354d5113c37743aa8300abdb229b7106: Log is configured to *not* fsync() on all Append() calls
I20260811 08:09:08.438208 8703 tablet_bootstrap.cc:492] T 19449772f7394ff28680fc414e9ece97 P 354d5113c37743aa8300abdb229b7106: No bootstrap required, opened a new log
I20260811 08:09:08.438264 8703 ts_tablet_manager.cc:1397] T 19449772f7394ff28680fc414e9ece97 P 354d5113c37743aa8300abdb229b7106: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260811 08:09:08.439558 8703 raft_consensus.cc:348] T 19449772f7394ff28680fc414e9ece97 P 354d5113c37743aa8300abdb229b7106 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af48f4f9fd64006b6205f420d6e7d74" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 44819 } } peers { permanent_uuid: "354d5113c37743aa8300abdb229b7106" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 41905 } } peers { permanent_uuid: "bd9c6cd01570488cac503f339622298c" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 43703 } }
I20260811 08:09:08.439677 8703 raft_consensus.cc:374] T 19449772f7394ff28680fc414e9ece97 P 354d5113c37743aa8300abdb229b7106 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:09:08.439695 8703 raft_consensus.cc:729] T 19449772f7394ff28680fc414e9ece97 P 354d5113c37743aa8300abdb229b7106 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 354d5113c37743aa8300abdb229b7106, State: Initialized, Role: FOLLOWER
I20260811 08:09:08.439779 8703 consensus_queue.cc:260] T 19449772f7394ff28680fc414e9ece97 P 354d5113c37743aa8300abdb229b7106 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af48f4f9fd64006b6205f420d6e7d74" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 44819 } } peers { permanent_uuid: "354d5113c37743aa8300abdb229b7106" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 41905 } } peers { permanent_uuid: "bd9c6cd01570488cac503f339622298c" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 43703 } }
I20260811 08:09:08.439985 8703 ts_tablet_manager.cc:1428] T 19449772f7394ff28680fc414e9ece97 P 354d5113c37743aa8300abdb229b7106: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260811 08:09:08.440055 8429 heartbeater.cc:503] Master 127.27.243.254:43189 was elected leader, sending a full tablet report...
I20260811 08:09:08.474047 8706 raft_consensus.cc:482] T 19449772f7394ff28680fc414e9ece97 P 2af48f4f9fd64006b6205f420d6e7d74 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:09:08.474220 8706 raft_consensus.cc:504] T 19449772f7394ff28680fc414e9ece97 P 2af48f4f9fd64006b6205f420d6e7d74 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af48f4f9fd64006b6205f420d6e7d74" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 44819 } } peers { permanent_uuid: "354d5113c37743aa8300abdb229b7106" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 41905 } } peers { permanent_uuid: "bd9c6cd01570488cac503f339622298c" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 43703 } }
I20260811 08:09:08.474603 8706 leader_election.cc:288] T 19449772f7394ff28680fc414e9ece97 P 2af48f4f9fd64006b6205f420d6e7d74 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 354d5113c37743aa8300abdb229b7106 (127.27.243.194:41905), bd9c6cd01570488cac503f339622298c (127.27.243.195:43703)
I20260811 08:09:08.477319 8696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:08.474887 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.193:52155 (local address 127.27.243.195:43703)
0811 08:09:08.474931 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:08.474933 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:08.475048 (+ 115us) server_negotiation.cc:407] Connection header received
0811 08:09:08.475101 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:08.475102 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:08.475111 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:08.475158 (+ 47us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:09:08.475285 (+ 127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:08.475743 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:08.476640 (+ 897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:08.477007 (+ 367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:08.477068 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:08.477077 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 08:09:08.477213 (+ 136us) server_negotiation.cc:299] Negotiation successful
0811 08:09:08.477250 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260811 08:09:08.477365 8694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:08.474838 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.193:42793 (local address 127.27.243.194:41905)
0811 08:09:08.474931 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:08.474934 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:08.474944 (+ 10us) server_negotiation.cc:407] Connection header received
0811 08:09:08.474975 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:08.474976 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:08.474987 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:08.475040 (+ 53us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:09:08.475210 (+ 170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:08.475702 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:08.476649 (+ 947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:08.477028 (+ 379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:08.477099 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:08.477107 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 08:09:08.477253 (+ 146us) server_negotiation.cc:299] Negotiation successful
0811 08:09:08.477292 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260811 08:09:08.477424 8220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:08.474776 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.194:41905 (local address 127.27.243.193:42793)
0811 08:09:08.474839 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:08.474851 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:08.474894 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:08.475063 (+ 169us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:08.475064 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:08.475066 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:09:08.475147 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:08.475149 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:08.475782 (+ 633us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:08.475783 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:08.476553 (+ 770us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:08.476556 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:08.477105 (+ 549us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:08.477106 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:08.477183 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:08.477187 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 08:09:08.477240 (+ 53us) client_negotiation.cc:240] Negotiation successful
0811 08:09:08.477292 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37}
I20260811 08:09:08.477376 8219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:08.474789 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.195:43703 (local address 127.27.243.193:52155)
0811 08:09:08.474990 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:08.474999 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:08.475049 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:08.475164 (+ 115us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:08.475165 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:08.475167 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:09:08.475232 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:08.475234 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:08.475812 (+ 578us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:08.475813 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:08.476557 (+ 744us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:08.476559 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:08.477078 (+ 519us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:08.477079 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:08.477154 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:08.477157 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 08:09:08.477202 (+ 45us) client_negotiation.cc:240] Negotiation successful
0811 08:09:08.477239 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":185,"mutex_wait_us":159}
I20260811 08:09:08.477823 8570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "19449772f7394ff28680fc414e9ece97" candidate_uuid: "2af48f4f9fd64006b6205f420d6e7d74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd9c6cd01570488cac503f339622298c" is_pre_election: true
I20260811 08:09:08.478003 8570 raft_consensus.cc:2454] T 19449772f7394ff28680fc414e9ece97 P bd9c6cd01570488cac503f339622298c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af48f4f9fd64006b6205f420d6e7d74 in term 0.
I20260811 08:09:08.478191 8349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "19449772f7394ff28680fc414e9ece97" candidate_uuid: "2af48f4f9fd64006b6205f420d6e7d74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "354d5113c37743aa8300abdb229b7106" is_pre_election: true
I20260811 08:09:08.478236 8023 leader_election.cc:302] T 19449772f7394ff28680fc414e9ece97 P 2af48f4f9fd64006b6205f420d6e7d74 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af48f4f9fd64006b6205f420d6e7d74, bd9c6cd01570488cac503f339622298c; no voters:
I20260811 08:09:08.478338 8349 raft_consensus.cc:2454] T 19449772f7394ff28680fc414e9ece97 P 354d5113c37743aa8300abdb229b7106 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af48f4f9fd64006b6205f420d6e7d74 in term 0.
I20260811 08:09:08.478358 8706 raft_consensus.cc:2781] T 19449772f7394ff28680fc414e9ece97 P 2af48f4f9fd64006b6205f420d6e7d74 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 08:09:08.478402 8706 raft_consensus.cc:482] T 19449772f7394ff28680fc414e9ece97 P 2af48f4f9fd64006b6205f420d6e7d74 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 08:09:08.478436 8706 raft_consensus.cc:3037] T 19449772f7394ff28680fc414e9ece97 P 2af48f4f9fd64006b6205f420d6e7d74 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:09:08.479379 8706 raft_consensus.cc:504] T 19449772f7394ff28680fc414e9ece97 P 2af48f4f9fd64006b6205f420d6e7d74 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af48f4f9fd64006b6205f420d6e7d74" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 44819 } } peers { permanent_uuid: "354d5113c37743aa8300abdb229b7106" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 41905 } } peers { permanent_uuid: "bd9c6cd01570488cac503f339622298c" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 43703 } }
I20260811 08:09:08.479511 8706 leader_election.cc:288] T 19449772f7394ff28680fc414e9ece97 P 2af48f4f9fd64006b6205f420d6e7d74 [CANDIDATE]: Term 1 election: Requested vote from peers 354d5113c37743aa8300abdb229b7106 (127.27.243.194:41905), bd9c6cd01570488cac503f339622298c (127.27.243.195:43703)
I20260811 08:09:08.479651 8570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "19449772f7394ff28680fc414e9ece97" candidate_uuid: "2af48f4f9fd64006b6205f420d6e7d74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd9c6cd01570488cac503f339622298c"
I20260811 08:09:08.479724 8349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "19449772f7394ff28680fc414e9ece97" candidate_uuid: "2af48f4f9fd64006b6205f420d6e7d74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "354d5113c37743aa8300abdb229b7106"
I20260811 08:09:08.479734 8570 raft_consensus.cc:3037] T 19449772f7394ff28680fc414e9ece97 P bd9c6cd01570488cac503f339622298c [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:09:08.479800 8349 raft_consensus.cc:3037] T 19449772f7394ff28680fc414e9ece97 P 354d5113c37743aa8300abdb229b7106 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:09:08.480645 8570 raft_consensus.cc:2454] T 19449772f7394ff28680fc414e9ece97 P bd9c6cd01570488cac503f339622298c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af48f4f9fd64006b6205f420d6e7d74 in term 1.
I20260811 08:09:08.480645 8349 raft_consensus.cc:2454] T 19449772f7394ff28680fc414e9ece97 P 354d5113c37743aa8300abdb229b7106 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af48f4f9fd64006b6205f420d6e7d74 in term 1.
I20260811 08:09:08.480829 8023 leader_election.cc:302] T 19449772f7394ff28680fc414e9ece97 P 2af48f4f9fd64006b6205f420d6e7d74 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af48f4f9fd64006b6205f420d6e7d74, bd9c6cd01570488cac503f339622298c; no voters:
I20260811 08:09:08.480916 8706 raft_consensus.cc:2781] T 19449772f7394ff28680fc414e9ece97 P 2af48f4f9fd64006b6205f420d6e7d74 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:09:08.481057 8706 raft_consensus.cc:686] T 19449772f7394ff28680fc414e9ece97 P 2af48f4f9fd64006b6205f420d6e7d74 [term 1 LEADER]: Becoming Leader. State: Replica: 2af48f4f9fd64006b6205f420d6e7d74, State: Running, Role: LEADER
I20260811 08:09:08.481227 8706 consensus_queue.cc:237] T 19449772f7394ff28680fc414e9ece97 P 2af48f4f9fd64006b6205f420d6e7d74 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af48f4f9fd64006b6205f420d6e7d74" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 44819 } } peers { permanent_uuid: "354d5113c37743aa8300abdb229b7106" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 41905 } } peers { permanent_uuid: "bd9c6cd01570488cac503f339622298c" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 43703 } }
I20260811 08:09:08.482055 6567 catalog_manager.cc:5495] T 19449772f7394ff28680fc414e9ece97 P 2af48f4f9fd64006b6205f420d6e7d74 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2af48f4f9fd64006b6205f420d6e7d74 (127.27.243.193). New cstate: current_term: 1 leader_uuid: "2af48f4f9fd64006b6205f420d6e7d74" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af48f4f9fd64006b6205f420d6e7d74" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 44819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "354d5113c37743aa8300abdb229b7106" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 41905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd9c6cd01570488cac503f339622298c" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 43703 } health_report { overall_health: UNKNOWN } } }
W20260811 08:09:08.486687 8432 tablet.cc:2369] T 19449772f7394ff28680fc414e9ece97 P 354d5113c37743aa8300abdb229b7106: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 08:09:08.497715 8693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:08.495496 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46128 (local address 127.27.243.193:44819)
0811 08:09:08.495541 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:08.495543 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:08.495552 (+ 9us) server_negotiation.cc:407] Connection header received
0811 08:09:08.495601 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:08.495603 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:08.495620 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:08.495679 (+ 59us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:09:08.495819 (+ 140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:08.496287 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:08.497013 (+ 726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:08.497226 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:08.497281 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:08.497380 (+ 99us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:09:08.497490 (+ 110us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:09:08.497605 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0811 08:09:08.497618 (+ 13us) server_negotiation.cc:299] Negotiation successful
0811 08:09:08.497636 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 08:09:08.499480 8570 raft_consensus.cc:1261] T 19449772f7394ff28680fc414e9ece97 P bd9c6cd01570488cac503f339622298c [term 1 FOLLOWER]: Refusing update from remote peer 2af48f4f9fd64006b6205f420d6e7d74: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:09:08.499480 8349 raft_consensus.cc:1261] T 19449772f7394ff28680fc414e9ece97 P 354d5113c37743aa8300abdb229b7106 [term 1 FOLLOWER]: Refusing update from remote peer 2af48f4f9fd64006b6205f420d6e7d74: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:09:08.499790 8706 consensus_queue.cc:1035] T 19449772f7394ff28680fc414e9ece97 P 2af48f4f9fd64006b6205f420d6e7d74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "354d5113c37743aa8300abdb229b7106" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 41905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:09:08.499944 8715 consensus_queue.cc:1035] T 19449772f7394ff28680fc414e9ece97 P 2af48f4f9fd64006b6205f420d6e7d74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd9c6cd01570488cac503f339622298c" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 43703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:09:08.502532 8718 mvcc.cc:205] Tried to move back new op lower bound from 7317240825851273216 to 7317240825779699712. Current Snapshot: MvccSnapshot[applied={T|T < 7317240825851273216}]
I20260811 08:09:08.502638 8724 mvcc.cc:205] Tried to move back new op lower bound from 7317240825851273216 to 7317240825779699712. Current Snapshot: MvccSnapshot[applied={T|T < 7317240825851273216}]
I20260811 08:09:08.505136 8721 mvcc.cc:205] Tried to move back new op lower bound from 7317240825851273216 to 7317240825779699712. Current Snapshot: MvccSnapshot[applied={T|T < 7317240825851273216}]
I20260811 08:09:08.505323 6567 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54910:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:09:08.505411 6567 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54910:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:09:08.507004 6567 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1e9672280b3347719b31d040efc4c7ee: Sending DeleteTablet for 3 replicas of tablet 19449772f7394ff28680fc414e9ece97
I20260811 08:09:08.507355 8537 tablet_service.cc:1514] Processing DeleteTablet for tablet 19449772f7394ff28680fc414e9ece97 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:09:08 UTC) from {username='oryx', principal='oryx/127.27.243.254@KRBTEST.COM'} at 127.0.0.1:51622
I20260811 08:09:08.507401 8095 tablet_service.cc:1514] Processing DeleteTablet for tablet 19449772f7394ff28680fc414e9ece97 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:09:08 UTC) from {username='oryx', principal='oryx/127.27.243.254@KRBTEST.COM'} at 127.0.0.1:46116
I20260811 08:09:08.507589 8739 tablet_replica.cc:330] T 19449772f7394ff28680fc414e9ece97 P bd9c6cd01570488cac503f339622298c: stopping tablet replica
I20260811 08:09:08.507623 8317 tablet_service.cc:1514] Processing DeleteTablet for tablet 19449772f7394ff28680fc414e9ece97 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:09:08 UTC) from {username='oryx', principal='oryx/127.27.243.254@KRBTEST.COM'} at 127.0.0.1:46776
I20260811 08:09:08.507686 8739 raft_consensus.cc:2229] T 19449772f7394ff28680fc414e9ece97 P bd9c6cd01570488cac503f339622298c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:09:08.507761 8744 tablet_replica.cc:330] T 19449772f7394ff28680fc414e9ece97 P 2af48f4f9fd64006b6205f420d6e7d74: stopping tablet replica
I20260811 08:09:08.507793 8739 raft_consensus.cc:2258] T 19449772f7394ff28680fc414e9ece97 P bd9c6cd01570488cac503f339622298c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:09:08.507901 8744 raft_consensus.cc:2229] T 19449772f7394ff28680fc414e9ece97 P 2af48f4f9fd64006b6205f420d6e7d74 [term 1 LEADER]: Raft consensus shutting down.
I20260811 08:09:08.508034 8744 raft_consensus.cc:2258] T 19449772f7394ff28680fc414e9ece97 P 2af48f4f9fd64006b6205f420d6e7d74 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:09:08.508262 8739 ts_tablet_manager.cc:1905] T 19449772f7394ff28680fc414e9ece97 P bd9c6cd01570488cac503f339622298c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:09:08.508875 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 6512
I20260811 08:09:08.509966 8739 ts_tablet_manager.cc:1918] T 19449772f7394ff28680fc414e9ece97 P bd9c6cd01570488cac503f339622298c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:09:08.510031 8739 log.cc:1196] T 19449772f7394ff28680fc414e9ece97 P bd9c6cd01570488cac503f339622298c: Deleting WAL directory at /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/ts-2/wal/wals/19449772f7394ff28680fc414e9ece97
I20260811 08:09:08.510247 8739 ts_tablet_manager.cc:1939] T 19449772f7394ff28680fc414e9ece97 P bd9c6cd01570488cac503f339622298c: Deleting consensus metadata
I20260811 08:09:08.509116 8744 ts_tablet_manager.cc:1905] T 19449772f7394ff28680fc414e9ece97 P 2af48f4f9fd64006b6205f420d6e7d74: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:09:08.517613 8744 ts_tablet_manager.cc:1918] T 19449772f7394ff28680fc414e9ece97 P 2af48f4f9fd64006b6205f420d6e7d74: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:09:08.517752 8744 log.cc:1196] T 19449772f7394ff28680fc414e9ece97 P 2af48f4f9fd64006b6205f420d6e7d74: Deleting WAL directory at /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/ts-0/wal/wals/19449772f7394ff28680fc414e9ece97
I20260811 08:09:08.518159 8744 ts_tablet_manager.cc:1939] T 19449772f7394ff28680fc414e9ece97 P 2af48f4f9fd64006b6205f420d6e7d74: Deleting consensus metadata
I20260811 08:09:08.521103 8745 tablet_replica.cc:330] T 19449772f7394ff28680fc414e9ece97 P 354d5113c37743aa8300abdb229b7106: stopping tablet replica
I20260811 08:09:08.521225 8745 raft_consensus.cc:2229] T 19449772f7394ff28680fc414e9ece97 P 354d5113c37743aa8300abdb229b7106 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:09:08.521344 8745 raft_consensus.cc:2258] T 19449772f7394ff28680fc414e9ece97 P 354d5113c37743aa8300abdb229b7106 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:09:08.523041 8745 ts_tablet_manager.cc:1905] T 19449772f7394ff28680fc414e9ece97 P 354d5113c37743aa8300abdb229b7106: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:09:08.524632 8745 ts_tablet_manager.cc:1918] T 19449772f7394ff28680fc414e9ece97 P 354d5113c37743aa8300abdb229b7106: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:09:08.524721 8745 log.cc:1196] T 19449772f7394ff28680fc414e9ece97 P 354d5113c37743aa8300abdb229b7106: Deleting WAL directory at /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/ts-1/wal/wals/19449772f7394ff28680fc414e9ece97
I20260811 08:09:08.525023 8745 ts_tablet_manager.cc:1939] T 19449772f7394ff28680fc414e9ece97 P 354d5113c37743aa8300abdb229b7106: Deleting consensus metadata
W20260811 08:09:08.528354 8468 connection.cc:535] server connection from 127.0.0.1:51622 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260811 08:09:08.528353 8255 connection.cc:535] server connection from 127.0.0.1:46776 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260811 08:09:08.528548 8023 connection.cc:535] server connection from 127.0.0.1:46116 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260811 08:09:08.529855 8679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:08.508629 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52836 (local address 127.27.243.252:45529)
0811 08:09:08.508667 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:08.508669 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:08.521578 (+ 12909us) server_negotiation.cc:407] Connection header received
0811 08:09:08.521677 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:08.521678 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:08.521695 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:08.521768 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:08.522689 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:08.523467 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:08.524557 (+ 1090us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:08.524868 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:08.524916 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:08.526651 (+ 1735us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:09:08.526653 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:09:08.526654 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:09:08.526661 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:09:08.528363 (+ 1702us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:08.528788 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:08.528789 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:08.528790 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:08.528854 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:08.529075 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:08.529076 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:08.529076 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:08.529206 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:09:08.529292 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0811 08:09:08.529666 (+ 374us) server_negotiation.cc:299] Negotiation successful
0811 08:09:08.529762 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 08:09:08.536222 8679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:08.530627 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52848 (local address 127.27.243.252:45529)
0811 08:09:08.530668 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:08.530670 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:08.530767 (+ 97us) server_negotiation.cc:407] Connection header received
0811 08:09:08.530828 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:08.530829 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:08.530838 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:08.530881 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:08.531396 (+ 515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:08.531918 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:08.532642 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:08.532846 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:08.532899 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:08.533977 (+ 1078us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:09:08.533978 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:09:08.533978 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:09:08.533984 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:09:08.535195 (+ 1211us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:08.535493 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:08.535494 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:08.535494 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:08.535546 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:08.535702 (+ 156us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:08.535703 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:08.535703 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:08.535833 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:09:08.535925 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0811 08:09:08.536062 (+ 137us) server_negotiation.cc:299] Negotiation successful
0811 08:09:08.536137 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 08:09:08.538316 7672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:08.530418 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49608 (local address 127.27.243.253:41319)
0811 08:09:08.530477 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:08.530480 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:08.530630 (+ 150us) server_negotiation.cc:407] Connection header received
0811 08:09:08.530741 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:08.530742 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:08.530757 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:08.530821 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:08.532162 (+ 1341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:08.532891 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:08.533953 (+ 1062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:08.534241 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:08.534294 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:08.535766 (+ 1472us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:09:08.535768 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:09:08.535768 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:09:08.535774 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:09:08.537085 (+ 1311us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:08.537458 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:08.537459 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:08.537459 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:08.537502 (+ 43us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:08.537900 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:08.537901 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:08.537901 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:08.538002 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:09:08.538072 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 08:09:08.538199 (+ 127us) server_negotiation.cc:299] Negotiation successful
0811 08:09:08.538254 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260811 08:09:09.504408 8758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:09.504126 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:43189 (local address 127.27.243.195:40491)
0811 08:09:09.504244 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:09.504334 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:43189: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":63,"threads_started":1}
W20260811 08:09:09.504678 8660 heartbeater.cc:644] Failed to heartbeat to 127.27.243.254:43189 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.27.243.254:43189: connect: Connection refused (error 111)
I20260811 08:09:09.505618 8761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:09.505360 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:43189 (local address 127.27.243.193:56441)
0811 08:09:09.505463 (+ 103us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:09.505563 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:43189: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":86,"thread_start_us":59,"threads_started":1}
W20260811 08:09:09.505800 8209 heartbeater.cc:644] Failed to heartbeat to 127.27.243.254:43189 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.27.243.254:43189: connect: Connection refused (error 111)
I20260811 08:09:09.507833 8764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:09.507627 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:43189 (local address 127.27.243.194:46715)
0811 08:09:09.507731 (+ 104us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:09.507791 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:43189: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":85,"thread_start_us":49,"threads_started":1}
W20260811 08:09:09.508036 8429 heartbeater.cc:644] Failed to heartbeat to 127.27.243.254:43189 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.27.243.254:43189: connect: Connection refused (error 111)
I20260811 08:09:10.007874 8766 raft_consensus.cc:482] T 00000000000000000000000000000000 P 50172d9ed73e463c9f5d4a120c34be6d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e9672280b3347719b31d040efc4c7ee)
I20260811 08:09:10.008025 8768 raft_consensus.cc:482] T 00000000000000000000000000000000 P e7239e9050e74949bd7be2f23f82fc50 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e9672280b3347719b31d040efc4c7ee)
I20260811 08:09:10.008018 8766 raft_consensus.cc:504] T 00000000000000000000000000000000 P 50172d9ed73e463c9f5d4a120c34be6d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "1e9672280b3347719b31d040efc4c7ee" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 43189 } } peers { permanent_uuid: "e7239e9050e74949bd7be2f23f82fc50" member_type: VOTER last_known_addr { host: "127.27.243.253" port: 41319 } attrs { promote: false } } peers { permanent_uuid: "50172d9ed73e463c9f5d4a120c34be6d" member_type: VOTER last_known_addr { host: "127.27.243.252" port: 45529 } attrs { promote: false } }
I20260811 08:09:10.008148 8768 raft_consensus.cc:504] T 00000000000000000000000000000000 P e7239e9050e74949bd7be2f23f82fc50 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "1e9672280b3347719b31d040efc4c7ee" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 43189 } } peers { permanent_uuid: "e7239e9050e74949bd7be2f23f82fc50" member_type: VOTER last_known_addr { host: "127.27.243.253" port: 41319 } attrs { promote: false } } peers { permanent_uuid: "50172d9ed73e463c9f5d4a120c34be6d" member_type: VOTER last_known_addr { host: "127.27.243.252" port: 45529 } attrs { promote: false } }
I20260811 08:09:10.008297 8766 leader_election.cc:288] T 00000000000000000000000000000000 P 50172d9ed73e463c9f5d4a120c34be6d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e9672280b3347719b31d040efc4c7ee (127.27.243.254:43189), e7239e9050e74949bd7be2f23f82fc50 (127.27.243.253:41319)
I20260811 08:09:10.008674 8774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:10.008424 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:43189 (local address 127.0.0.1:55340)
0811 08:09:10.008571 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:10.008636 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:43189: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":53,"threads_started":1}
I20260811 08:09:10.008671 8768 leader_election.cc:288] T 00000000000000000000000000000000 P e7239e9050e74949bd7be2f23f82fc50 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e9672280b3347719b31d040efc4c7ee (127.27.243.254:43189), 50172d9ed73e463c9f5d4a120c34be6d (127.27.243.252:45529)
W20260811 08:09:10.008847 7895 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.27.243.254:43189: connect: Connection refused (error 111)
I20260811 08:09:10.008939 8779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:10.008728 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:43189 (local address 127.0.0.1:55346)
0811 08:09:10.008850 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:10.008905 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:43189: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":43,"threads_started":1}
W20260811 08:09:10.009043 7568 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.27.243.254:43189: connect: Connection refused (error 111)
I20260811 08:09:10.009423 8774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:10.009316 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:43189 (local address 127.0.0.1:55348)
0811 08:09:10.009349 (+ 33us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:10.009380 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:43189: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":19}
I20260811 08:09:10.009459 8779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:10.009352 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:43189 (local address 127.0.0.1:55352)
0811 08:09:10.009410 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:10.009437 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:43189: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260811 08:09:10.009569 7568 leader_election.cc:334] T 00000000000000000000000000000000 P e7239e9050e74949bd7be2f23f82fc50 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1e9672280b3347719b31d040efc4c7ee (127.27.243.254:43189): Network error: Client connection negotiation failed: client connection to 127.27.243.254:43189: connect: Connection refused (error 111)
W20260811 08:09:10.009627 7895 leader_election.cc:334] T 00000000000000000000000000000000 P 50172d9ed73e463c9f5d4a120c34be6d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1e9672280b3347719b31d040efc4c7ee (127.27.243.254:43189): Network error: Client connection negotiation failed: client connection to 127.27.243.254:43189: connect: Connection refused (error 111)
I20260811 08:09:10.011884 8772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:10.008460 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.253:41319 (local address 127.0.0.1:49612)
0811 08:09:10.008594 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:10.008605 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:10.008677 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:10.009440 (+ 763us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:10.009441 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:10.009443 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:09:10.009500 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:10.009502 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:10.010240 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:10.010241 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:10.011073 (+ 832us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:10.011076 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:10.011639 (+ 563us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:10.011640 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:10.011705 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:10.011709 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 08:09:10.011761 (+ 52us) client_negotiation.cc:240] Negotiation successful
0811 08:09:10.011815 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":69,"threads_started":1}
I20260811 08:09:10.011884 8777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:10.008521 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49612 (local address 127.27.243.253:41319)
0811 08:09:10.008614 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:10.008617 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:10.009217 (+ 600us) server_negotiation.cc:407] Connection header received
0811 08:09:10.009361 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:10.009362 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:10.009374 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:10.009433 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:09:10.009612 (+ 179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:10.010172 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:10.011155 (+ 983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:10.011568 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:10.011631 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:10.011641 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 08:09:10.011779 (+ 138us) server_negotiation.cc:299] Negotiation successful
0811 08:09:10.011821 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77,"thread_start_us":44,"threads_started":1}
I20260811 08:09:10.012072 8785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:10.008954 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.252:45529 (local address 127.0.0.1:52858)
0811 08:09:10.009061 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:10.009071 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:10.009121 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:10.009598 (+ 477us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:10.009600 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:10.009602 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:09:10.009656 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:10.009658 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:10.010376 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:10.010377 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:10.011187 (+ 810us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:10.011190 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:10.011730 (+ 540us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:10.011730 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:10.011782 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:10.011785 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 08:09:10.011828 (+ 43us) client_negotiation.cc:240] Negotiation successful
0811 08:09:10.011872 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":94,"thread_start_us":43,"threads_started":1}
I20260811 08:09:10.012080 8792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:10.009123 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52858 (local address 127.27.243.252:45529)
0811 08:09:10.009288 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:10.009290 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:10.009300 (+ 10us) server_negotiation.cc:407] Connection header received
0811 08:09:10.009326 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:10.009327 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:10.009337 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:10.009724 (+ 387us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:09:10.009757 (+ 33us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:10.010295 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:10.011278 (+ 983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:10.011666 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:10.011716 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:10.011724 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 08:09:10.011839 (+ 115us) server_negotiation.cc:299] Negotiation successful
0811 08:09:10.011878 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":71,"threads_started":1}
I20260811 08:09:10.012148 7609 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "50172d9ed73e463c9f5d4a120c34be6d" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "e7239e9050e74949bd7be2f23f82fc50" is_pre_election: true
I20260811 08:09:10.012260 7609 raft_consensus.cc:2454] T 00000000000000000000000000000000 P e7239e9050e74949bd7be2f23f82fc50 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50172d9ed73e463c9f5d4a120c34be6d in term 1.
I20260811 08:09:10.012357 7934 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e7239e9050e74949bd7be2f23f82fc50" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "50172d9ed73e463c9f5d4a120c34be6d" is_pre_election: true
I20260811 08:09:10.012398 7898 leader_election.cc:302] T 00000000000000000000000000000000 P 50172d9ed73e463c9f5d4a120c34be6d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50172d9ed73e463c9f5d4a120c34be6d, e7239e9050e74949bd7be2f23f82fc50; no voters: 1e9672280b3347719b31d040efc4c7ee
I20260811 08:09:10.012452 7934 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 50172d9ed73e463c9f5d4a120c34be6d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e7239e9050e74949bd7be2f23f82fc50 in term 1.
I20260811 08:09:10.012496 8766 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 50172d9ed73e463c9f5d4a120c34be6d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260811 08:09:10.012538 8766 raft_consensus.cc:482] T 00000000000000000000000000000000 P 50172d9ed73e463c9f5d4a120c34be6d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1e9672280b3347719b31d040efc4c7ee)
I20260811 08:09:10.012564 8766 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 50172d9ed73e463c9f5d4a120c34be6d [term 1 FOLLOWER]: Advancing to term 2
I20260811 08:09:10.012612 7570 leader_election.cc:302] T 00000000000000000000000000000000 P e7239e9050e74949bd7be2f23f82fc50 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50172d9ed73e463c9f5d4a120c34be6d, e7239e9050e74949bd7be2f23f82fc50; no voters: 1e9672280b3347719b31d040efc4c7ee
I20260811 08:09:10.012722 8768 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e7239e9050e74949bd7be2f23f82fc50 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260811 08:09:10.012768 8768 raft_consensus.cc:482] T 00000000000000000000000000000000 P e7239e9050e74949bd7be2f23f82fc50 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1e9672280b3347719b31d040efc4c7ee)
I20260811 08:09:10.012799 8768 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e7239e9050e74949bd7be2f23f82fc50 [term 1 FOLLOWER]: Advancing to term 2
I20260811 08:09:10.013501 8766 raft_consensus.cc:504] T 00000000000000000000000000000000 P 50172d9ed73e463c9f5d4a120c34be6d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "1e9672280b3347719b31d040efc4c7ee" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 43189 } } peers { permanent_uuid: "e7239e9050e74949bd7be2f23f82fc50" member_type: VOTER last_known_addr { host: "127.27.243.253" port: 41319 } attrs { promote: false } } peers { permanent_uuid: "50172d9ed73e463c9f5d4a120c34be6d" member_type: VOTER last_known_addr { host: "127.27.243.252" port: 45529 } attrs { promote: false } }
I20260811 08:09:10.013672 8766 leader_election.cc:288] T 00000000000000000000000000000000 P 50172d9ed73e463c9f5d4a120c34be6d [CANDIDATE]: Term 2 election: Requested vote from peers 1e9672280b3347719b31d040efc4c7ee (127.27.243.254:43189), e7239e9050e74949bd7be2f23f82fc50 (127.27.243.253:41319)
I20260811 08:09:10.013667 8768 raft_consensus.cc:504] T 00000000000000000000000000000000 P e7239e9050e74949bd7be2f23f82fc50 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "1e9672280b3347719b31d040efc4c7ee" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 43189 } } peers { permanent_uuid: "e7239e9050e74949bd7be2f23f82fc50" member_type: VOTER last_known_addr { host: "127.27.243.253" port: 41319 } attrs { promote: false } } peers { permanent_uuid: "50172d9ed73e463c9f5d4a120c34be6d" member_type: VOTER last_known_addr { host: "127.27.243.252" port: 45529 } attrs { promote: false } }
I20260811 08:09:10.013813 7609 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "50172d9ed73e463c9f5d4a120c34be6d" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "e7239e9050e74949bd7be2f23f82fc50"
I20260811 08:09:10.013916 7609 raft_consensus.cc:2379] T 00000000000000000000000000000000 P e7239e9050e74949bd7be2f23f82fc50 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 50172d9ed73e463c9f5d4a120c34be6d in current term 2: Already voted for candidate e7239e9050e74949bd7be2f23f82fc50 in this term.
I20260811 08:09:10.013819 8768 leader_election.cc:288] T 00000000000000000000000000000000 P e7239e9050e74949bd7be2f23f82fc50 [CANDIDATE]: Term 2 election: Requested vote from peers 1e9672280b3347719b31d040efc4c7ee (127.27.243.254:43189), 50172d9ed73e463c9f5d4a120c34be6d (127.27.243.252:45529)
I20260811 08:09:10.013952 7934 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e7239e9050e74949bd7be2f23f82fc50" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "50172d9ed73e463c9f5d4a120c34be6d"
I20260811 08:09:10.013993 8785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:10.013913 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:43189 (local address 127.0.0.1:55372)
0811 08:09:10.013944 (+ 31us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:10.013971 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:43189: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":16}
I20260811 08:09:10.014022 7934 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 50172d9ed73e463c9f5d4a120c34be6d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e7239e9050e74949bd7be2f23f82fc50 in current term 2: Already voted for candidate 50172d9ed73e463c9f5d4a120c34be6d in this term.
I20260811 08:09:10.014055 8772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:10.013857 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:43189 (local address 127.0.0.1:55366)
0811 08:09:10.014008 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:10.014034 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:43189: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":137}
I20260811 08:09:10.014297 8785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:10.014218 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:43189 (local address 127.0.0.1:55382)
0811 08:09:10.014248 (+ 30us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:10.014274 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:43189: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":17}
W20260811 08:09:10.014348 7568 leader_election.cc:334] T 00000000000000000000000000000000 P e7239e9050e74949bd7be2f23f82fc50 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 1e9672280b3347719b31d040efc4c7ee (127.27.243.254:43189): Network error: Client connection negotiation failed: client connection to 127.27.243.254:43189: connect: Connection refused (error 111)
I20260811 08:09:10.014361 8772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:10.014277 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:43189 (local address 127.0.0.1:55390)
0811 08:09:10.014311 (+ 34us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:10.014337 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:43189: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":17}
I20260811 08:09:10.014421 7570 leader_election.cc:302] T 00000000000000000000000000000000 P e7239e9050e74949bd7be2f23f82fc50 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e7239e9050e74949bd7be2f23f82fc50; no voters: 1e9672280b3347719b31d040efc4c7ee, 50172d9ed73e463c9f5d4a120c34be6d
W20260811 08:09:10.014465 7895 leader_election.cc:334] T 00000000000000000000000000000000 P 50172d9ed73e463c9f5d4a120c34be6d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 1e9672280b3347719b31d040efc4c7ee (127.27.243.254:43189): Network error: Client connection negotiation failed: client connection to 127.27.243.254:43189: connect: Connection refused (error 111)
I20260811 08:09:10.014495 7895 leader_election.cc:302] T 00000000000000000000000000000000 P 50172d9ed73e463c9f5d4a120c34be6d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50172d9ed73e463c9f5d4a120c34be6d; no voters: 1e9672280b3347719b31d040efc4c7ee, e7239e9050e74949bd7be2f23f82fc50
I20260811 08:09:10.014554 8766 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 50172d9ed73e463c9f5d4a120c34be6d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260811 08:09:10.014540 8768 raft_consensus.cc:2726] T 00000000000000000000000000000000 P e7239e9050e74949bd7be2f23f82fc50 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260811 08:09:10.505229 8793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:10.504972 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:43189 (local address 127.27.243.195:41483)
0811 08:09:10.505119 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:10.505169 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:43189: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":79,"threads_started":1}
I20260811 08:09:10.506340 8795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:10.506108 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:43189 (local address 127.27.243.193:49135)
0811 08:09:10.506247 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:10.506293 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:43189: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":78,"threads_started":1}
I20260811 08:09:10.508525 8797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:10.508334 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:43189 (local address 127.27.243.194:55917)
0811 08:09:10.508446 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:10.508486 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:43189: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94,"thread_start_us":51,"threads_started":1}
I20260811 08:09:11.505957 8798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:11.505706 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:43189 (local address 127.27.243.195:45487)
0811 08:09:11.505860 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:11.505911 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:43189: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":57,"threads_started":1}
I20260811 08:09:11.507005 8801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:11.506807 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:43189 (local address 127.27.243.193:46059)
0811 08:09:11.506927 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:11.506961 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:43189: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":56,"threads_started":1}
I20260811 08:09:11.509056 8805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:11.508907 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:43189 (local address 127.27.243.194:40147)
0811 08:09:11.508997 (+ 90us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:11.509021 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:43189: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77,"thread_start_us":44,"threads_started":1}
I20260811 08:09:11.800534 8807 raft_consensus.cc:482] T 00000000000000000000000000000000 P 50172d9ed73e463c9f5d4a120c34be6d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:09:11.800631 8807 raft_consensus.cc:504] T 00000000000000000000000000000000 P 50172d9ed73e463c9f5d4a120c34be6d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "1e9672280b3347719b31d040efc4c7ee" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 43189 } } peers { permanent_uuid: "e7239e9050e74949bd7be2f23f82fc50" member_type: VOTER last_known_addr { host: "127.27.243.253" port: 41319 } attrs { promote: false } } peers { permanent_uuid: "50172d9ed73e463c9f5d4a120c34be6d" member_type: VOTER last_known_addr { host: "127.27.243.252" port: 45529 } attrs { promote: false } }
I20260811 08:09:11.800786 8807 leader_election.cc:288] T 00000000000000000000000000000000 P 50172d9ed73e463c9f5d4a120c34be6d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e9672280b3347719b31d040efc4c7ee (127.27.243.254:43189), e7239e9050e74949bd7be2f23f82fc50 (127.27.243.253:41319)
I20260811 08:09:11.801054 7609 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "50172d9ed73e463c9f5d4a120c34be6d" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "e7239e9050e74949bd7be2f23f82fc50" is_pre_election: true
I20260811 08:09:11.801118 8808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:11.800941 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:43189 (local address 127.0.0.1:55654)
0811 08:09:11.801037 (+ 96us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:11.801077 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:43189: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77,"thread_start_us":47,"threads_started":1}
I20260811 08:09:11.801152 7609 raft_consensus.cc:2454] T 00000000000000000000000000000000 P e7239e9050e74949bd7be2f23f82fc50 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50172d9ed73e463c9f5d4a120c34be6d in term 2.
I20260811 08:09:11.801306 7898 leader_election.cc:302] T 00000000000000000000000000000000 P 50172d9ed73e463c9f5d4a120c34be6d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50172d9ed73e463c9f5d4a120c34be6d, e7239e9050e74949bd7be2f23f82fc50; no voters:
I20260811 08:09:11.801429 8807 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 50172d9ed73e463c9f5d4a120c34be6d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260811 08:09:11.801473 8807 raft_consensus.cc:482] T 00000000000000000000000000000000 P 50172d9ed73e463c9f5d4a120c34be6d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 08:09:11.801492 8807 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 50172d9ed73e463c9f5d4a120c34be6d [term 2 FOLLOWER]: Advancing to term 3
I20260811 08:09:11.801549 8808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:11.801423 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:43189 (local address 127.0.0.1:55662)
0811 08:09:11.801462 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:11.801493 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:43189: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":22}
W20260811 08:09:11.801609 7895 leader_election.cc:334] T 00000000000000000000000000000000 P 50172d9ed73e463c9f5d4a120c34be6d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1e9672280b3347719b31d040efc4c7ee (127.27.243.254:43189): Network error: Client connection negotiation failed: client connection to 127.27.243.254:43189: connect: Connection refused (error 111)
I20260811 08:09:11.802320 8807 raft_consensus.cc:504] T 00000000000000000000000000000000 P 50172d9ed73e463c9f5d4a120c34be6d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "1e9672280b3347719b31d040efc4c7ee" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 43189 } } peers { permanent_uuid: "e7239e9050e74949bd7be2f23f82fc50" member_type: VOTER last_known_addr { host: "127.27.243.253" port: 41319 } attrs { promote: false } } peers { permanent_uuid: "50172d9ed73e463c9f5d4a120c34be6d" member_type: VOTER last_known_addr { host: "127.27.243.252" port: 45529 } attrs { promote: false } }
I20260811 08:09:11.802440 8807 leader_election.cc:288] T 00000000000000000000000000000000 P 50172d9ed73e463c9f5d4a120c34be6d [CANDIDATE]: Term 3 election: Requested vote from peers 1e9672280b3347719b31d040efc4c7ee (127.27.243.254:43189), e7239e9050e74949bd7be2f23f82fc50 (127.27.243.253:41319)
I20260811 08:09:11.802615 8808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:11.802532 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:43189 (local address 127.0.0.1:55672)
0811 08:09:11.802575 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:11.802599 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:43189: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
I20260811 08:09:11.802579 7609 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "50172d9ed73e463c9f5d4a120c34be6d" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "e7239e9050e74949bd7be2f23f82fc50"
I20260811 08:09:11.802649 7609 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e7239e9050e74949bd7be2f23f82fc50 [term 2 FOLLOWER]: Advancing to term 3
I20260811 08:09:11.802903 8808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:11.802820 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:43189 (local address 127.0.0.1:55688)
0811 08:09:11.802858 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:11.802882 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:43189: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
W20260811 08:09:11.802970 7895 leader_election.cc:334] T 00000000000000000000000000000000 P 50172d9ed73e463c9f5d4a120c34be6d [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 1e9672280b3347719b31d040efc4c7ee (127.27.243.254:43189): Network error: Client connection negotiation failed: client connection to 127.27.243.254:43189: connect: Connection refused (error 111)
I20260811 08:09:11.803360 7609 raft_consensus.cc:2454] T 00000000000000000000000000000000 P e7239e9050e74949bd7be2f23f82fc50 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50172d9ed73e463c9f5d4a120c34be6d in term 3.
I20260811 08:09:11.803516 7898 leader_election.cc:302] T 00000000000000000000000000000000 P 50172d9ed73e463c9f5d4a120c34be6d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50172d9ed73e463c9f5d4a120c34be6d, e7239e9050e74949bd7be2f23f82fc50; no voters: 1e9672280b3347719b31d040efc4c7ee
I20260811 08:09:11.803601 8807 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 50172d9ed73e463c9f5d4a120c34be6d [term 3 FOLLOWER]: Leader election won for term 3
I20260811 08:09:11.803710 8807 raft_consensus.cc:686] T 00000000000000000000000000000000 P 50172d9ed73e463c9f5d4a120c34be6d [term 3 LEADER]: Becoming Leader. State: Replica: 50172d9ed73e463c9f5d4a120c34be6d, State: Running, Role: LEADER
I20260811 08:09:11.803793 8807 consensus_queue.cc:237] T 00000000000000000000000000000000 P 50172d9ed73e463c9f5d4a120c34be6d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "1e9672280b3347719b31d040efc4c7ee" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 43189 } } peers { permanent_uuid: "e7239e9050e74949bd7be2f23f82fc50" member_type: VOTER last_known_addr { host: "127.27.243.253" port: 41319 } attrs { promote: false } } peers { permanent_uuid: "50172d9ed73e463c9f5d4a120c34be6d" member_type: VOTER last_known_addr { host: "127.27.243.252" port: 45529 } attrs { promote: false } }
I20260811 08:09:11.804144 8810 sys_catalog.cc:455] T 00000000000000000000000000000000 P 50172d9ed73e463c9f5d4a120c34be6d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 50172d9ed73e463c9f5d4a120c34be6d. Latest consensus state: current_term: 3 leader_uuid: "50172d9ed73e463c9f5d4a120c34be6d" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "1e9672280b3347719b31d040efc4c7ee" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 43189 } } peers { permanent_uuid: "e7239e9050e74949bd7be2f23f82fc50" member_type: VOTER last_known_addr { host: "127.27.243.253" port: 41319 } attrs { promote: false } } peers { permanent_uuid: "50172d9ed73e463c9f5d4a120c34be6d" member_type: VOTER last_known_addr { host: "127.27.243.252" port: 45529 } attrs { promote: false } } }
I20260811 08:09:11.804239 8810 sys_catalog.cc:458] T 00000000000000000000000000000000 P 50172d9ed73e463c9f5d4a120c34be6d [sys.catalog]: This master's current role is: LEADER
I20260811 08:09:11.804414 8815 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:09:11.804806 8815 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:09:11.804865 8815 catalog_manager.cc:1259] Loaded cluster ID: 2e14b5917f2040f497e9ee9cf3e0af5e
I20260811 08:09:11.804880 8815 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:09:11.805044 8815 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:09:11.805114 8815 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 50172d9ed73e463c9f5d4a120c34be6d: Loaded TSK: 0
I20260811 08:09:11.805253 8815 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 08:09:11.850662 7916 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52848:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 08:09:11.852198 7916 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 08:09:11.853149 8808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:11.853040 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:43189 (local address 127.0.0.1:55708)
0811 08:09:11.853084 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:11.853115 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:43189: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
I20260811 08:09:11.853161 7609 raft_consensus.cc:1261] T 00000000000000000000000000000000 P e7239e9050e74949bd7be2f23f82fc50 [term 3 FOLLOWER]: Refusing update from remote peer 50172d9ed73e463c9f5d4a120c34be6d: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 3 index: 14. (index mismatch)
I20260811 08:09:11.853391 8810 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 50172d9ed73e463c9f5d4a120c34be6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7239e9050e74949bd7be2f23f82fc50" member_type: VOTER last_known_addr { host: "127.27.243.253" port: 41319 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260811 08:09:11.853469 8808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:11.853398 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:43189 (local address 127.0.0.1:55722)
0811 08:09:11.853425 (+ 27us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:11.853450 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:43189: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":14}
W20260811 08:09:11.853549 7895 consensus_peers.cc:487] T 00000000000000000000000000000000 P 50172d9ed73e463c9f5d4a120c34be6d -> Peer 1e9672280b3347719b31d040efc4c7ee (127.27.243.254:43189): Couldn't send request to peer 1e9672280b3347719b31d040efc4c7ee. Status: Network error: Client connection negotiation failed: client connection to 127.27.243.254:43189: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260811 08:09:11.854025 8818 sys_catalog.cc:455] T 00000000000000000000000000000000 P e7239e9050e74949bd7be2f23f82fc50 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 50172d9ed73e463c9f5d4a120c34be6d. Latest consensus state: current_term: 3 leader_uuid: "50172d9ed73e463c9f5d4a120c34be6d" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "1e9672280b3347719b31d040efc4c7ee" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 43189 } } peers { permanent_uuid: "e7239e9050e74949bd7be2f23f82fc50" member_type: VOTER last_known_addr { host: "127.27.243.253" port: 41319 } attrs { promote: false } } peers { permanent_uuid: "50172d9ed73e463c9f5d4a120c34be6d" member_type: VOTER last_known_addr { host: "127.27.243.252" port: 45529 } attrs { promote: false } } }
I20260811 08:09:11.854113 8818 sys_catalog.cc:458] T 00000000000000000000000000000000 P e7239e9050e74949bd7be2f23f82fc50 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 08:09:11.854417 8817 mvcc.cc:205] Tried to move back new op lower bound from 7317240839588667392 to 7317240839389069312. Current Snapshot: MvccSnapshot[applied={T|T < 7317240839588667392}]
I20260811 08:09:11.854509 8807 sys_catalog.cc:455] T 00000000000000000000000000000000 P 50172d9ed73e463c9f5d4a120c34be6d [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "50172d9ed73e463c9f5d4a120c34be6d" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "1e9672280b3347719b31d040efc4c7ee" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 43189 } } peers { permanent_uuid: "e7239e9050e74949bd7be2f23f82fc50" member_type: VOTER last_known_addr { host: "127.27.243.253" port: 41319 } attrs { promote: false } } peers { permanent_uuid: "50172d9ed73e463c9f5d4a120c34be6d" member_type: VOTER last_known_addr { host: "127.27.243.252" port: 45529 } attrs { promote: false } } }
I20260811 08:09:11.854573 8820 mvcc.cc:205] Tried to move back new op lower bound from 7317240839588667392 to 7317240839389069312. Current Snapshot: MvccSnapshot[applied={T|T < 7317240839588667392}]
I20260811 08:09:11.854597 8807 sys_catalog.cc:458] T 00000000000000000000000000000000 P 50172d9ed73e463c9f5d4a120c34be6d [sys.catalog]: This master's current role is: LEADER
I20260811 08:09:11.854717 8818 sys_catalog.cc:455] T 00000000000000000000000000000000 P e7239e9050e74949bd7be2f23f82fc50 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "50172d9ed73e463c9f5d4a120c34be6d" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "1e9672280b3347719b31d040efc4c7ee" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 43189 } } peers { permanent_uuid: "e7239e9050e74949bd7be2f23f82fc50" member_type: VOTER last_known_addr { host: "127.27.243.253" port: 41319 } attrs { promote: false } } peers { permanent_uuid: "50172d9ed73e463c9f5d4a120c34be6d" member_type: VOTER last_known_addr { host: "127.27.243.252" port: 45529 } attrs { promote: false } } }
I20260811 08:09:11.854790 8818 sys_catalog.cc:458] T 00000000000000000000000000000000 P e7239e9050e74949bd7be2f23f82fc50 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 08:09:11.859788 8830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:11.856605 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51628 (local address 127.27.243.195:43703)
0811 08:09:11.856908 (+ 303us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:11.856911 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:11.856921 (+ 10us) server_negotiation.cc:407] Connection header received
0811 08:09:11.856947 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:11.856947 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:11.856959 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:11.857035 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:09:11.857155 (+ 120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:11.857778 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:11.858968 (+ 1190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:11.859489 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:11.859553 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:11.859563 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 08:09:11.859679 (+ 116us) server_negotiation.cc:299] Negotiation successful
0811 08:09:11.859720 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":280,"thread_start_us":51,"threads_started":1}
I20260811 08:09:11.859779 8808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:11.856470 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.195:43703 (local address 127.0.0.1:51628)
0811 08:09:11.856513 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:11.856523 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:11.856572 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:11.857037 (+ 465us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:11.857038 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:11.857040 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:09:11.857093 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:11.857094 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:11.857855 (+ 761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:11.857856 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:11.858873 (+ 1017us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:11.858875 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:11.859557 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:11.859558 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:11.859618 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:11.859622 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 08:09:11.859668 (+ 46us) client_negotiation.cc:240] Negotiation successful
0811 08:09:11.859709 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":28}
I20260811 08:09:11.859910 8831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:11.856713 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46780 (local address 127.27.243.194:41905)
0811 08:09:11.857093 (+ 380us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:11.857096 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:11.857104 (+ 8us) server_negotiation.cc:407] Connection header received
0811 08:09:11.857128 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:11.857129 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:11.857140 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:11.857208 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:09:11.857311 (+ 103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:11.858072 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:11.859024 (+ 952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:11.859490 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:11.859556 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:11.859564 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 08:09:11.859808 (+ 244us) server_negotiation.cc:299] Negotiation successful
0811 08:09:11.859845 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":361,"thread_start_us":57,"threads_started":1}
I20260811 08:09:11.860040 8829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:11.856531 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.194:41905 (local address 127.0.0.1:46780)
0811 08:09:11.856659 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:11.856669 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:11.856705 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:11.857215 (+ 510us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:11.857216 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:11.857219 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:09:11.857258 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:11.857259 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:11.858161 (+ 902us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:11.858162 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:11.858933 (+ 771us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:11.858936 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:11.859595 (+ 659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:11.859596 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:11.859657 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:11.859661 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 08:09:11.859703 (+ 42us) client_negotiation.cc:240] Negotiation successful
0811 08:09:11.859740 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"mutex_wait_us":1,"thread_start_us":78,"threads_started":1}
I20260811 08:09:11.860312 8827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:11.856555 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.193:44819 (local address 127.0.0.1:46144)
0811 08:09:11.856939 (+ 384us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:11.856949 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:11.856999 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:11.857296 (+ 297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:11.857297 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:11.857300 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:09:11.857332 (+ 32us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:11.857334 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:11.858200 (+ 866us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:11.858201 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:11.859261 (+ 1060us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:11.859263 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:11.860092 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:11.860093 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:11.860157 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:11.860161 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 08:09:11.860216 (+ 55us) client_negotiation.cc:240] Negotiation successful
0811 08:09:11.860250 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":365,"mutex_wait_us":2,"thread_start_us":76,"threads_started":1}
I20260811 08:09:11.860353 8317 tablet_service.cc:1467] Processing CreateTablet for tablet 538b42b2372347b78ea14497789ba3ff (DEFAULT_TABLE table=test-table [id=567b1823d0464f678ea7be8994f6d109]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:09:11.860488 8317 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 538b42b2372347b78ea14497789ba3ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:09:11.860531 8833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:11.856734 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46144 (local address 127.27.243.193:44819)
0811 08:09:11.856888 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:11.856890 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:11.856989 (+ 99us) server_negotiation.cc:407] Connection header received
0811 08:09:11.857183 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:11.857184 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:11.857195 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:11.857256 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:09:11.857399 (+ 143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:11.858124 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:11.859336 (+ 1212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:11.859955 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:11.860090 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:11.860100 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 08:09:11.860418 (+ 318us) server_negotiation.cc:299] Negotiation successful
0811 08:09:11.860463 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":103,"thread_start_us":72,"threads_started":1}
I20260811 08:09:11.861754 8835 tablet_bootstrap.cc:492] T 538b42b2372347b78ea14497789ba3ff P 354d5113c37743aa8300abdb229b7106: Bootstrap starting.
I20260811 08:09:11.861797 8537 tablet_service.cc:1467] Processing CreateTablet for tablet 538b42b2372347b78ea14497789ba3ff (DEFAULT_TABLE table=test-table [id=567b1823d0464f678ea7be8994f6d109]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:09:11.861946 8537 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 538b42b2372347b78ea14497789ba3ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:09:11.862157 8835 tablet_bootstrap.cc:654] T 538b42b2372347b78ea14497789ba3ff P 354d5113c37743aa8300abdb229b7106: Neither blocks nor log segments found. Creating new log.
I20260811 08:09:11.862705 8835 tablet_bootstrap.cc:492] T 538b42b2372347b78ea14497789ba3ff P 354d5113c37743aa8300abdb229b7106: No bootstrap required, opened a new log
I20260811 08:09:11.862748 8835 ts_tablet_manager.cc:1397] T 538b42b2372347b78ea14497789ba3ff P 354d5113c37743aa8300abdb229b7106: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 08:09:11.862890 8835 raft_consensus.cc:348] T 538b42b2372347b78ea14497789ba3ff P 354d5113c37743aa8300abdb229b7106 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9c6cd01570488cac503f339622298c" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 43703 } } peers { permanent_uuid: "354d5113c37743aa8300abdb229b7106" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 41905 } } peers { permanent_uuid: "2af48f4f9fd64006b6205f420d6e7d74" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 44819 } }
I20260811 08:09:11.862943 8835 raft_consensus.cc:374] T 538b42b2372347b78ea14497789ba3ff P 354d5113c37743aa8300abdb229b7106 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:09:11.862960 8835 raft_consensus.cc:729] T 538b42b2372347b78ea14497789ba3ff P 354d5113c37743aa8300abdb229b7106 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 354d5113c37743aa8300abdb229b7106, State: Initialized, Role: FOLLOWER
I20260811 08:09:11.863003 8835 consensus_queue.cc:260] T 538b42b2372347b78ea14497789ba3ff P 354d5113c37743aa8300abdb229b7106 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9c6cd01570488cac503f339622298c" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 43703 } } peers { permanent_uuid: "354d5113c37743aa8300abdb229b7106" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 41905 } } peers { permanent_uuid: "2af48f4f9fd64006b6205f420d6e7d74" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 44819 } }
I20260811 08:09:11.863153 8839 tablet_bootstrap.cc:492] T 538b42b2372347b78ea14497789ba3ff P bd9c6cd01570488cac503f339622298c: Bootstrap starting.
I20260811 08:09:11.863183 8835 ts_tablet_manager.cc:1428] T 538b42b2372347b78ea14497789ba3ff P 354d5113c37743aa8300abdb229b7106: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 08:09:11.863293 8095 tablet_service.cc:1467] Processing CreateTablet for tablet 538b42b2372347b78ea14497789ba3ff (DEFAULT_TABLE table=test-table [id=567b1823d0464f678ea7be8994f6d109]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:09:11.863408 8095 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 538b42b2372347b78ea14497789ba3ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:09:11.863574 8839 tablet_bootstrap.cc:654] T 538b42b2372347b78ea14497789ba3ff P bd9c6cd01570488cac503f339622298c: Neither blocks nor log segments found. Creating new log.
I20260811 08:09:11.863756 8428 heartbeater.cc:503] Master 127.27.243.252:45529 was elected leader, sending a full tablet report...
I20260811 08:09:11.864149 8839 tablet_bootstrap.cc:492] T 538b42b2372347b78ea14497789ba3ff P bd9c6cd01570488cac503f339622298c: No bootstrap required, opened a new log
I20260811 08:09:11.864192 8839 ts_tablet_manager.cc:1397] T 538b42b2372347b78ea14497789ba3ff P bd9c6cd01570488cac503f339622298c: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 08:09:11.864310 8839 raft_consensus.cc:348] T 538b42b2372347b78ea14497789ba3ff P bd9c6cd01570488cac503f339622298c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9c6cd01570488cac503f339622298c" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 43703 } } peers { permanent_uuid: "354d5113c37743aa8300abdb229b7106" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 41905 } } peers { permanent_uuid: "2af48f4f9fd64006b6205f420d6e7d74" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 44819 } }
I20260811 08:09:11.864390 8839 raft_consensus.cc:374] T 538b42b2372347b78ea14497789ba3ff P bd9c6cd01570488cac503f339622298c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:09:11.864409 8839 raft_consensus.cc:729] T 538b42b2372347b78ea14497789ba3ff P bd9c6cd01570488cac503f339622298c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd9c6cd01570488cac503f339622298c, State: Initialized, Role: FOLLOWER
I20260811 08:09:11.864449 8839 consensus_queue.cc:260] T 538b42b2372347b78ea14497789ba3ff P bd9c6cd01570488cac503f339622298c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9c6cd01570488cac503f339622298c" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 43703 } } peers { permanent_uuid: "354d5113c37743aa8300abdb229b7106" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 41905 } } peers { permanent_uuid: "2af48f4f9fd64006b6205f420d6e7d74" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 44819 } }
I20260811 08:09:11.864576 8839 ts_tablet_manager.cc:1428] T 538b42b2372347b78ea14497789ba3ff P bd9c6cd01570488cac503f339622298c: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 08:09:11.864904 8798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:11.864762 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:43189 (local address 127.27.243.195:41027)
0811 08:09:11.864843 (+ 81us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:11.864877 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:43189: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
I20260811 08:09:11.864950 8850 tablet_bootstrap.cc:492] T 538b42b2372347b78ea14497789ba3ff P 2af48f4f9fd64006b6205f420d6e7d74: Bootstrap starting.
I20260811 08:09:11.865119 8659 heartbeater.cc:503] Master 127.27.243.252:45529 was elected leader, sending a full tablet report...
I20260811 08:09:11.865160 8805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:11.865006 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:43189 (local address 127.27.243.194:35571)
0811 08:09:11.865105 (+ 99us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:11.865134 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:43189: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":84}
I20260811 08:09:11.865247 8798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:11.865084 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:43189 (local address 127.27.243.195:58667)
0811 08:09:11.865203 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:11.865227 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:43189: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104}
I20260811 08:09:11.865478 8850 tablet_bootstrap.cc:654] T 538b42b2372347b78ea14497789ba3ff P 2af48f4f9fd64006b6205f420d6e7d74: Neither blocks nor log segments found. Creating new log.
I20260811 08:09:11.866091 8850 tablet_bootstrap.cc:492] T 538b42b2372347b78ea14497789ba3ff P 2af48f4f9fd64006b6205f420d6e7d74: No bootstrap required, opened a new log
I20260811 08:09:11.866137 8850 ts_tablet_manager.cc:1397] T 538b42b2372347b78ea14497789ba3ff P 2af48f4f9fd64006b6205f420d6e7d74: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 08:09:11.866227 8850 raft_consensus.cc:348] T 538b42b2372347b78ea14497789ba3ff P 2af48f4f9fd64006b6205f420d6e7d74 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9c6cd01570488cac503f339622298c" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 43703 } } peers { permanent_uuid: "354d5113c37743aa8300abdb229b7106" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 41905 } } peers { permanent_uuid: "2af48f4f9fd64006b6205f420d6e7d74" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 44819 } }
I20260811 08:09:11.866290 8850 raft_consensus.cc:374] T 538b42b2372347b78ea14497789ba3ff P 2af48f4f9fd64006b6205f420d6e7d74 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:09:11.866302 8850 raft_consensus.cc:729] T 538b42b2372347b78ea14497789ba3ff P 2af48f4f9fd64006b6205f420d6e7d74 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2af48f4f9fd64006b6205f420d6e7d74, State: Initialized, Role: FOLLOWER
I20260811 08:09:11.866369 8850 consensus_queue.cc:260] T 538b42b2372347b78ea14497789ba3ff P 2af48f4f9fd64006b6205f420d6e7d74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9c6cd01570488cac503f339622298c" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 43703 } } peers { permanent_uuid: "354d5113c37743aa8300abdb229b7106" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 41905 } } peers { permanent_uuid: "2af48f4f9fd64006b6205f420d6e7d74" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 44819 } }
I20260811 08:09:11.866531 8850 ts_tablet_manager.cc:1428] T 538b42b2372347b78ea14497789ba3ff P 2af48f4f9fd64006b6205f420d6e7d74: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 08:09:11.866783 8801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:11.866691 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:43189 (local address 127.27.243.193:45613)
0811 08:09:11.866730 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:11.866755 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:43189: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
I20260811 08:09:11.866950 8205 heartbeater.cc:503] Master 127.27.243.252:45529 was elected leader, sending a full tablet report...
I20260811 08:09:11.867118 8801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:11.867037 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:43189 (local address 127.27.243.193:57331)
0811 08:09:11.867074 (+ 37us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:11.867094 (+ 20us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:43189: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260811 08:09:11.899121 8664 tablet.cc:2369] T 538b42b2372347b78ea14497789ba3ff P bd9c6cd01570488cac503f339622298c: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 08:09:12.093700 8212 tablet.cc:2369] T 538b42b2372347b78ea14497789ba3ff P 2af48f4f9fd64006b6205f420d6e7d74: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 08:09:12.153507 8847 raft_consensus.cc:482] T 538b42b2372347b78ea14497789ba3ff P bd9c6cd01570488cac503f339622298c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:09:12.153662 8847 raft_consensus.cc:504] T 538b42b2372347b78ea14497789ba3ff P bd9c6cd01570488cac503f339622298c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9c6cd01570488cac503f339622298c" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 43703 } } peers { permanent_uuid: "354d5113c37743aa8300abdb229b7106" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 41905 } } peers { permanent_uuid: "2af48f4f9fd64006b6205f420d6e7d74" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 44819 } }
I20260811 08:09:12.154098 8847 leader_election.cc:288] T 538b42b2372347b78ea14497789ba3ff P bd9c6cd01570488cac503f339622298c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 354d5113c37743aa8300abdb229b7106 (127.27.243.194:41905), 2af48f4f9fd64006b6205f420d6e7d74 (127.27.243.193:44819)
I20260811 08:09:12.156976 8831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:12.154378 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.195:53893 (local address 127.27.243.194:41905)
0811 08:09:12.154431 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:12.154433 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:12.154602 (+ 169us) server_negotiation.cc:407] Connection header received
0811 08:09:12.154662 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:12.154664 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:12.154674 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:12.154732 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:09:12.154887 (+ 155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:12.155336 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:12.156312 (+ 976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:12.156667 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:12.156720 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:12.156729 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 08:09:12.156872 (+ 143us) server_negotiation.cc:299] Negotiation successful
0811 08:09:12.156908 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 08:09:12.156982 8854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:12.154282 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.194:41905 (local address 127.27.243.195:53893)
0811 08:09:12.154516 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:12.154527 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:12.154595 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:12.154744 (+ 149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:12.154745 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:12.154747 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:09:12.154815 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:12.154817 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:12.155423 (+ 606us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:12.155424 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:12.156213 (+ 789us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:12.156216 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:12.156736 (+ 520us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:12.156737 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:12.156796 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:12.156801 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 08:09:12.156860 (+ 59us) client_negotiation.cc:240] Negotiation successful
0811 08:09:12.156904 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":203,"mutex_wait_us":72,"thread_start_us":120,"threads_started":1}
I20260811 08:09:12.157106 8798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:12.154282 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.193:44819 (local address 127.27.243.195:51035)
0811 08:09:12.154327 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:12.154339 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:12.154414 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:12.154605 (+ 191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:12.154606 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:12.154609 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:09:12.154713 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:12.154716 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:12.155416 (+ 700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:12.155417 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:12.156209 (+ 792us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:12.156211 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:12.156881 (+ 670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:12.156883 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:12.156950 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:12.156954 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 08:09:12.157011 (+ 57us) client_negotiation.cc:240] Negotiation successful
0811 08:09:12.157046 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":24,"mutex_wait_us":2}
I20260811 08:09:12.157131 8833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:12.154380 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.195:51035 (local address 127.27.243.193:44819)
0811 08:09:12.154439 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:12.154441 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:12.154451 (+ 10us) server_negotiation.cc:407] Connection header received
0811 08:09:12.154488 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:12.154489 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:12.154501 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:12.154589 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:09:12.154794 (+ 205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:12.155322 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:12.156300 (+ 978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:12.156761 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:12.156852 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:12.156864 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0811 08:09:12.157030 (+ 166us) server_negotiation.cc:299] Negotiation successful
0811 08:09:12.157070 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260811 08:09:12.157351 8134 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "538b42b2372347b78ea14497789ba3ff" candidate_uuid: "bd9c6cd01570488cac503f339622298c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af48f4f9fd64006b6205f420d6e7d74" is_pre_election: true
I20260811 08:09:12.157534 8134 raft_consensus.cc:2454] T 538b42b2372347b78ea14497789ba3ff P 2af48f4f9fd64006b6205f420d6e7d74 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd9c6cd01570488cac503f339622298c in term 0.
I20260811 08:09:12.157480 8349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "538b42b2372347b78ea14497789ba3ff" candidate_uuid: "bd9c6cd01570488cac503f339622298c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "354d5113c37743aa8300abdb229b7106" is_pre_election: true
I20260811 08:09:12.157588 8349 raft_consensus.cc:2454] T 538b42b2372347b78ea14497789ba3ff P 354d5113c37743aa8300abdb229b7106 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd9c6cd01570488cac503f339622298c in term 0.
I20260811 08:09:12.157749 8467 leader_election.cc:302] T 538b42b2372347b78ea14497789ba3ff P bd9c6cd01570488cac503f339622298c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af48f4f9fd64006b6205f420d6e7d74, bd9c6cd01570488cac503f339622298c; no voters:
I20260811 08:09:12.157920 8847 raft_consensus.cc:2781] T 538b42b2372347b78ea14497789ba3ff P bd9c6cd01570488cac503f339622298c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 08:09:12.157979 8847 raft_consensus.cc:482] T 538b42b2372347b78ea14497789ba3ff P bd9c6cd01570488cac503f339622298c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 08:09:12.157995 8847 raft_consensus.cc:3037] T 538b42b2372347b78ea14497789ba3ff P bd9c6cd01570488cac503f339622298c [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:09:12.158895 8847 raft_consensus.cc:504] T 538b42b2372347b78ea14497789ba3ff P bd9c6cd01570488cac503f339622298c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9c6cd01570488cac503f339622298c" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 43703 } } peers { permanent_uuid: "354d5113c37743aa8300abdb229b7106" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 41905 } } peers { permanent_uuid: "2af48f4f9fd64006b6205f420d6e7d74" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 44819 } }
I20260811 08:09:12.159044 8847 leader_election.cc:288] T 538b42b2372347b78ea14497789ba3ff P bd9c6cd01570488cac503f339622298c [CANDIDATE]: Term 1 election: Requested vote from peers 354d5113c37743aa8300abdb229b7106 (127.27.243.194:41905), 2af48f4f9fd64006b6205f420d6e7d74 (127.27.243.193:44819)
I20260811 08:09:12.159195 8134 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "538b42b2372347b78ea14497789ba3ff" candidate_uuid: "bd9c6cd01570488cac503f339622298c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af48f4f9fd64006b6205f420d6e7d74"
I20260811 08:09:12.159188 8349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "538b42b2372347b78ea14497789ba3ff" candidate_uuid: "bd9c6cd01570488cac503f339622298c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "354d5113c37743aa8300abdb229b7106"
I20260811 08:09:12.159273 8134 raft_consensus.cc:3037] T 538b42b2372347b78ea14497789ba3ff P 2af48f4f9fd64006b6205f420d6e7d74 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:09:12.159273 8349 raft_consensus.cc:3037] T 538b42b2372347b78ea14497789ba3ff P 354d5113c37743aa8300abdb229b7106 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:09:12.160072 8134 raft_consensus.cc:2454] T 538b42b2372347b78ea14497789ba3ff P 2af48f4f9fd64006b6205f420d6e7d74 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd9c6cd01570488cac503f339622298c in term 1.
I20260811 08:09:12.160072 8349 raft_consensus.cc:2454] T 538b42b2372347b78ea14497789ba3ff P 354d5113c37743aa8300abdb229b7106 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd9c6cd01570488cac503f339622298c in term 1.
I20260811 08:09:12.160234 8468 leader_election.cc:302] T 538b42b2372347b78ea14497789ba3ff P bd9c6cd01570488cac503f339622298c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 2af48f4f9fd64006b6205f420d6e7d74, 354d5113c37743aa8300abdb229b7106, bd9c6cd01570488cac503f339622298c; no voters:
I20260811 08:09:12.160349 8847 raft_consensus.cc:2781] T 538b42b2372347b78ea14497789ba3ff P bd9c6cd01570488cac503f339622298c [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:09:12.160490 8847 raft_consensus.cc:686] T 538b42b2372347b78ea14497789ba3ff P bd9c6cd01570488cac503f339622298c [term 1 LEADER]: Becoming Leader. State: Replica: bd9c6cd01570488cac503f339622298c, State: Running, Role: LEADER
I20260811 08:09:12.160547 8847 consensus_queue.cc:237] T 538b42b2372347b78ea14497789ba3ff P bd9c6cd01570488cac503f339622298c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9c6cd01570488cac503f339622298c" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 43703 } } peers { permanent_uuid: "354d5113c37743aa8300abdb229b7106" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 41905 } } peers { permanent_uuid: "2af48f4f9fd64006b6205f420d6e7d74" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 44819 } }
I20260811 08:09:12.160887 8798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:12.160786 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:43189 (local address 127.27.243.195:33583)
0811 08:09:12.160829 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:12.160860 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:43189: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
I20260811 08:09:12.161286 7916 catalog_manager.cc:5495] T 538b42b2372347b78ea14497789ba3ff P bd9c6cd01570488cac503f339622298c reported cstate change: term changed from 0 to 1, leader changed from <none> to bd9c6cd01570488cac503f339622298c (127.27.243.195). New cstate: current_term: 1 leader_uuid: "bd9c6cd01570488cac503f339622298c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9c6cd01570488cac503f339622298c" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 43703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "354d5113c37743aa8300abdb229b7106" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 41905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2af48f4f9fd64006b6205f420d6e7d74" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 44819 } health_report { overall_health: UNKNOWN } } }
I20260811 08:09:12.211647 8830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:12.209198 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51630 (local address 127.27.243.195:43703)
0811 08:09:12.209262 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:12.209264 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:12.209273 (+ 9us) server_negotiation.cc:407] Connection header received
0811 08:09:12.209313 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:12.209314 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:12.209334 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:12.209412 (+ 78us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:09:12.209565 (+ 153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:12.210042 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:12.210909 (+ 867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:12.211099 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:12.211153 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:12.211304 (+ 151us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:09:12.211439 (+ 135us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:09:12.211507 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 08:09:12.211547 (+ 40us) server_negotiation.cc:299] Negotiation successful
0811 08:09:12.211570 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 08:09:12.212728 8349 raft_consensus.cc:1261] T 538b42b2372347b78ea14497789ba3ff P 354d5113c37743aa8300abdb229b7106 [term 1 FOLLOWER]: Refusing update from remote peer bd9c6cd01570488cac503f339622298c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:09:12.212843 8134 raft_consensus.cc:1261] T 538b42b2372347b78ea14497789ba3ff P 2af48f4f9fd64006b6205f420d6e7d74 [term 1 FOLLOWER]: Refusing update from remote peer bd9c6cd01570488cac503f339622298c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:09:12.213150 8847 consensus_queue.cc:1035] T 538b42b2372347b78ea14497789ba3ff P bd9c6cd01570488cac503f339622298c [LEADER]: Connected to new peer: Peer: permanent_uuid: "354d5113c37743aa8300abdb229b7106" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 41905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:09:12.213296 8856 consensus_queue.cc:1035] T 538b42b2372347b78ea14497789ba3ff P bd9c6cd01570488cac503f339622298c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af48f4f9fd64006b6205f420d6e7d74" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 44819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:09:12.214102 8805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:12.213993 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:43189 (local address 127.27.243.194:48105)
0811 08:09:12.214040 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:12.214070 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:43189: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
I20260811 08:09:12.214633 8801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:12.214523 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:43189 (local address 127.27.243.193:40783)
0811 08:09:12.214565 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:12.214601 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:43189: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":21}
I20260811 08:09:12.215319 8805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:12.215206 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:43189 (local address 127.27.243.194:43601)
0811 08:09:12.215260 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:12.215291 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:43189: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260811 08:09:12.215507 8798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:12.215219 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:43189 (local address 127.27.243.195:44087)
0811 08:09:12.215448 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:12.215478 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:43189: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":212}
I20260811 08:09:12.215871 8798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:12.215756 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:43189 (local address 127.27.243.195:37305)
0811 08:09:12.215804 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:12.215837 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:43189: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260811 08:09:12.216109 8801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:12.215955 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:43189 (local address 127.27.243.193:44607)
0811 08:09:12.216050 (+ 95us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:12.216081 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:43189: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
I20260811 08:09:12.218210 7915 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52848:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:09:12.218307 7915 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52848:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:09:12.219617 7915 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 50172d9ed73e463c9f5d4a120c34be6d: Sending DeleteTablet for 3 replicas of tablet 538b42b2372347b78ea14497789ba3ff
I20260811 08:09:12.219880 8537 tablet_service.cc:1514] Processing DeleteTablet for tablet 538b42b2372347b78ea14497789ba3ff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:09:12 UTC) from {username='oryx', principal='oryx/127.27.243.252@KRBTEST.COM'} at 127.0.0.1:51628
I20260811 08:09:12.219928 8095 tablet_service.cc:1514] Processing DeleteTablet for tablet 538b42b2372347b78ea14497789ba3ff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:09:12 UTC) from {username='oryx', principal='oryx/127.27.243.252@KRBTEST.COM'} at 127.0.0.1:46144
I20260811 08:09:12.219919 8317 tablet_service.cc:1514] Processing DeleteTablet for tablet 538b42b2372347b78ea14497789ba3ff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:09:12 UTC) from {username='oryx', principal='oryx/127.27.243.252@KRBTEST.COM'} at 127.0.0.1:46780
I20260811 08:09:12.220193 8881 tablet_replica.cc:330] T 538b42b2372347b78ea14497789ba3ff P 354d5113c37743aa8300abdb229b7106: stopping tablet replica
I20260811 08:09:12.220288 8881 raft_consensus.cc:2229] T 538b42b2372347b78ea14497789ba3ff P 354d5113c37743aa8300abdb229b7106 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:09:12.220394 8881 raft_consensus.cc:2258] T 538b42b2372347b78ea14497789ba3ff P 354d5113c37743aa8300abdb229b7106 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:09:12.220436 8878 tablet_replica.cc:330] T 538b42b2372347b78ea14497789ba3ff P bd9c6cd01570488cac503f339622298c: stopping tablet replica
I20260811 08:09:12.220562 8878 raft_consensus.cc:2229] T 538b42b2372347b78ea14497789ba3ff P bd9c6cd01570488cac503f339622298c [term 1 LEADER]: Raft consensus shutting down.
I20260811 08:09:12.220582 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 7846
I20260811 08:09:12.220881 8881 ts_tablet_manager.cc:1905] T 538b42b2372347b78ea14497789ba3ff P 354d5113c37743aa8300abdb229b7106: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:09:12.221275 8878 raft_consensus.cc:2258] T 538b42b2372347b78ea14497789ba3ff P bd9c6cd01570488cac503f339622298c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:09:12.222735 8881 ts_tablet_manager.cc:1918] T 538b42b2372347b78ea14497789ba3ff P 354d5113c37743aa8300abdb229b7106: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:09:12.222800 8881 log.cc:1196] T 538b42b2372347b78ea14497789ba3ff P 354d5113c37743aa8300abdb229b7106: Deleting WAL directory at /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/ts-1/wal/wals/538b42b2372347b78ea14497789ba3ff
I20260811 08:09:12.223021 8881 ts_tablet_manager.cc:1939] T 538b42b2372347b78ea14497789ba3ff P 354d5113c37743aa8300abdb229b7106: Deleting consensus metadata
I20260811 08:09:12.225622 7898 catalog_manager.cc:4841] TS 354d5113c37743aa8300abdb229b7106 (127.27.243.194:41905): tablet 538b42b2372347b78ea14497789ba3ff (table test-table [id=567b1823d0464f678ea7be8994f6d109]) successfully deleted
I20260811 08:09:12.228541 8878 ts_tablet_manager.cc:1905] T 538b42b2372347b78ea14497789ba3ff P bd9c6cd01570488cac503f339622298c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:09:12.230712 8878 ts_tablet_manager.cc:1918] T 538b42b2372347b78ea14497789ba3ff P bd9c6cd01570488cac503f339622298c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:09:12.230891 8878 log.cc:1196] T 538b42b2372347b78ea14497789ba3ff P bd9c6cd01570488cac503f339622298c: Deleting WAL directory at /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435717191469-28623-0/minicluster-data/ts-2/wal/wals/538b42b2372347b78ea14497789ba3ff
I20260811 08:09:12.231257 8878 ts_tablet_manager.cc:1939] T 538b42b2372347b78ea14497789ba3ff P bd9c6cd01570488cac503f339622298c: Deleting consensus metadata
I20260811 08:09:12.235481 7897 catalog_manager.cc:4841] TS bd9c6cd01570488cac503f339622298c (127.27.243.195:43703): tablet 538b42b2372347b78ea14497789ba3ff (table test-table [id=567b1823d0464f678ea7be8994f6d109]) successfully deleted
W20260811 08:09:12.243656 8827 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:09:12.243505 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.193:44819 (local address 127.0.0.1:46150)
0811 08:09:12.243567 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:12.243598 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.193:44819: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":36}
I20260811 08:09:12.243853 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 8222
W20260811 08:09:12.243867 7897 catalog_manager.cc:4584] TS 2af48f4f9fd64006b6205f420d6e7d74 (127.27.243.193:44819): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 538b42b2372347b78ea14497789ba3ff: Network error: Client connection negotiation failed: client connection to 127.27.243.193:44819: connect: Connection reset by peer (error 104)
I20260811 08:09:12.260248 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 8437
I20260811 08:09:12.278925 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 7341
I20260811 08:09:12.286984 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 7678
2026-08-11T08:09:12Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (8330 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435717191469-28623-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:09:12 dist-test-slave-7lbf krb5kdc[8888](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:09:12 dist-test-slave-7lbf krb5kdc[8888](info): set up 2 sockets
Aug 11 08:09:12 dist-test-slave-7lbf krb5kdc[8888](info): commencing operation
krb5kdc: starting...
W20260811 08:09:13.460793 28623 mini_kdc.cc:121] Time spent starting KDC: real 1.144s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435717191469-28623-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435717191469-28623-0/krb5kdc/test-user.keytab.
Aug 11 08:09:13 dist-test-slave-7lbf krb5kdc[8888](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435753, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:09:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:09:13Z Disabled control of system clock
WARNING: no policy specified for oryx/127.27.243.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.27.243.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.27.243.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435717191469-28623-0/krb5kdc/oryx_127.27.243.254.keytab.
Entry for principal oryx/127.27.243.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435717191469-28623-0/krb5kdc/oryx_127.27.243.254.keytab.
I20260811 08:09:13.579401 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435717191469-28623-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435717191469-28623-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435717191469-28623-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.243.254:39635
--webserver_interface=127.27.243.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435717191469-28623-0/krb5kdc/oryx_127.27.243.254.keytab
--principal=oryx/127.27.243.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:37879
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.243.254:39635
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:09:13.661707 8910 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:09:13.661922 8910 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:09:13.661944 8910 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:09:13.663053 8910 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:09:13.663087 8910 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260811 08:09:13.663098 8910 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:09:13.663110 8910 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:09:13.663120 8910 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:09:13.663137 8910 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:09:13.664696 8910 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:37879
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435717191469-28623-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435717191469-28623-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.243.254:39635
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435717191469-28623-0/krb5kdc/oryx_127.27.243.254.keytab
--principal=oryx/127.27.243.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.243.254:39635
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.243.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8910
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435717191469-28623-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:09:13.664896 8910 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:09:13.665061 8910 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:09:13.669783 8923 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:09:13.669792 8916 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:09:13.669799 8919 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:09:13.669975 8910 server_base.cc:1034] running on GCE node
I20260811 08:09:13.670264 8910 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:09:13.670604 8910 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:09:13.671783 8910 hybrid_clock.cc:648] HybridClock initialized: now 1786435753671759 us; error 39 us; skew 500 ppm
Aug 11 08:09:13 dist-test-slave-7lbf krb5kdc[8888](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435753, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.243.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:09:13.677102 8910 init.cc:377] Logged in from keytab as oryx/127.27.243.254@KRBTEST.COM (short username oryx)
I20260811 08:09:13.677567 8910 webserver.cc:460] Webserver started at http://127.27.243.254:37097/ using document root <none> and password file <none>
I20260811 08:09:13.677769 8910 fs_manager.cc:359] Metadata directory not provided
I20260811 08:09:13.677814 8910 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:09:13.677942 8910 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:09:13.679013 8910 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435717191469-28623-0/minicluster-data/master-0/data/instance:
uuid: "c7303b1e1da24c53be2d72763b31d7c6"
format_stamp: "Formatted at 2026-08-11 08:09:13 on dist-test-slave-7lbf"
server_key: "7a4c8907840146cee118930eabacc012"
server_key_iv: "df460997ab9fa3570c90586c1b36ca1c"
server_key_version: "encryptionkey@0"
I20260811 08:09:13.679363 8910 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435717191469-28623-0/minicluster-data/master-0/wal/instance:
uuid: "c7303b1e1da24c53be2d72763b31d7c6"
format_stamp: "Formatted at 2026-08-11 08:09:13 on dist-test-slave-7lbf"
server_key: "7a4c8907840146cee118930eabacc012"
server_key_iv: "df460997ab9fa3570c90586c1b36ca1c"
server_key_version: "encryptionkey@0"
I20260811 08:09:13.680647 8910 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 08:09:13.681279 8936 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:13.681423 8910 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 08:09:13.681509 8910 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435717191469-28623-0/minicluster-data/master-0/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435717191469-28623-0/minicluster-data/master-0/wal
uuid: "c7303b1e1da24c53be2d72763b31d7c6"
format_stamp: "Formatted at 2026-08-11 08:09:13 on dist-test-slave-7lbf"
server_key: "7a4c8907840146cee118930eabacc012"
server_key_iv: "df460997ab9fa3570c90586c1b36ca1c"
server_key_version: "encryptionkey@0"
I20260811 08:09:13.681605 8910 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435717191469-28623-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435717191469-28623-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435717191469-28623-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:09:13.701745 8910 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:09:13.703888 8910 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:09:13.704031 8910 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:09:13.708503 8910 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.254:39635
I20260811 08:09:13.708576 9050 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.254:39635 every 8 connection(s)
I20260811 08:09:13.708894 8910 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
I20260811 08:09:13.709645 9051 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:09:13.712090 9051 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c7303b1e1da24c53be2d72763b31d7c6: Bootstrap starting.
I20260811 08:09:13.712713 9051 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c7303b1e1da24c53be2d72763b31d7c6: Neither blocks nor log segments found. Creating new log.
I20260811 08:09:13.713007 9051 log.cc:824] T 00000000000000000000000000000000 P c7303b1e1da24c53be2d72763b31d7c6: Log is configured to *not* fsync() on all Append() calls
I20260811 08:09:13.713709 9051 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c7303b1e1da24c53be2d72763b31d7c6: No bootstrap required, opened a new log
I20260811 08:09:13.714419 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 8910
I20260811 08:09:13.714512 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435717191469-28623-0/minicluster-data/master-0/wal/instance
I20260811 08:09:13.714697 28623 external_mini_cluster.cc:1428] Setting key 5066a32dae2b6ce4cb32b9248186ea38
I20260811 08:09:13.716207 9051 raft_consensus.cc:348] T 00000000000000000000000000000000 P c7303b1e1da24c53be2d72763b31d7c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7303b1e1da24c53be2d72763b31d7c6" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 39635 } }
I20260811 08:09:13.716440 9051 raft_consensus.cc:374] T 00000000000000000000000000000000 P c7303b1e1da24c53be2d72763b31d7c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:09:13.716501 9051 raft_consensus.cc:729] T 00000000000000000000000000000000 P c7303b1e1da24c53be2d72763b31d7c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7303b1e1da24c53be2d72763b31d7c6, State: Initialized, Role: FOLLOWER
I20260811 08:09:13.716627 9051 consensus_queue.cc:260] T 00000000000000000000000000000000 P c7303b1e1da24c53be2d72763b31d7c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7303b1e1da24c53be2d72763b31d7c6" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 39635 } }
I20260811 08:09:13.716717 9051 raft_consensus.cc:388] T 00000000000000000000000000000000 P c7303b1e1da24c53be2d72763b31d7c6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:09:13.716741 9051 raft_consensus.cc:482] T 00000000000000000000000000000000 P c7303b1e1da24c53be2d72763b31d7c6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:09:13.716794 9051 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c7303b1e1da24c53be2d72763b31d7c6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:09:13.717473 9051 raft_consensus.cc:504] T 00000000000000000000000000000000 P c7303b1e1da24c53be2d72763b31d7c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7303b1e1da24c53be2d72763b31d7c6" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 39635 } }
I20260811 08:09:13.717607 9051 leader_election.cc:302] T 00000000000000000000000000000000 P c7303b1e1da24c53be2d72763b31d7c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c7303b1e1da24c53be2d72763b31d7c6; no voters:
I20260811 08:09:13.717773 9051 leader_election.cc:288] T 00000000000000000000000000000000 P c7303b1e1da24c53be2d72763b31d7c6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:09:13.717859 9058 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c7303b1e1da24c53be2d72763b31d7c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:09:13.718022 9051 sys_catalog.cc:564] T 00000000000000000000000000000000 P c7303b1e1da24c53be2d72763b31d7c6 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:09:13.718037 9058 raft_consensus.cc:686] T 00000000000000000000000000000000 P c7303b1e1da24c53be2d72763b31d7c6 [term 1 LEADER]: Becoming Leader. State: Replica: c7303b1e1da24c53be2d72763b31d7c6, State: Running, Role: LEADER
I20260811 08:09:13.718226 9058 consensus_queue.cc:237] T 00000000000000000000000000000000 P c7303b1e1da24c53be2d72763b31d7c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7303b1e1da24c53be2d72763b31d7c6" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 39635 } }
I20260811 08:09:13.718690 9061 sys_catalog.cc:455] T 00000000000000000000000000000000 P c7303b1e1da24c53be2d72763b31d7c6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c7303b1e1da24c53be2d72763b31d7c6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7303b1e1da24c53be2d72763b31d7c6" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 39635 } } }
I20260811 08:09:13.718696 9062 sys_catalog.cc:455] T 00000000000000000000000000000000 P c7303b1e1da24c53be2d72763b31d7c6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c7303b1e1da24c53be2d72763b31d7c6. Latest consensus state: current_term: 1 leader_uuid: "c7303b1e1da24c53be2d72763b31d7c6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7303b1e1da24c53be2d72763b31d7c6" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 39635 } } }
I20260811 08:09:13.718889 9061 sys_catalog.cc:458] T 00000000000000000000000000000000 P c7303b1e1da24c53be2d72763b31d7c6 [sys.catalog]: This master's current role is: LEADER
I20260811 08:09:13.718930 9062 sys_catalog.cc:458] T 00000000000000000000000000000000 P c7303b1e1da24c53be2d72763b31d7c6 [sys.catalog]: This master's current role is: LEADER
I20260811 08:09:13.719602 9072 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:09:13.720181 9072 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:09:13.721707 9072 catalog_manager.cc:1347] Generated new cluster ID: 3b2a1d8c27a74dcba50b69a5455f2834
I20260811 08:09:13.721762 9072 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 08:09:13 dist-test-slave-7lbf krb5kdc[8888](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435753, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.27.243.254@KRBTEST.COM
I20260811 08:09:13.727272 9057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:13.715262 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44108 (local address 127.27.243.254:39635)
0811 08:09:13.715492 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:13.715503 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:13.715544 (+ 41us) server_negotiation.cc:407] Connection header received
0811 08:09:13.716171 (+ 627us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:13.716180 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:13.716247 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:13.716428 (+ 181us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:13.717114 (+ 686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:13.718544 (+ 1430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:13.719644 (+ 1100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:13.720261 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:13.720373 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:13.723129 (+ 2756us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:09:13.723133 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:09:13.723133 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:09:13.723145 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:09:13.725647 (+ 2502us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:13.726054 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:13.726057 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:13.726058 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:13.726166 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:13.726365 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:13.726365 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:13.726366 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:13.726644 (+ 278us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:09:13.726820 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0811 08:09:13.726915 (+ 95us) server_negotiation.cc:299] Negotiation successful
0811 08:09:13.727060 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":158,"thread_start_us":101,"threads_started":1}
I20260811 08:09:13.741951 9072 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:09:13.742502 9072 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:09:13.753813 9072 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c7303b1e1da24c53be2d72763b31d7c6: Generated new TSK 0
I20260811 08:09:13.754029 9072 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.27.243.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.27.243.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.27.243.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435717191469-28623-0/krb5kdc/oryx_127.27.243.193.keytab.
Entry for principal oryx/127.27.243.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435717191469-28623-0/krb5kdc/oryx_127.27.243.193.keytab.
I20260811 08:09:13.784025 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435717191469-28623-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435717191469-28623-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435717191469-28623-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435717191469-28623-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.243.193:0
--local_ip_for_outbound_sockets=127.27.243.193
--webserver_interface=127.27.243.193
--webserver_port=0
--tserver_master_addrs=127.27.243.254:39635
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435717191469-28623-0/krb5kdc/oryx_127.27.243.193.keytab
--principal=oryx/127.27.243.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:37879
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:09:13.866071 9093 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:09:13.866264 9093 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:09:13.866287 9093 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:09:13.867444 9093 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:09:13.867489 9093 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:09:13.867508 9093 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 08:09:13.867524 9093 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.243.193
I20260811 08:09:13.868960 9093 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:37879
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435717191469-28623-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435717191469-28623-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435717191469-28623-0/krb5kdc/oryx_127.27.243.193.keytab
--principal=oryx/127.27.243.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.243.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435717191469-28623-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.243.193
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.27.243.254:39635
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9093
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.243.193
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435717191469-28623-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:09:13.869138 9093 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:09:13.869341 9093 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:09:13.874106 9102 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:09:13.874151 9106 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:09:13.874220 9103 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:09:13.874382 9093 server_base.cc:1034] running on GCE node
I20260811 08:09:13.874562 9093 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:09:13.874765 9093 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:09:13.875914 9093 hybrid_clock.cc:648] HybridClock initialized: now 1786435753875901 us; error 29 us; skew 500 ppm
Aug 11 08:09:13 dist-test-slave-7lbf krb5kdc[8888](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435753, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.243.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:09:13.878340 9093 init.cc:377] Logged in from keytab as oryx/127.27.243.193@KRBTEST.COM (short username oryx)
I20260811 08:09:13.878764 9093 webserver.cc:460] Webserver started at http://127.27.243.193:37613/ using document root <none> and password file <none>
I20260811 08:09:13.879019 9093 fs_manager.cc:359] Metadata directory not provided
I20260811 08:09:13.879070 9093 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:09:13.879196 9093 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:09:13.880244 9093 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435717191469-28623-0/minicluster-data/ts-0/data/instance:
uuid: "7f31b3d35e9749b08e0eda69535d33cd"
format_stamp: "Formatted at 2026-08-11 08:09:13 on dist-test-slave-7lbf"
server_key: "2daccb073c9ee8cff9d3dd1e4621f5a3"
server_key_iv: "b8fb5bc60606cbc213fe5fdc294e9162"
server_key_version: "encryptionkey@0"
I20260811 08:09:13.880571 9093 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435717191469-28623-0/minicluster-data/ts-0/wal/instance:
uuid: "7f31b3d35e9749b08e0eda69535d33cd"
format_stamp: "Formatted at 2026-08-11 08:09:13 on dist-test-slave-7lbf"
server_key: "2daccb073c9ee8cff9d3dd1e4621f5a3"
server_key_iv: "b8fb5bc60606cbc213fe5fdc294e9162"
server_key_version: "encryptionkey@0"
I20260811 08:09:13.881904 9093 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 08:09:13.882611 9122 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:13.882784 9093 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 08:09:13.882874 9093 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435717191469-28623-0/minicluster-data/ts-0/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435717191469-28623-0/minicluster-data/ts-0/wal
uuid: "7f31b3d35e9749b08e0eda69535d33cd"
format_stamp: "Formatted at 2026-08-11 08:09:13 on dist-test-slave-7lbf"
server_key: "2daccb073c9ee8cff9d3dd1e4621f5a3"
server_key_iv: "b8fb5bc60606cbc213fe5fdc294e9162"
server_key_version: "encryptionkey@0"
I20260811 08:09:13.882931 9093 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435717191469-28623-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435717191469-28623-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435717191469-28623-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:09:13.897210 9093 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:09:13.899183 9093 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:09:13.899326 9093 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:09:13.899891 9093 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:09:13.899935 9093 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:13.899966 9093 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:09:13.899986 9093 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 08:09:13 dist-test-slave-7lbf krb5kdc[8888](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435753, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.243.193@KRBTEST.COM for oryx/127.27.243.254@KRBTEST.COM
I20260811 08:09:13.906899 9093 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.193:40685
I20260811 08:09:13.906939 9317 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.193:40685 every 8 connection(s)
I20260811 08:09:13.907254 9093 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435717191469-28623-0/minicluster-data/ts-0/data/info.pb
I20260811 08:09:13.909327 9057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:13.900330 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.193:59975 (local address 127.27.243.254:39635)
0811 08:09:13.900400 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:13.900402 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:13.900592 (+ 190us) server_negotiation.cc:407] Connection header received
0811 08:09:13.901251 (+ 659us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:13.901253 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:13.901269 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:13.901339 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:13.902221 (+ 882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:13.902728 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:13.903728 (+ 1000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:13.903956 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:13.904013 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:13.906671 (+ 2658us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:09:13.906673 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:09:13.906673 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:09:13.906680 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:09:13.907999 (+ 1319us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:13.908446 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:13.908448 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:13.908448 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:13.908504 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:13.908721 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:13.908722 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:13.908723 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:13.908841 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:09:13.908898 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 08:09:13.909148 (+ 250us) server_negotiation.cc:299] Negotiation successful
0811 08:09:13.909238 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260811 08:09:13.909485 9135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:13.900294 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:39635 (local address 127.27.243.193:59975)
0811 08:09:13.900451 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:13.900499 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:13.901145 (+ 646us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:13.901428 (+ 283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:13.901432 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:13.901806 (+ 374us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:09:13.902097 (+ 291us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:13.902105 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:13.902825 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:13.902826 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:13.903645 (+ 819us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:13.903648 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:13.904035 (+ 387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:13.904036 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:13.904147 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:13.904562 (+ 415us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:09:13.904570 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:09:13.906571 (+ 2001us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:09:13.908074 (+ 1503us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:09:13.908082 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:09:13.908084 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:09:13.908376 (+ 292us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:09:13.908559 (+ 183us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:09:13.908560 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:09:13.908560 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:09:13.908666 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:09:13.908896 (+ 230us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:09:13.908903 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:09:13.909034 (+ 131us) client_negotiation.cc:769] Sending connection context
0811 08:09:13.909118 (+ 84us) client_negotiation.cc:240] Negotiation successful
0811 08:09:13.909270 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":69,"threads_started":1}
I20260811 08:09:13.909806 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 9093
I20260811 08:09:13.909916 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435717191469-28623-0/minicluster-data/ts-0/wal/instance
I20260811 08:09:13.909986 9318 heartbeater.cc:347] Connected to a master server at 127.27.243.254:39635
I20260811 08:09:13.910060 9318 heartbeater.cc:464] Registering TS with master...
I20260811 08:09:13.910125 28623 external_mini_cluster.cc:1428] Setting key 0786e12d16b4c2e5d3f9f7346c0bdf89
I20260811 08:09:13.910197 9318 heartbeater.cc:511] Master 127.27.243.254:39635 requested a full tablet report, sending...
I20260811 08:09:13.910688 8969 ts_manager.cc:194] Registered new tserver with Master: 7f31b3d35e9749b08e0eda69535d33cd (127.27.243.193:40685)
I20260811 08:09:13.911553 8969 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.27.243.193@KRBTEST.COM'} at 127.27.243.193:59975
I20260811 08:09:13.917001 9057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:13.911019 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.193:35933 (local address 127.27.243.254:39635)
0811 08:09:13.911720 (+ 701us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:13.911722 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:13.911729 (+ 7us) server_negotiation.cc:407] Connection header received
0811 08:09:13.911745 (+ 16us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:13.911746 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:13.911755 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:13.911803 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:13.912155 (+ 352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:13.912765 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:13.913709 (+ 944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:13.913902 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:13.913955 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:13.914790 (+ 835us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:09:13.914791 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:09:13.914791 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:09:13.914797 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:09:13.916009 (+ 1212us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:13.916382 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:13.916383 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:13.916383 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:13.916440 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:13.916616 (+ 176us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:13.916616 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:13.916617 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:13.916702 (+ 85us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:09:13.916743 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0811 08:09:13.916888 (+ 145us) server_negotiation.cc:299] Negotiation successful
0811 08:09:13.916943 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":686}
I20260811 08:09:13.917073 9330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:13.910962 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:39635 (local address 127.27.243.193:35933)
0811 08:09:13.911080 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:13.911091 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:13.911141 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:13.911820 (+ 679us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:13.911822 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:13.912001 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:09:13.912077 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:13.912079 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:13.912874 (+ 795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:13.912875 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:13.913639 (+ 764us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:13.913642 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:13.913966 (+ 324us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:13.913966 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:13.914023 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:13.914400 (+ 377us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:09:13.914404 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:09:13.914717 (+ 313us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:09:13.916088 (+ 1371us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:09:13.916088 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:09:13.916089 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:09:13.916288 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:09:13.916496 (+ 208us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:09:13.916497 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:09:13.916497 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:09:13.916561 (+ 64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:09:13.916750 (+ 189us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:09:13.916750 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:09:13.916799 (+ 49us) client_negotiation.cc:769] Sending connection context
0811 08:09:13.916873 (+ 74us) client_negotiation.cc:240] Negotiation successful
0811 08:09:13.916971 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":92,"thread_start_us":65,"threads_started":1}
WARNING: no policy specified for oryx/127.27.243.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.27.243.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.27.243.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435717191469-28623-0/krb5kdc/oryx_127.27.243.194.keytab.
Entry for principal oryx/127.27.243.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435717191469-28623-0/krb5kdc/oryx_127.27.243.194.keytab.
I20260811 08:09:13.936530 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435717191469-28623-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435717191469-28623-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435717191469-28623-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435717191469-28623-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.243.194:0
--local_ip_for_outbound_sockets=127.27.243.194
--webserver_interface=127.27.243.194
--webserver_port=0
--tserver_master_addrs=127.27.243.254:39635
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435717191469-28623-0/krb5kdc/oryx_127.27.243.194.keytab
--principal=oryx/127.27.243.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:37879
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:09:14.018429 9333 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:09:14.018662 9333 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:09:14.018697 9333 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:09:14.019981 9333 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:09:14.020032 9333 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:09:14.020057 9333 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 08:09:14.020087 9333 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.243.194
I20260811 08:09:14.021634 9333 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:37879
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435717191469-28623-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435717191469-28623-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435717191469-28623-0/krb5kdc/oryx_127.27.243.194.keytab
--principal=oryx/127.27.243.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.243.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435717191469-28623-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.243.194
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.27.243.254:39635
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9333
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.243.194
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435717191469-28623-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:09:14.021880 9333 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:09:14.022109 9333 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 08:09:14.027036 9333 server_base.cc:1034] running on GCE node
W20260811 08:09:14.026973 9341 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:09:14.026991 9343 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:09:14.027000 9346 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:09:14.027413 9333 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:09:14.027670 9333 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:09:14.028832 9333 hybrid_clock.cc:648] HybridClock initialized: now 1786435754028812 us; error 35 us; skew 500 ppm
Aug 11 08:09:14 dist-test-slave-7lbf krb5kdc[8888](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435754, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.243.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:09:14.031354 9333 init.cc:377] Logged in from keytab as oryx/127.27.243.194@KRBTEST.COM (short username oryx)
I20260811 08:09:14.031791 9333 webserver.cc:460] Webserver started at http://127.27.243.194:36191/ using document root <none> and password file <none>
I20260811 08:09:14.031991 9333 fs_manager.cc:359] Metadata directory not provided
I20260811 08:09:14.032039 9333 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:09:14.032164 9333 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:09:14.033188 9333 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435717191469-28623-0/minicluster-data/ts-1/data/instance:
uuid: "e4d26088a4674b1d80c2e00d7446fac9"
format_stamp: "Formatted at 2026-08-11 08:09:14 on dist-test-slave-7lbf"
server_key: "8749f9e21d6df921f1f24a80f4ff86eb"
server_key_iv: "62af0f057f754cbb6db96e2519f44e17"
server_key_version: "encryptionkey@0"
I20260811 08:09:14.033558 9333 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435717191469-28623-0/minicluster-data/ts-1/wal/instance:
uuid: "e4d26088a4674b1d80c2e00d7446fac9"
format_stamp: "Formatted at 2026-08-11 08:09:14 on dist-test-slave-7lbf"
server_key: "8749f9e21d6df921f1f24a80f4ff86eb"
server_key_iv: "62af0f057f754cbb6db96e2519f44e17"
server_key_version: "encryptionkey@0"
I20260811 08:09:14.034829 9333 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 08:09:14.035501 9357 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:14.035646 9333 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 08:09:14.035729 9333 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435717191469-28623-0/minicluster-data/ts-1/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435717191469-28623-0/minicluster-data/ts-1/wal
uuid: "e4d26088a4674b1d80c2e00d7446fac9"
format_stamp: "Formatted at 2026-08-11 08:09:14 on dist-test-slave-7lbf"
server_key: "8749f9e21d6df921f1f24a80f4ff86eb"
server_key_iv: "62af0f057f754cbb6db96e2519f44e17"
server_key_version: "encryptionkey@0"
I20260811 08:09:14.035795 9333 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435717191469-28623-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435717191469-28623-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435717191469-28623-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:09:14.051354 9333 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:09:14.053269 9333 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:09:14.053381 9333 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:09:14.053894 9333 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:09:14.053933 9333 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:14.053953 9333 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:09:14.053965 9333 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:14.060567 9333 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.194:35175
Aug 11 08:09:14 dist-test-slave-7lbf krb5kdc[8888](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435754, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.243.194@KRBTEST.COM for oryx/127.27.243.254@KRBTEST.COM
I20260811 08:09:14.060628 9535 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.194:35175 every 8 connection(s)
I20260811 08:09:14.061009 9333 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435717191469-28623-0/minicluster-data/ts-1/data/info.pb
I20260811 08:09:14.061923 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 9333
I20260811 08:09:14.062033 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435717191469-28623-0/minicluster-data/ts-1/wal/instance
I20260811 08:09:14.062252 28623 external_mini_cluster.cc:1428] Setting key ad63d3c83747d30bdbd860aaded5acc1
I20260811 08:09:14.063962 9057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:14.054339 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.194:42073 (local address 127.27.243.254:39635)
0811 08:09:14.054410 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:14.054413 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:14.054568 (+ 155us) server_negotiation.cc:407] Connection header received
0811 08:09:14.055063 (+ 495us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:14.055064 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:14.055077 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:14.055156 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:14.056032 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:14.056871 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:14.058356 (+ 1485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:14.058664 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:14.058744 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:14.061136 (+ 2392us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:09:14.061138 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:09:14.061139 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:09:14.061147 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:09:14.062614 (+ 1467us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:14.063063 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:14.063064 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:14.063064 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:14.063129 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:14.063341 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:14.063341 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:14.063342 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:14.063466 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:09:14.063529 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 08:09:14.063738 (+ 209us) server_negotiation.cc:299] Negotiation successful
0811 08:09:14.063874 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 08:09:14.064044 9370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:14.054279 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:39635 (local address 127.27.243.194:42073)
0811 08:09:14.054443 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:14.054483 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:14.054969 (+ 486us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:14.055265 (+ 296us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:14.055269 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:14.055614 (+ 345us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:09:14.055928 (+ 314us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:14.055935 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:14.056970 (+ 1035us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:14.056971 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:14.058258 (+ 1287us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:14.058262 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:14.058756 (+ 494us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:14.058758 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:14.058900 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:14.059372 (+ 472us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:09:14.059384 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:09:14.061050 (+ 1666us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:09:14.062693 (+ 1643us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:09:14.062700 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:09:14.062702 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:09:14.063007 (+ 305us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:09:14.063191 (+ 184us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:09:14.063191 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:09:14.063191 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:09:14.063289 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:09:14.063521 (+ 232us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:09:14.063524 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:09:14.063629 (+ 105us) client_negotiation.cc:769] Sending connection context
0811 08:09:14.063703 (+ 74us) client_negotiation.cc:240] Negotiation successful
0811 08:09:14.063880 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":91,"threads_started":1}
I20260811 08:09:14.064489 9536 heartbeater.cc:347] Connected to a master server at 127.27.243.254:39635
I20260811 08:09:14.064572 9536 heartbeater.cc:464] Registering TS with master...
I20260811 08:09:14.064772 9536 heartbeater.cc:511] Master 127.27.243.254:39635 requested a full tablet report, sending...
I20260811 08:09:14.065136 8968 ts_manager.cc:194] Registered new tserver with Master: e4d26088a4674b1d80c2e00d7446fac9 (127.27.243.194:35175)
I20260811 08:09:14.065645 8968 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.27.243.194@KRBTEST.COM'} at 127.27.243.194:42073
WARNING: no policy specified for oryx/127.27.243.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.27.243.195@KRBTEST.COM" created.
I20260811 08:09:14.075376 9057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:14.069805 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.194:54277 (local address 127.27.243.254:39635)
0811 08:09:14.069850 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:14.069852 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:14.069952 (+ 100us) server_negotiation.cc:407] Connection header received
0811 08:09:14.069990 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:14.069991 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:14.070001 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:14.070070 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:14.070333 (+ 263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:14.071085 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:14.071823 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:14.072005 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:14.072058 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:14.072857 (+ 799us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:09:14.072858 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:09:14.072859 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:09:14.072865 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:09:14.074212 (+ 1347us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:14.074576 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:14.074578 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:14.074578 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:14.074657 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:14.074903 (+ 246us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:14.074903 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:14.074903 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:14.075044 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:09:14.075102 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 08:09:14.075243 (+ 141us) server_negotiation.cc:299] Negotiation successful
0811 08:09:14.075312 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260811 08:09:14.075417 9546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:14.069727 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:39635 (local address 127.27.243.194:54277)
0811 08:09:14.069892 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:14.069900 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:14.069949 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:14.070073 (+ 124us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:14.070074 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:14.070223 (+ 149us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:09:14.070271 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:14.070272 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:14.071185 (+ 913us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:14.071186 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:14.071731 (+ 545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:14.071733 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:14.072062 (+ 329us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:14.072062 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:14.072109 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:14.072488 (+ 379us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:09:14.072492 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:09:14.072758 (+ 266us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:09:14.074284 (+ 1526us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:09:14.074285 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:09:14.074285 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:09:14.074479 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:09:14.074727 (+ 248us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:09:14.074728 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:09:14.074729 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:09:14.074796 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:09:14.075103 (+ 307us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:09:14.075104 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:09:14.075152 (+ 48us) client_negotiation.cc:769] Sending connection context
0811 08:09:14.075224 (+ 72us) client_negotiation.cc:240] Negotiation successful
0811 08:09:14.075322 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":74,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.27.243.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435717191469-28623-0/krb5kdc/oryx_127.27.243.195.keytab.
Entry for principal oryx/127.27.243.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435717191469-28623-0/krb5kdc/oryx_127.27.243.195.keytab.
I20260811 08:09:14.088470 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435717191469-28623-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435717191469-28623-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435717191469-28623-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435717191469-28623-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.243.195:0
--local_ip_for_outbound_sockets=127.27.243.195
--webserver_interface=127.27.243.195
--webserver_port=0
--tserver_master_addrs=127.27.243.254:39635
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435717191469-28623-0/krb5kdc/oryx_127.27.243.195.keytab
--principal=oryx/127.27.243.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:37879
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:09:14.169687 9549 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:09:14.169886 9549 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:09:14.169909 9549 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:09:14.171039 9549 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:09:14.171084 9549 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:09:14.171104 9549 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 08:09:14.171119 9549 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.243.195
I20260811 08:09:14.172566 9549 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:37879
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435717191469-28623-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435717191469-28623-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435717191469-28623-0/krb5kdc/oryx_127.27.243.195.keytab
--principal=oryx/127.27.243.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.243.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435717191469-28623-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.243.195
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.27.243.254:39635
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9549
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.243.195
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435717191469-28623-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:09:14.172745 9549 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:09:14.172919 9549 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:09:14.177618 9554 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:09:14.177582 9555 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:09:14.177703 9549 server_base.cc:1034] running on GCE node
W20260811 08:09:14.177582 9560 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:09:14.178061 9549 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:09:14.178290 9549 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:09:14.179435 9549 hybrid_clock.cc:648] HybridClock initialized: now 1786435754179417 us; error 38 us; skew 500 ppm
Aug 11 08:09:14 dist-test-slave-7lbf krb5kdc[8888](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435754, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.243.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:09:14.181881 9549 init.cc:377] Logged in from keytab as oryx/127.27.243.195@KRBTEST.COM (short username oryx)
I20260811 08:09:14.182267 9549 webserver.cc:460] Webserver started at http://127.27.243.195:42599/ using document root <none> and password file <none>
I20260811 08:09:14.182451 9549 fs_manager.cc:359] Metadata directory not provided
I20260811 08:09:14.182494 9549 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:09:14.182611 9549 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:09:14.183674 9549 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435717191469-28623-0/minicluster-data/ts-2/data/instance:
uuid: "9521ffed0d01466ab0aea29084e9d617"
format_stamp: "Formatted at 2026-08-11 08:09:14 on dist-test-slave-7lbf"
server_key: "a72e7097fca08146058fd122bbb75dc0"
server_key_iv: "e2661d39ef51cb84dc7b8c726f05a7ed"
server_key_version: "encryptionkey@0"
I20260811 08:09:14.184010 9549 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435717191469-28623-0/minicluster-data/ts-2/wal/instance:
uuid: "9521ffed0d01466ab0aea29084e9d617"
format_stamp: "Formatted at 2026-08-11 08:09:14 on dist-test-slave-7lbf"
server_key: "a72e7097fca08146058fd122bbb75dc0"
server_key_iv: "e2661d39ef51cb84dc7b8c726f05a7ed"
server_key_version: "encryptionkey@0"
I20260811 08:09:14.185294 9549 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 08:09:14.186028 9569 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:14.186170 9549 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:14.186246 9549 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435717191469-28623-0/minicluster-data/ts-2/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435717191469-28623-0/minicluster-data/ts-2/wal
uuid: "9521ffed0d01466ab0aea29084e9d617"
format_stamp: "Formatted at 2026-08-11 08:09:14 on dist-test-slave-7lbf"
server_key: "a72e7097fca08146058fd122bbb75dc0"
server_key_iv: "e2661d39ef51cb84dc7b8c726f05a7ed"
server_key_version: "encryptionkey@0"
I20260811 08:09:14.186312 9549 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435717191469-28623-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435717191469-28623-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435717191469-28623-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:09:14.197085 9549 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:09:14.198972 9549 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:09:14.199090 9549 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:09:14.199580 9549 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:09:14.199620 9549 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:14.199641 9549 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:09:14.199654 9549 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:14.206243 9549 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.195:45485
Aug 11 08:09:14 dist-test-slave-7lbf krb5kdc[8888](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435754, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.243.195@KRBTEST.COM for oryx/127.27.243.254@KRBTEST.COM
I20260811 08:09:14.206318 9746 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.195:45485 every 8 connection(s)
I20260811 08:09:14.206691 9549 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435717191469-28623-0/minicluster-data/ts-2/data/info.pb
I20260811 08:09:14.209180 9057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:14.200085 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.195:36791 (local address 127.27.243.254:39635)
0811 08:09:14.200153 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:14.200156 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:14.200304 (+ 148us) server_negotiation.cc:407] Connection header received
0811 08:09:14.200785 (+ 481us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:14.200787 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:14.200801 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:14.200869 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:14.201693 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:14.202442 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:14.203923 (+ 1481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:14.204197 (+ 274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:14.204271 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:14.206838 (+ 2567us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:09:14.206840 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:09:14.206840 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:09:14.206849 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:09:14.208126 (+ 1277us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:14.208493 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:14.208494 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:14.208494 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:14.208536 (+ 42us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:14.208713 (+ 177us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:14.208714 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:14.208714 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:14.208807 (+ 93us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:09:14.208851 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0811 08:09:14.209064 (+ 213us) server_negotiation.cc:299] Negotiation successful
0811 08:09:14.209118 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260811 08:09:14.209362 9581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:14.199971 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:39635 (local address 127.27.243.195:36791)
0811 08:09:14.200182 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:14.200222 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:14.200695 (+ 473us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:14.200960 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:14.200964 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:14.201310 (+ 346us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:09:14.201608 (+ 298us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:14.201614 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:14.202531 (+ 917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:14.202532 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:14.203832 (+ 1300us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:14.203836 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:14.204282 (+ 446us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:14.204283 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:14.204443 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:14.204953 (+ 510us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:09:14.204964 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:09:14.206727 (+ 1763us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:09:14.208197 (+ 1470us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:09:14.208204 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:09:14.208206 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:09:14.208432 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:09:14.208579 (+ 147us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:09:14.208580 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:09:14.208580 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:09:14.208671 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:09:14.208854 (+ 183us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:09:14.208857 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:09:14.208966 (+ 109us) client_negotiation.cc:769] Sending connection context
0811 08:09:14.209042 (+ 76us) client_negotiation.cc:240] Negotiation successful
0811 08:09:14.209158 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":77,"threads_started":1}
I20260811 08:09:14.209857 9747 heartbeater.cc:347] Connected to a master server at 127.27.243.254:39635
I20260811 08:09:14.209954 9747 heartbeater.cc:464] Registering TS with master...
I20260811 08:09:14.210139 9747 heartbeater.cc:511] Master 127.27.243.254:39635 requested a full tablet report, sending...
I20260811 08:09:14.210553 8969 ts_manager.cc:194] Registered new tserver with Master: 9521ffed0d01466ab0aea29084e9d617 (127.27.243.195:45485)
I20260811 08:09:14.210927 8969 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.27.243.195@KRBTEST.COM'} at 127.27.243.195:36791
I20260811 08:09:14.213640 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 9549
I20260811 08:09:14.213744 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435717191469-28623-0/minicluster-data/ts-2/wal/instance
I20260811 08:09:14.213968 28623 external_mini_cluster.cc:1428] Setting key 8d045abdd68aab6c2fa5fb08919d77ea
I20260811 08:09:14.214787 28623 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 08:09:14.216113 9057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:14.211031 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.195:34459 (local address 127.27.243.254:39635)
0811 08:09:14.211099 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:14.211101 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:14.211146 (+ 45us) server_negotiation.cc:407] Connection header received
0811 08:09:14.211200 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:14.211201 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:14.211211 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:14.211256 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:14.211555 (+ 299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:14.212024 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:14.212692 (+ 668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:14.212896 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:14.212949 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:14.213807 (+ 858us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:09:14.213809 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:09:14.213809 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:09:14.213816 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:09:14.215155 (+ 1339us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:14.215508 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:14.215508 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:14.215508 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:14.215549 (+ 41us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:14.215698 (+ 149us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:14.215698 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:14.215699 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:14.215786 (+ 87us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:09:14.215837 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 08:09:14.215977 (+ 140us) server_negotiation.cc:299] Negotiation successful
0811 08:09:14.216039 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260811 08:09:14.216141 9757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:14.210949 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:39635 (local address 127.27.243.195:34459)
0811 08:09:14.211081 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:14.211090 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:14.211146 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:14.211259 (+ 113us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:14.211260 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:14.211436 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:09:14.211488 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:14.211490 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:14.212110 (+ 620us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:14.212111 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:14.212621 (+ 510us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:14.212622 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:14.212955 (+ 333us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:14.212956 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:14.213020 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:14.213385 (+ 365us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:09:14.213390 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:09:14.213739 (+ 349us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:09:14.215226 (+ 1487us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:09:14.215227 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:09:14.215227 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:09:14.215443 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:09:14.215592 (+ 149us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:09:14.215592 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:09:14.215593 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:09:14.215651 (+ 58us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:09:14.215839 (+ 188us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:09:14.215839 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:09:14.215886 (+ 47us) client_negotiation.cc:769] Sending connection context
0811 08:09:14.215952 (+ 66us) client_negotiation.cc:240] Negotiation successful
0811 08:09:14.216048 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":70,"threads_started":1}
Aug 11 08:09:14 dist-test-slave-7lbf krb5kdc[8888](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435754, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 08:09:14 dist-test-slave-7lbf krb5kdc[8888](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.27.243.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:09:14 dist-test-slave-7lbf krb5kdc[8888](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.27.243.254@KRBTEST.COM, Server not found in Kerberos database
W20260811 08:09:14.236785 9057 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:09:14.231729 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44114 (local address 127.27.243.254:39635)
0811 08:09:14.231781 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:14.231783 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:14.231791 (+ 8us) server_negotiation.cc:407] Connection header received
0811 08:09:14.231816 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:14.231816 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:14.231825 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:14.231887 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:14.232392 (+ 505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:14.232888 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:14.233671 (+ 783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:14.233865 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:14.233916 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:14.236702 (+ 2786us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44114: BlockingRecv error: recv got EOF from 127.0.0.1:44114 (error 108)
Metrics: {"server-negotiator.queue_time_us":28}
Aug 11 08:09:14 dist-test-slave-7lbf krb5kdc[8888](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435754, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.27.243.254@KRBTEST.COM
I20260811 08:09:14.243721 9057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:14.237471 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44130 (local address 127.27.243.254:39635)
0811 08:09:14.237546 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:14.237548 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:14.237557 (+ 9us) server_negotiation.cc:407] Connection header received
0811 08:09:14.237630 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:14.237631 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:14.237640 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:14.237679 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:14.238132 (+ 453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:14.238655 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:14.239286 (+ 631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:14.239483 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:14.239540 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:14.241456 (+ 1916us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:09:14.241457 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:09:14.241458 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:09:14.241464 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:09:14.242721 (+ 1257us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:14.243058 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:14.243059 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:14.243059 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:14.243115 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:14.243273 (+ 158us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:14.243274 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:14.243274 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:14.243385 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:09:14.243468 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0811 08:09:14.243563 (+ 95us) server_negotiation.cc:299] Negotiation successful
0811 08:09:14.243635 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260811 08:09:14.245170 8969 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44130:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 08:09:14.246778 8969 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 08:09:14.252987 9773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:14.248824 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.195:45485 (local address 127.0.0.1:33234)
0811 08:09:14.248997 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:14.249038 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:14.249104 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:14.249752 (+ 648us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:14.249753 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:14.249755 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:09:14.249798 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:14.249800 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:14.251050 (+ 1250us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:14.251051 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:14.251974 (+ 923us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:14.251976 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:14.252773 (+ 797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:14.252774 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:14.252839 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:14.252842 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 08:09:14.252884 (+ 42us) client_negotiation.cc:240] Negotiation successful
0811 08:09:14.252914 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"mutex_wait_us":27,"thread_start_us":72,"threads_started":1}
I20260811 08:09:14.253029 9781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:14.249229 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36680 (local address 127.27.243.194:35175)
0811 08:09:14.249392 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:14.249396 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:14.249404 (+ 8us) server_negotiation.cc:407] Connection header received
0811 08:09:14.249435 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:14.249436 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:14.249448 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:14.249720 (+ 272us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:09:14.249785 (+ 65us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:14.250507 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:14.251830 (+ 1323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:14.252579 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:14.252669 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:14.252728 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0811 08:09:14.252875 (+ 147us) server_negotiation.cc:299] Negotiation successful
0811 08:09:14.252915 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":125,"thread_start_us":89,"threads_started":1}
I20260811 08:09:14.253314 9779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:14.249004 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33234 (local address 127.27.243.195:45485)
0811 08:09:14.249476 (+ 472us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:14.249480 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:14.249489 (+ 9us) server_negotiation.cc:407] Connection header received
0811 08:09:14.249545 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:14.249547 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:14.249561 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:14.249632 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:09:14.249895 (+ 263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:14.250960 (+ 1065us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:14.252056 (+ 1096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:14.252597 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:14.252678 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:14.252738 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0811 08:09:14.253194 (+ 456us) server_negotiation.cc:299] Negotiation successful
0811 08:09:14.253238 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":436,"thread_start_us":104,"threads_started":1}
I20260811 08:09:14.253365 9774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:14.248827 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.193:40685 (local address 127.0.0.1:37790)
0811 08:09:14.249161 (+ 334us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:14.249172 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:14.249224 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:14.249553 (+ 329us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:14.249556 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:14.249558 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:09:14.249647 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:14.249649 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:14.251033 (+ 1384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:14.251035 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:14.252046 (+ 1011us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:14.252048 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:14.253117 (+ 1069us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:14.253118 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:14.253187 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:14.253191 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 08:09:14.253247 (+ 56us) client_negotiation.cc:240] Negotiation successful
0811 08:09:14.253288 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":320,"mutex_wait_us":45,"thread_start_us":48,"threads_started":1}
I20260811 08:09:14.253407 9778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:14.248980 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37790 (local address 127.27.243.193:40685)
0811 08:09:14.249338 (+ 358us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:14.249343 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:14.249353 (+ 10us) server_negotiation.cc:407] Connection header received
0811 08:09:14.249393 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:14.249395 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:14.249412 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:14.249714 (+ 302us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:09:14.249784 (+ 70us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:14.250942 (+ 1158us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:14.252127 (+ 1185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:14.252944 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:14.253028 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:14.253078 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0811 08:09:14.253277 (+ 199us) server_negotiation.cc:299] Negotiation successful
0811 08:09:14.253314 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":322,"thread_start_us":92,"threads_started":1}
I20260811 08:09:14.254055 9642 tablet_service.cc:1467] Processing CreateTablet for tablet 77c37409ba3e4f5999575d59ff8e6523 (DEFAULT_TABLE table=test-table [id=f897950b445a4809aacf6cca7623c8b8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:09:14.254081 9204 tablet_service.cc:1467] Processing CreateTablet for tablet 77c37409ba3e4f5999575d59ff8e6523 (DEFAULT_TABLE table=test-table [id=f897950b445a4809aacf6cca7623c8b8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:09:14.254398 9642 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 77c37409ba3e4f5999575d59ff8e6523. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:09:14.254397 9204 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 77c37409ba3e4f5999575d59ff8e6523. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:09:14.252987 9772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:14.249017 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.194:35175 (local address 127.0.0.1:36680)
0811 08:09:14.249196 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:14.249205 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:14.249245 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:14.249557 (+ 312us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:14.249558 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:14.249559 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:09:14.249643 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:14.249644 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:14.250600 (+ 956us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:14.250601 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:14.251742 (+ 1141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:14.251745 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:14.252669 (+ 924us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:14.252670 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:14.252760 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:14.252775 (+ 15us) client_negotiation.cc:769] Sending connection context
0811 08:09:14.252845 (+ 70us) client_negotiation.cc:240] Negotiation successful
0811 08:09:14.252900 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":57,"threads_started":1}
I20260811 08:09:14.257062 9783 tablet_bootstrap.cc:492] T 77c37409ba3e4f5999575d59ff8e6523 P 9521ffed0d01466ab0aea29084e9d617: Bootstrap starting.
I20260811 08:09:14.257407 9784 tablet_bootstrap.cc:492] T 77c37409ba3e4f5999575d59ff8e6523 P 7f31b3d35e9749b08e0eda69535d33cd: Bootstrap starting.
I20260811 08:09:14.257721 9783 tablet_bootstrap.cc:654] T 77c37409ba3e4f5999575d59ff8e6523 P 9521ffed0d01466ab0aea29084e9d617: Neither blocks nor log segments found. Creating new log.
I20260811 08:09:14.258029 9784 tablet_bootstrap.cc:654] T 77c37409ba3e4f5999575d59ff8e6523 P 7f31b3d35e9749b08e0eda69535d33cd: Neither blocks nor log segments found. Creating new log.
I20260811 08:09:14.257961 9431 tablet_service.cc:1467] Processing CreateTablet for tablet 77c37409ba3e4f5999575d59ff8e6523 (DEFAULT_TABLE table=test-table [id=f897950b445a4809aacf6cca7623c8b8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:09:14.258076 9783 log.cc:824] T 77c37409ba3e4f5999575d59ff8e6523 P 9521ffed0d01466ab0aea29084e9d617: Log is configured to *not* fsync() on all Append() calls
I20260811 08:09:14.258322 9431 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 77c37409ba3e4f5999575d59ff8e6523. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:09:14.258324 9784 log.cc:824] T 77c37409ba3e4f5999575d59ff8e6523 P 7f31b3d35e9749b08e0eda69535d33cd: Log is configured to *not* fsync() on all Append() calls
I20260811 08:09:14.258853 9783 tablet_bootstrap.cc:492] T 77c37409ba3e4f5999575d59ff8e6523 P 9521ffed0d01466ab0aea29084e9d617: No bootstrap required, opened a new log
I20260811 08:09:14.258926 9783 ts_tablet_manager.cc:1397] T 77c37409ba3e4f5999575d59ff8e6523 P 9521ffed0d01466ab0aea29084e9d617: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 08:09:14.258983 9784 tablet_bootstrap.cc:492] T 77c37409ba3e4f5999575d59ff8e6523 P 7f31b3d35e9749b08e0eda69535d33cd: No bootstrap required, opened a new log
I20260811 08:09:14.259052 9784 ts_tablet_manager.cc:1397] T 77c37409ba3e4f5999575d59ff8e6523 P 7f31b3d35e9749b08e0eda69535d33cd: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 08:09:14.260455 9784 raft_consensus.cc:348] T 77c37409ba3e4f5999575d59ff8e6523 P 7f31b3d35e9749b08e0eda69535d33cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f31b3d35e9749b08e0eda69535d33cd" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40685 } } peers { permanent_uuid: "9521ffed0d01466ab0aea29084e9d617" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 45485 } } peers { permanent_uuid: "e4d26088a4674b1d80c2e00d7446fac9" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 35175 } }
I20260811 08:09:14.260627 9784 raft_consensus.cc:374] T 77c37409ba3e4f5999575d59ff8e6523 P 7f31b3d35e9749b08e0eda69535d33cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:09:14.260686 9784 raft_consensus.cc:729] T 77c37409ba3e4f5999575d59ff8e6523 P 7f31b3d35e9749b08e0eda69535d33cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f31b3d35e9749b08e0eda69535d33cd, State: Initialized, Role: FOLLOWER
I20260811 08:09:14.260821 9784 consensus_queue.cc:260] T 77c37409ba3e4f5999575d59ff8e6523 P 7f31b3d35e9749b08e0eda69535d33cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f31b3d35e9749b08e0eda69535d33cd" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40685 } } peers { permanent_uuid: "9521ffed0d01466ab0aea29084e9d617" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 45485 } } peers { permanent_uuid: "e4d26088a4674b1d80c2e00d7446fac9" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 35175 } }
I20260811 08:09:14.260905 9783 raft_consensus.cc:348] T 77c37409ba3e4f5999575d59ff8e6523 P 9521ffed0d01466ab0aea29084e9d617 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f31b3d35e9749b08e0eda69535d33cd" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40685 } } peers { permanent_uuid: "9521ffed0d01466ab0aea29084e9d617" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 45485 } } peers { permanent_uuid: "e4d26088a4674b1d80c2e00d7446fac9" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 35175 } }
I20260811 08:09:14.261071 9783 raft_consensus.cc:374] T 77c37409ba3e4f5999575d59ff8e6523 P 9521ffed0d01466ab0aea29084e9d617 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:09:14.261071 9784 ts_tablet_manager.cc:1428] T 77c37409ba3e4f5999575d59ff8e6523 P 7f31b3d35e9749b08e0eda69535d33cd: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 08:09:14.261150 9783 raft_consensus.cc:729] T 77c37409ba3e4f5999575d59ff8e6523 P 9521ffed0d01466ab0aea29084e9d617 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9521ffed0d01466ab0aea29084e9d617, State: Initialized, Role: FOLLOWER
I20260811 08:09:14.261204 9318 heartbeater.cc:503] Master 127.27.243.254:39635 was elected leader, sending a full tablet report...
I20260811 08:09:14.261279 9783 consensus_queue.cc:260] T 77c37409ba3e4f5999575d59ff8e6523 P 9521ffed0d01466ab0aea29084e9d617 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f31b3d35e9749b08e0eda69535d33cd" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40685 } } peers { permanent_uuid: "9521ffed0d01466ab0aea29084e9d617" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 45485 } } peers { permanent_uuid: "e4d26088a4674b1d80c2e00d7446fac9" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 35175 } }
I20260811 08:09:14.261546 9783 ts_tablet_manager.cc:1428] T 77c37409ba3e4f5999575d59ff8e6523 P 9521ffed0d01466ab0aea29084e9d617: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260811 08:09:14.261576 9747 heartbeater.cc:503] Master 127.27.243.254:39635 was elected leader, sending a full tablet report...
I20260811 08:09:14.262547 9790 tablet_bootstrap.cc:492] T 77c37409ba3e4f5999575d59ff8e6523 P e4d26088a4674b1d80c2e00d7446fac9: Bootstrap starting.
I20260811 08:09:14.263100 9790 tablet_bootstrap.cc:654] T 77c37409ba3e4f5999575d59ff8e6523 P e4d26088a4674b1d80c2e00d7446fac9: Neither blocks nor log segments found. Creating new log.
I20260811 08:09:14.263362 9790 log.cc:824] T 77c37409ba3e4f5999575d59ff8e6523 P e4d26088a4674b1d80c2e00d7446fac9: Log is configured to *not* fsync() on all Append() calls
I20260811 08:09:14.264076 9790 tablet_bootstrap.cc:492] T 77c37409ba3e4f5999575d59ff8e6523 P e4d26088a4674b1d80c2e00d7446fac9: No bootstrap required, opened a new log
I20260811 08:09:14.264130 9790 ts_tablet_manager.cc:1397] T 77c37409ba3e4f5999575d59ff8e6523 P e4d26088a4674b1d80c2e00d7446fac9: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 08:09:14.265573 9790 raft_consensus.cc:348] T 77c37409ba3e4f5999575d59ff8e6523 P e4d26088a4674b1d80c2e00d7446fac9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f31b3d35e9749b08e0eda69535d33cd" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40685 } } peers { permanent_uuid: "9521ffed0d01466ab0aea29084e9d617" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 45485 } } peers { permanent_uuid: "e4d26088a4674b1d80c2e00d7446fac9" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 35175 } }
I20260811 08:09:14.265702 9790 raft_consensus.cc:374] T 77c37409ba3e4f5999575d59ff8e6523 P e4d26088a4674b1d80c2e00d7446fac9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:09:14.265722 9790 raft_consensus.cc:729] T 77c37409ba3e4f5999575d59ff8e6523 P e4d26088a4674b1d80c2e00d7446fac9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4d26088a4674b1d80c2e00d7446fac9, State: Initialized, Role: FOLLOWER
I20260811 08:09:14.265805 9790 consensus_queue.cc:260] T 77c37409ba3e4f5999575d59ff8e6523 P e4d26088a4674b1d80c2e00d7446fac9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f31b3d35e9749b08e0eda69535d33cd" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40685 } } peers { permanent_uuid: "9521ffed0d01466ab0aea29084e9d617" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 45485 } } peers { permanent_uuid: "e4d26088a4674b1d80c2e00d7446fac9" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 35175 } }
I20260811 08:09:14.265983 9790 ts_tablet_manager.cc:1428] T 77c37409ba3e4f5999575d59ff8e6523 P e4d26088a4674b1d80c2e00d7446fac9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 08:09:14.266069 9536 heartbeater.cc:503] Master 127.27.243.254:39635 was elected leader, sending a full tablet report...
W20260811 08:09:14.311619 9540 tablet.cc:2369] T 77c37409ba3e4f5999575d59ff8e6523 P e4d26088a4674b1d80c2e00d7446fac9: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 08:09:14.407967 9322 tablet.cc:2369] T 77c37409ba3e4f5999575d59ff8e6523 P 7f31b3d35e9749b08e0eda69535d33cd: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 08:09:14.446424 9789 raft_consensus.cc:482] T 77c37409ba3e4f5999575d59ff8e6523 P 9521ffed0d01466ab0aea29084e9d617 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:09:14.446550 9789 raft_consensus.cc:504] T 77c37409ba3e4f5999575d59ff8e6523 P 9521ffed0d01466ab0aea29084e9d617 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f31b3d35e9749b08e0eda69535d33cd" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40685 } } peers { permanent_uuid: "9521ffed0d01466ab0aea29084e9d617" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 45485 } } peers { permanent_uuid: "e4d26088a4674b1d80c2e00d7446fac9" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 35175 } }
I20260811 08:09:14.446908 9789 leader_election.cc:288] T 77c37409ba3e4f5999575d59ff8e6523 P 9521ffed0d01466ab0aea29084e9d617 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7f31b3d35e9749b08e0eda69535d33cd (127.27.243.193:40685), e4d26088a4674b1d80c2e00d7446fac9 (127.27.243.194:35175)
I20260811 08:09:14.450793 9778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:14.447203 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.195:42887 (local address 127.27.243.193:40685)
0811 08:09:14.447254 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:14.447257 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:14.447268 (+ 11us) server_negotiation.cc:407] Connection header received
0811 08:09:14.447334 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:14.447335 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:14.447355 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:14.447419 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:09:14.447595 (+ 176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:14.448326 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:14.449861 (+ 1535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:14.450425 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:14.450500 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:14.450510 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 08:09:14.450686 (+ 176us) server_negotiation.cc:299] Negotiation successful
0811 08:09:14.450723 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 08:09:14.450793 9781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:14.447325 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.195:53099 (local address 127.27.243.194:35175)
0811 08:09:14.447380 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:14.447383 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:14.447448 (+ 65us) server_negotiation.cc:407] Connection header received
0811 08:09:14.447477 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:14.447478 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:14.447487 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:14.447527 (+ 40us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:09:14.447679 (+ 152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:14.448364 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:14.449890 (+ 1526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:14.450425 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:14.450500 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:14.450510 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 08:09:14.450686 (+ 176us) server_negotiation.cc:299] Negotiation successful
0811 08:09:14.450723 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 08:09:14.450825 9581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:14.447107 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.193:40685 (local address 127.27.243.195:42887)
0811 08:09:14.447183 (+ 76us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:14.447195 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:14.447272 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:14.447440 (+ 168us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:14.447442 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:14.447444 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:09:14.447518 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:14.447520 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:14.448420 (+ 900us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:14.448421 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:14.449763 (+ 1342us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:14.449767 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:14.450504 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:14.450505 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:14.450616 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:14.450618 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 08:09:14.450672 (+ 54us) client_negotiation.cc:240] Negotiation successful
0811 08:09:14.450712 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":46,"mutex_wait_us":67}
I20260811 08:09:14.450875 9793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:14.447208 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.194:35175 (local address 127.27.243.195:53099)
0811 08:09:14.447382 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:14.447390 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:14.447437 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:14.447547 (+ 110us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:14.447547 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:14.447549 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:09:14.447617 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:14.447618 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:14.448434 (+ 816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:14.448435 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:14.449763 (+ 1328us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:14.449767 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:14.450504 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:14.450505 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:14.450613 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:14.450617 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 08:09:14.450672 (+ 55us) client_negotiation.cc:240] Negotiation successful
0811 08:09:14.450712 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":158,"mutex_wait_us":34,"thread_start_us":102,"threads_started":1}
I20260811 08:09:14.451262 9458 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77c37409ba3e4f5999575d59ff8e6523" candidate_uuid: "9521ffed0d01466ab0aea29084e9d617" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4d26088a4674b1d80c2e00d7446fac9" is_pre_election: true
I20260811 08:09:14.451262 9238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77c37409ba3e4f5999575d59ff8e6523" candidate_uuid: "9521ffed0d01466ab0aea29084e9d617" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f31b3d35e9749b08e0eda69535d33cd" is_pre_election: true
I20260811 08:09:14.451427 9238 raft_consensus.cc:2454] T 77c37409ba3e4f5999575d59ff8e6523 P 7f31b3d35e9749b08e0eda69535d33cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9521ffed0d01466ab0aea29084e9d617 in term 0.
I20260811 08:09:14.451427 9458 raft_consensus.cc:2454] T 77c37409ba3e4f5999575d59ff8e6523 P e4d26088a4674b1d80c2e00d7446fac9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9521ffed0d01466ab0aea29084e9d617 in term 0.
I20260811 08:09:14.451676 9572 leader_election.cc:302] T 77c37409ba3e4f5999575d59ff8e6523 P 9521ffed0d01466ab0aea29084e9d617 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9521ffed0d01466ab0aea29084e9d617, e4d26088a4674b1d80c2e00d7446fac9; no voters:
I20260811 08:09:14.451865 9789 raft_consensus.cc:2781] T 77c37409ba3e4f5999575d59ff8e6523 P 9521ffed0d01466ab0aea29084e9d617 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 08:09:14.451933 9789 raft_consensus.cc:482] T 77c37409ba3e4f5999575d59ff8e6523 P 9521ffed0d01466ab0aea29084e9d617 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 08:09:14.451956 9789 raft_consensus.cc:3037] T 77c37409ba3e4f5999575d59ff8e6523 P 9521ffed0d01466ab0aea29084e9d617 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:09:14.452943 9789 raft_consensus.cc:504] T 77c37409ba3e4f5999575d59ff8e6523 P 9521ffed0d01466ab0aea29084e9d617 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f31b3d35e9749b08e0eda69535d33cd" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40685 } } peers { permanent_uuid: "9521ffed0d01466ab0aea29084e9d617" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 45485 } } peers { permanent_uuid: "e4d26088a4674b1d80c2e00d7446fac9" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 35175 } }
I20260811 08:09:14.453065 9789 leader_election.cc:288] T 77c37409ba3e4f5999575d59ff8e6523 P 9521ffed0d01466ab0aea29084e9d617 [CANDIDATE]: Term 1 election: Requested vote from peers 7f31b3d35e9749b08e0eda69535d33cd (127.27.243.193:40685), e4d26088a4674b1d80c2e00d7446fac9 (127.27.243.194:35175)
I20260811 08:09:14.453231 9238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77c37409ba3e4f5999575d59ff8e6523" candidate_uuid: "9521ffed0d01466ab0aea29084e9d617" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f31b3d35e9749b08e0eda69535d33cd"
I20260811 08:09:14.453276 9458 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77c37409ba3e4f5999575d59ff8e6523" candidate_uuid: "9521ffed0d01466ab0aea29084e9d617" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4d26088a4674b1d80c2e00d7446fac9"
I20260811 08:09:14.453320 9238 raft_consensus.cc:3037] T 77c37409ba3e4f5999575d59ff8e6523 P 7f31b3d35e9749b08e0eda69535d33cd [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:09:14.453353 9458 raft_consensus.cc:3037] T 77c37409ba3e4f5999575d59ff8e6523 P e4d26088a4674b1d80c2e00d7446fac9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:09:14.454178 9238 raft_consensus.cc:2454] T 77c37409ba3e4f5999575d59ff8e6523 P 7f31b3d35e9749b08e0eda69535d33cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9521ffed0d01466ab0aea29084e9d617 in term 1.
I20260811 08:09:14.454178 9458 raft_consensus.cc:2454] T 77c37409ba3e4f5999575d59ff8e6523 P e4d26088a4674b1d80c2e00d7446fac9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9521ffed0d01466ab0aea29084e9d617 in term 1.
I20260811 08:09:14.454381 9572 leader_election.cc:302] T 77c37409ba3e4f5999575d59ff8e6523 P 9521ffed0d01466ab0aea29084e9d617 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9521ffed0d01466ab0aea29084e9d617, e4d26088a4674b1d80c2e00d7446fac9; no voters:
I20260811 08:09:14.454479 9789 raft_consensus.cc:2781] T 77c37409ba3e4f5999575d59ff8e6523 P 9521ffed0d01466ab0aea29084e9d617 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:09:14.454631 9789 raft_consensus.cc:686] T 77c37409ba3e4f5999575d59ff8e6523 P 9521ffed0d01466ab0aea29084e9d617 [term 1 LEADER]: Becoming Leader. State: Replica: 9521ffed0d01466ab0aea29084e9d617, State: Running, Role: LEADER
I20260811 08:09:14.454720 9789 consensus_queue.cc:237] T 77c37409ba3e4f5999575d59ff8e6523 P 9521ffed0d01466ab0aea29084e9d617 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f31b3d35e9749b08e0eda69535d33cd" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40685 } } peers { permanent_uuid: "9521ffed0d01466ab0aea29084e9d617" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 45485 } } peers { permanent_uuid: "e4d26088a4674b1d80c2e00d7446fac9" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 35175 } }
I20260811 08:09:14.455608 8968 catalog_manager.cc:5495] T 77c37409ba3e4f5999575d59ff8e6523 P 9521ffed0d01466ab0aea29084e9d617 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9521ffed0d01466ab0aea29084e9d617 (127.27.243.195). New cstate: current_term: 1 leader_uuid: "9521ffed0d01466ab0aea29084e9d617" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f31b3d35e9749b08e0eda69535d33cd" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9521ffed0d01466ab0aea29084e9d617" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 45485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e4d26088a4674b1d80c2e00d7446fac9" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 35175 } health_report { overall_health: UNKNOWN } } }
W20260811 08:09:14.457470 9748 tablet.cc:2369] T 77c37409ba3e4f5999575d59ff8e6523 P 9521ffed0d01466ab0aea29084e9d617: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 08:09:14.480666 9779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:14.478441 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33242 (local address 127.27.243.195:45485)
0811 08:09:14.478497 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:14.478499 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:14.478508 (+ 9us) server_negotiation.cc:407] Connection header received
0811 08:09:14.478559 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:14.478560 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:14.478577 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:14.478634 (+ 57us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:09:14.478748 (+ 114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:14.479210 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:14.479955 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:14.480145 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:14.480199 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:14.480389 (+ 190us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:09:14.480488 (+ 99us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:09:14.480546 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 08:09:14.480575 (+ 29us) server_negotiation.cc:299] Negotiation successful
0811 08:09:14.480595 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260811 08:09:14.482338 9238 raft_consensus.cc:1261] T 77c37409ba3e4f5999575d59ff8e6523 P 7f31b3d35e9749b08e0eda69535d33cd [term 1 FOLLOWER]: Refusing update from remote peer 9521ffed0d01466ab0aea29084e9d617: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:09:14.482338 9458 raft_consensus.cc:1261] T 77c37409ba3e4f5999575d59ff8e6523 P e4d26088a4674b1d80c2e00d7446fac9 [term 1 FOLLOWER]: Refusing update from remote peer 9521ffed0d01466ab0aea29084e9d617: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:09:14.482650 9789 consensus_queue.cc:1035] T 77c37409ba3e4f5999575d59ff8e6523 P 9521ffed0d01466ab0aea29084e9d617 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f31b3d35e9749b08e0eda69535d33cd" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:09:14.482798 9794 consensus_queue.cc:1035] T 77c37409ba3e4f5999575d59ff8e6523 P 9521ffed0d01466ab0aea29084e9d617 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4d26088a4674b1d80c2e00d7446fac9" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 35175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:09:14.486256 9799 mvcc.cc:205] Tried to move back new op lower bound from 7317240850357080064 to 7317240850247233536. Current Snapshot: MvccSnapshot[applied={T|T < 7317240850357080064 or (T in {7317240850357080064})}]
I20260811 08:09:14.486388 9800 mvcc.cc:205] Tried to move back new op lower bound from 7317240850357080064 to 7317240850247233536. Current Snapshot: MvccSnapshot[applied={T|T < 7317240850357080064 or (T in {7317240850357080064})}]
I20260811 08:09:14.487658 8967 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44130:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:09:14.487754 8967 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44130:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:09:14.488518 8967 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c7303b1e1da24c53be2d72763b31d7c6: Sending DeleteTablet for 3 replicas of tablet 77c37409ba3e4f5999575d59ff8e6523
I20260811 08:09:14.488845 9642 tablet_service.cc:1514] Processing DeleteTablet for tablet 77c37409ba3e4f5999575d59ff8e6523 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:09:14 UTC) from {username='oryx', principal='oryx/127.27.243.254@KRBTEST.COM'} at 127.0.0.1:33234
I20260811 08:09:14.488859 9431 tablet_service.cc:1514] Processing DeleteTablet for tablet 77c37409ba3e4f5999575d59ff8e6523 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:09:14 UTC) from {username='oryx', principal='oryx/127.27.243.254@KRBTEST.COM'} at 127.0.0.1:36680
I20260811 08:09:14.489086 9820 tablet_replica.cc:330] T 77c37409ba3e4f5999575d59ff8e6523 P 9521ffed0d01466ab0aea29084e9d617: stopping tablet replica
I20260811 08:09:14.489125 9204 tablet_service.cc:1514] Processing DeleteTablet for tablet 77c37409ba3e4f5999575d59ff8e6523 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:09:14 UTC) from {username='oryx', principal='oryx/127.27.243.254@KRBTEST.COM'} at 127.0.0.1:37790
I20260811 08:09:14.489180 9820 raft_consensus.cc:2229] T 77c37409ba3e4f5999575d59ff8e6523 P 9521ffed0d01466ab0aea29084e9d617 [term 1 LEADER]: Raft consensus shutting down.
I20260811 08:09:14.489169 8967 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44130:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 08:09:14.489265 9820 raft_consensus.cc:2258] T 77c37409ba3e4f5999575d59ff8e6523 P 9521ffed0d01466ab0aea29084e9d617 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260811 08:09:14.489328 8967 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 08:09:14.489666 9820 ts_tablet_manager.cc:1905] T 77c37409ba3e4f5999575d59ff8e6523 P 9521ffed0d01466ab0aea29084e9d617: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:09:14.489781 9819 tablet_replica.cc:330] T 77c37409ba3e4f5999575d59ff8e6523 P e4d26088a4674b1d80c2e00d7446fac9: stopping tablet replica
I20260811 08:09:14.489894 9819 raft_consensus.cc:2229] T 77c37409ba3e4f5999575d59ff8e6523 P e4d26088a4674b1d80c2e00d7446fac9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:09:14.489998 9819 raft_consensus.cc:2258] T 77c37409ba3e4f5999575d59ff8e6523 P e4d26088a4674b1d80c2e00d7446fac9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:09:14.490796 9819 ts_tablet_manager.cc:1905] T 77c37409ba3e4f5999575d59ff8e6523 P e4d26088a4674b1d80c2e00d7446fac9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:09:14.491166 9431 tablet_service.cc:1467] Processing CreateTablet for tablet aa4865e3097248bc9a2aaf3b2602d5cb (DEFAULT_TABLE table=test-table [id=f1e45b99a3a2481c99b85184c63cf989]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:09:14.491269 9431 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aa4865e3097248bc9a2aaf3b2602d5cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:09:14.491380 9820 ts_tablet_manager.cc:1918] T 77c37409ba3e4f5999575d59ff8e6523 P 9521ffed0d01466ab0aea29084e9d617: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:09:14.491446 9820 log.cc:1196] T 77c37409ba3e4f5999575d59ff8e6523 P 9521ffed0d01466ab0aea29084e9d617: Deleting WAL directory at /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435717191469-28623-0/minicluster-data/ts-2/wal/wals/77c37409ba3e4f5999575d59ff8e6523
I20260811 08:09:14.491683 9820 ts_tablet_manager.cc:1939] T 77c37409ba3e4f5999575d59ff8e6523 P 9521ffed0d01466ab0aea29084e9d617: Deleting consensus metadata
I20260811 08:09:14.492451 9790 tablet_bootstrap.cc:492] T aa4865e3097248bc9a2aaf3b2602d5cb P e4d26088a4674b1d80c2e00d7446fac9: Bootstrap starting.
I20260811 08:09:14.492489 9642 tablet_service.cc:1467] Processing CreateTablet for tablet aa4865e3097248bc9a2aaf3b2602d5cb (DEFAULT_TABLE table=test-table [id=f1e45b99a3a2481c99b85184c63cf989]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:09:14.492583 9642 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aa4865e3097248bc9a2aaf3b2602d5cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:09:14.492662 9819 ts_tablet_manager.cc:1918] T 77c37409ba3e4f5999575d59ff8e6523 P e4d26088a4674b1d80c2e00d7446fac9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:09:14.492722 9819 log.cc:1196] T 77c37409ba3e4f5999575d59ff8e6523 P e4d26088a4674b1d80c2e00d7446fac9: Deleting WAL directory at /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435717191469-28623-0/minicluster-data/ts-1/wal/wals/77c37409ba3e4f5999575d59ff8e6523
I20260811 08:09:14.492849 9790 tablet_bootstrap.cc:654] T aa4865e3097248bc9a2aaf3b2602d5cb P e4d26088a4674b1d80c2e00d7446fac9: Neither blocks nor log segments found. Creating new log.
I20260811 08:09:14.492970 9819 ts_tablet_manager.cc:1939] T 77c37409ba3e4f5999575d59ff8e6523 P e4d26088a4674b1d80c2e00d7446fac9: Deleting consensus metadata
I20260811 08:09:14.493764 9783 tablet_bootstrap.cc:492] T aa4865e3097248bc9a2aaf3b2602d5cb P 9521ffed0d01466ab0aea29084e9d617: Bootstrap starting.
I20260811 08:09:14.493746 8941 catalog_manager.cc:4841] TS e4d26088a4674b1d80c2e00d7446fac9 (127.27.243.194:35175): tablet 77c37409ba3e4f5999575d59ff8e6523 (table test-table [id=f897950b445a4809aacf6cca7623c8b8]) successfully deleted
I20260811 08:09:14.490250 9821 tablet_replica.cc:330] T 77c37409ba3e4f5999575d59ff8e6523 P 7f31b3d35e9749b08e0eda69535d33cd: stopping tablet replica
I20260811 08:09:14.493854 8937 catalog_manager.cc:4841] TS 9521ffed0d01466ab0aea29084e9d617 (127.27.243.195:45485): tablet 77c37409ba3e4f5999575d59ff8e6523 (table test-table [id=f897950b445a4809aacf6cca7623c8b8]) successfully deleted
I20260811 08:09:14.493886 9821 raft_consensus.cc:2229] T 77c37409ba3e4f5999575d59ff8e6523 P 7f31b3d35e9749b08e0eda69535d33cd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:09:14.491106 9204 tablet_service.cc:1467] Processing CreateTablet for tablet aa4865e3097248bc9a2aaf3b2602d5cb (DEFAULT_TABLE table=test-table [id=f1e45b99a3a2481c99b85184c63cf989]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:09:14.493991 9821 raft_consensus.cc:2258] T 77c37409ba3e4f5999575d59ff8e6523 P 7f31b3d35e9749b08e0eda69535d33cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:09:14.494043 9204 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aa4865e3097248bc9a2aaf3b2602d5cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:09:14.494170 9783 tablet_bootstrap.cc:654] T aa4865e3097248bc9a2aaf3b2602d5cb P 9521ffed0d01466ab0aea29084e9d617: Neither blocks nor log segments found. Creating new log.
I20260811 08:09:14.494400 9790 tablet_bootstrap.cc:492] T aa4865e3097248bc9a2aaf3b2602d5cb P e4d26088a4674b1d80c2e00d7446fac9: No bootstrap required, opened a new log
I20260811 08:09:14.494441 9790 ts_tablet_manager.cc:1397] T aa4865e3097248bc9a2aaf3b2602d5cb P e4d26088a4674b1d80c2e00d7446fac9: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 08:09:14.494451 9821 ts_tablet_manager.cc:1905] T 77c37409ba3e4f5999575d59ff8e6523 P 7f31b3d35e9749b08e0eda69535d33cd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:09:14.494578 9790 raft_consensus.cc:348] T aa4865e3097248bc9a2aaf3b2602d5cb P e4d26088a4674b1d80c2e00d7446fac9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f31b3d35e9749b08e0eda69535d33cd" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40685 } } peers { permanent_uuid: "e4d26088a4674b1d80c2e00d7446fac9" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 35175 } } peers { permanent_uuid: "9521ffed0d01466ab0aea29084e9d617" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 45485 } }
I20260811 08:09:14.494639 9790 raft_consensus.cc:374] T aa4865e3097248bc9a2aaf3b2602d5cb P e4d26088a4674b1d80c2e00d7446fac9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:09:14.494656 9790 raft_consensus.cc:729] T aa4865e3097248bc9a2aaf3b2602d5cb P e4d26088a4674b1d80c2e00d7446fac9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4d26088a4674b1d80c2e00d7446fac9, State: Initialized, Role: FOLLOWER
I20260811 08:09:14.494694 9790 consensus_queue.cc:260] T aa4865e3097248bc9a2aaf3b2602d5cb P e4d26088a4674b1d80c2e00d7446fac9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f31b3d35e9749b08e0eda69535d33cd" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40685 } } peers { permanent_uuid: "e4d26088a4674b1d80c2e00d7446fac9" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 35175 } } peers { permanent_uuid: "9521ffed0d01466ab0aea29084e9d617" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 45485 } }
I20260811 08:09:14.494774 9790 ts_tablet_manager.cc:1428] T aa4865e3097248bc9a2aaf3b2602d5cb P e4d26088a4674b1d80c2e00d7446fac9: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:14.495431 9784 tablet_bootstrap.cc:492] T aa4865e3097248bc9a2aaf3b2602d5cb P 7f31b3d35e9749b08e0eda69535d33cd: Bootstrap starting.
I20260811 08:09:14.495783 9821 ts_tablet_manager.cc:1918] T 77c37409ba3e4f5999575d59ff8e6523 P 7f31b3d35e9749b08e0eda69535d33cd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:09:14.495839 9783 tablet_bootstrap.cc:492] T aa4865e3097248bc9a2aaf3b2602d5cb P 9521ffed0d01466ab0aea29084e9d617: No bootstrap required, opened a new log
I20260811 08:09:14.495785 9784 tablet_bootstrap.cc:654] T aa4865e3097248bc9a2aaf3b2602d5cb P 7f31b3d35e9749b08e0eda69535d33cd: Neither blocks nor log segments found. Creating new log.
I20260811 08:09:14.495877 9783 ts_tablet_manager.cc:1397] T aa4865e3097248bc9a2aaf3b2602d5cb P 9521ffed0d01466ab0aea29084e9d617: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 08:09:14.495893 9821 log.cc:1196] T 77c37409ba3e4f5999575d59ff8e6523 P 7f31b3d35e9749b08e0eda69535d33cd: Deleting WAL directory at /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435717191469-28623-0/minicluster-data/ts-0/wal/wals/77c37409ba3e4f5999575d59ff8e6523
I20260811 08:09:14.496013 9783 raft_consensus.cc:348] T aa4865e3097248bc9a2aaf3b2602d5cb P 9521ffed0d01466ab0aea29084e9d617 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f31b3d35e9749b08e0eda69535d33cd" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40685 } } peers { permanent_uuid: "e4d26088a4674b1d80c2e00d7446fac9" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 35175 } } peers { permanent_uuid: "9521ffed0d01466ab0aea29084e9d617" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 45485 } }
I20260811 08:09:14.496058 9783 raft_consensus.cc:374] T aa4865e3097248bc9a2aaf3b2602d5cb P 9521ffed0d01466ab0aea29084e9d617 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:09:14.496070 9783 raft_consensus.cc:729] T aa4865e3097248bc9a2aaf3b2602d5cb P 9521ffed0d01466ab0aea29084e9d617 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9521ffed0d01466ab0aea29084e9d617, State: Initialized, Role: FOLLOWER
I20260811 08:09:14.496102 9783 consensus_queue.cc:260] T aa4865e3097248bc9a2aaf3b2602d5cb P 9521ffed0d01466ab0aea29084e9d617 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f31b3d35e9749b08e0eda69535d33cd" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40685 } } peers { permanent_uuid: "e4d26088a4674b1d80c2e00d7446fac9" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 35175 } } peers { permanent_uuid: "9521ffed0d01466ab0aea29084e9d617" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 45485 } }
I20260811 08:09:14.496150 9821 ts_tablet_manager.cc:1939] T 77c37409ba3e4f5999575d59ff8e6523 P 7f31b3d35e9749b08e0eda69535d33cd: Deleting consensus metadata
I20260811 08:09:14.496177 9783 ts_tablet_manager.cc:1428] T aa4865e3097248bc9a2aaf3b2602d5cb P 9521ffed0d01466ab0aea29084e9d617: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:14.496570 9784 tablet_bootstrap.cc:492] T aa4865e3097248bc9a2aaf3b2602d5cb P 7f31b3d35e9749b08e0eda69535d33cd: No bootstrap required, opened a new log
I20260811 08:09:14.496565 8941 catalog_manager.cc:4841] TS 7f31b3d35e9749b08e0eda69535d33cd (127.27.243.193:40685): tablet 77c37409ba3e4f5999575d59ff8e6523 (table test-table [id=f897950b445a4809aacf6cca7623c8b8]) successfully deleted
I20260811 08:09:14.496620 9784 ts_tablet_manager.cc:1397] T aa4865e3097248bc9a2aaf3b2602d5cb P 7f31b3d35e9749b08e0eda69535d33cd: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 08:09:14.496769 9784 raft_consensus.cc:348] T aa4865e3097248bc9a2aaf3b2602d5cb P 7f31b3d35e9749b08e0eda69535d33cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f31b3d35e9749b08e0eda69535d33cd" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40685 } } peers { permanent_uuid: "e4d26088a4674b1d80c2e00d7446fac9" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 35175 } } peers { permanent_uuid: "9521ffed0d01466ab0aea29084e9d617" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 45485 } }
I20260811 08:09:14.496830 9784 raft_consensus.cc:374] T aa4865e3097248bc9a2aaf3b2602d5cb P 7f31b3d35e9749b08e0eda69535d33cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:09:14.496847 9784 raft_consensus.cc:729] T aa4865e3097248bc9a2aaf3b2602d5cb P 7f31b3d35e9749b08e0eda69535d33cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f31b3d35e9749b08e0eda69535d33cd, State: Initialized, Role: FOLLOWER
I20260811 08:09:14.496886 9784 consensus_queue.cc:260] T aa4865e3097248bc9a2aaf3b2602d5cb P 7f31b3d35e9749b08e0eda69535d33cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f31b3d35e9749b08e0eda69535d33cd" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40685 } } peers { permanent_uuid: "e4d26088a4674b1d80c2e00d7446fac9" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 35175 } } peers { permanent_uuid: "9521ffed0d01466ab0aea29084e9d617" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 45485 } }
I20260811 08:09:14.497138 9784 ts_tablet_manager.cc:1428] T aa4865e3097248bc9a2aaf3b2602d5cb P 7f31b3d35e9749b08e0eda69535d33cd: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:14.594055 9794 raft_consensus.cc:482] T aa4865e3097248bc9a2aaf3b2602d5cb P 9521ffed0d01466ab0aea29084e9d617 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:09:14.594161 9794 raft_consensus.cc:504] T aa4865e3097248bc9a2aaf3b2602d5cb P 9521ffed0d01466ab0aea29084e9d617 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f31b3d35e9749b08e0eda69535d33cd" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40685 } } peers { permanent_uuid: "e4d26088a4674b1d80c2e00d7446fac9" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 35175 } } peers { permanent_uuid: "9521ffed0d01466ab0aea29084e9d617" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 45485 } }
I20260811 08:09:14.594324 9794 leader_election.cc:288] T aa4865e3097248bc9a2aaf3b2602d5cb P 9521ffed0d01466ab0aea29084e9d617 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7f31b3d35e9749b08e0eda69535d33cd (127.27.243.193:40685), e4d26088a4674b1d80c2e00d7446fac9 (127.27.243.194:35175)
I20260811 08:09:14.594548 9238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4865e3097248bc9a2aaf3b2602d5cb" candidate_uuid: "9521ffed0d01466ab0aea29084e9d617" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f31b3d35e9749b08e0eda69535d33cd" is_pre_election: true
I20260811 08:09:14.594594 9458 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4865e3097248bc9a2aaf3b2602d5cb" candidate_uuid: "9521ffed0d01466ab0aea29084e9d617" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4d26088a4674b1d80c2e00d7446fac9" is_pre_election: true
I20260811 08:09:14.594659 9238 raft_consensus.cc:2454] T aa4865e3097248bc9a2aaf3b2602d5cb P 7f31b3d35e9749b08e0eda69535d33cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9521ffed0d01466ab0aea29084e9d617 in term 0.
I20260811 08:09:14.594682 9458 raft_consensus.cc:2454] T aa4865e3097248bc9a2aaf3b2602d5cb P e4d26088a4674b1d80c2e00d7446fac9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9521ffed0d01466ab0aea29084e9d617 in term 0.
I20260811 08:09:14.594921 9572 leader_election.cc:302] T aa4865e3097248bc9a2aaf3b2602d5cb P 9521ffed0d01466ab0aea29084e9d617 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9521ffed0d01466ab0aea29084e9d617, e4d26088a4674b1d80c2e00d7446fac9; no voters:
I20260811 08:09:14.595033 9794 raft_consensus.cc:2781] T aa4865e3097248bc9a2aaf3b2602d5cb P 9521ffed0d01466ab0aea29084e9d617 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 08:09:14.595103 9794 raft_consensus.cc:482] T aa4865e3097248bc9a2aaf3b2602d5cb P 9521ffed0d01466ab0aea29084e9d617 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 08:09:14.595122 9794 raft_consensus.cc:3037] T aa4865e3097248bc9a2aaf3b2602d5cb P 9521ffed0d01466ab0aea29084e9d617 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:09:14.595942 9794 raft_consensus.cc:504] T aa4865e3097248bc9a2aaf3b2602d5cb P 9521ffed0d01466ab0aea29084e9d617 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f31b3d35e9749b08e0eda69535d33cd" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40685 } } peers { permanent_uuid: "e4d26088a4674b1d80c2e00d7446fac9" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 35175 } } peers { permanent_uuid: "9521ffed0d01466ab0aea29084e9d617" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 45485 } }
I20260811 08:09:14.596066 9794 leader_election.cc:288] T aa4865e3097248bc9a2aaf3b2602d5cb P 9521ffed0d01466ab0aea29084e9d617 [CANDIDATE]: Term 1 election: Requested vote from peers 7f31b3d35e9749b08e0eda69535d33cd (127.27.243.193:40685), e4d26088a4674b1d80c2e00d7446fac9 (127.27.243.194:35175)
I20260811 08:09:14.596271 9458 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4865e3097248bc9a2aaf3b2602d5cb" candidate_uuid: "9521ffed0d01466ab0aea29084e9d617" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4d26088a4674b1d80c2e00d7446fac9"
I20260811 08:09:14.596294 9238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4865e3097248bc9a2aaf3b2602d5cb" candidate_uuid: "9521ffed0d01466ab0aea29084e9d617" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f31b3d35e9749b08e0eda69535d33cd"
I20260811 08:09:14.596357 9458 raft_consensus.cc:3037] T aa4865e3097248bc9a2aaf3b2602d5cb P e4d26088a4674b1d80c2e00d7446fac9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:09:14.596376 9238 raft_consensus.cc:3037] T aa4865e3097248bc9a2aaf3b2602d5cb P 7f31b3d35e9749b08e0eda69535d33cd [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:09:14.597054 9238 raft_consensus.cc:2454] T aa4865e3097248bc9a2aaf3b2602d5cb P 7f31b3d35e9749b08e0eda69535d33cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9521ffed0d01466ab0aea29084e9d617 in term 1.
I20260811 08:09:14.597087 9458 raft_consensus.cc:2454] T aa4865e3097248bc9a2aaf3b2602d5cb P e4d26088a4674b1d80c2e00d7446fac9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9521ffed0d01466ab0aea29084e9d617 in term 1.
I20260811 08:09:14.597229 9572 leader_election.cc:302] T aa4865e3097248bc9a2aaf3b2602d5cb P 9521ffed0d01466ab0aea29084e9d617 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f31b3d35e9749b08e0eda69535d33cd, 9521ffed0d01466ab0aea29084e9d617; no voters:
I20260811 08:09:14.597353 9794 raft_consensus.cc:2781] T aa4865e3097248bc9a2aaf3b2602d5cb P 9521ffed0d01466ab0aea29084e9d617 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:09:14.597414 9794 raft_consensus.cc:686] T aa4865e3097248bc9a2aaf3b2602d5cb P 9521ffed0d01466ab0aea29084e9d617 [term 1 LEADER]: Becoming Leader. State: Replica: 9521ffed0d01466ab0aea29084e9d617, State: Running, Role: LEADER
I20260811 08:09:14.597463 9794 consensus_queue.cc:237] T aa4865e3097248bc9a2aaf3b2602d5cb P 9521ffed0d01466ab0aea29084e9d617 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f31b3d35e9749b08e0eda69535d33cd" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40685 } } peers { permanent_uuid: "e4d26088a4674b1d80c2e00d7446fac9" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 35175 } } peers { permanent_uuid: "9521ffed0d01466ab0aea29084e9d617" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 45485 } }
I20260811 08:09:14.598116 8967 catalog_manager.cc:5495] T aa4865e3097248bc9a2aaf3b2602d5cb P 9521ffed0d01466ab0aea29084e9d617 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9521ffed0d01466ab0aea29084e9d617 (127.27.243.195). New cstate: current_term: 1 leader_uuid: "9521ffed0d01466ab0aea29084e9d617" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f31b3d35e9749b08e0eda69535d33cd" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4d26088a4674b1d80c2e00d7446fac9" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 35175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9521ffed0d01466ab0aea29084e9d617" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 45485 } health_report { overall_health: HEALTHY } } }
Aug 11 08:09:14 dist-test-slave-7lbf krb5kdc[8888](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435753, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.243.254@KRBTEST.COM for oryx/127.27.243.254@KRBTEST.COM
I20260811 08:09:14.628752 9839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:14.622146 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:39635 (local address 127.0.0.1:44136)
0811 08:09:14.622330 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:14.622340 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:14.622405 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:14.622527 (+ 122us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:14.622528 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:14.622851 (+ 323us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:09:14.622898 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:14.622900 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:14.623523 (+ 623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:14.623524 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:14.624077 (+ 553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:14.624080 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:14.624394 (+ 314us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:14.624395 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:14.624443 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:14.624923 (+ 480us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:09:14.624928 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:09:14.626423 (+ 1495us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:09:14.627793 (+ 1370us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:09:14.627801 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:09:14.627803 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:09:14.627982 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:09:14.628145 (+ 163us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:09:14.628145 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:09:14.628146 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:09:14.628195 (+ 49us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:09:14.628398 (+ 203us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:09:14.628406 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:09:14.628451 (+ 45us) client_negotiation.cc:769] Sending connection context
0811 08:09:14.628507 (+ 56us) client_negotiation.cc:240] Negotiation successful
0811 08:09:14.628637 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"mutex_wait_us":2,"thread_start_us":92,"threads_started":1}
I20260811 08:09:14.628795 9057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:14.622237 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44136 (local address 127.27.243.254:39635)
0811 08:09:14.622308 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:14.622310 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:14.622394 (+ 84us) server_negotiation.cc:407] Connection header received
0811 08:09:14.622457 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:14.622458 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:14.622468 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:14.622519 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:14.622973 (+ 454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:14.623456 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:14.624151 (+ 695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:14.624337 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:14.624391 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:14.626497 (+ 2106us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:09:14.626499 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:09:14.626499 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:09:14.626506 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:09:14.627721 (+ 1215us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:14.628043 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:14.628044 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:14.628044 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:14.628094 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:14.628243 (+ 149us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:14.628243 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:14.628244 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:14.628346 (+ 102us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:09:14.628400 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 08:09:14.628533 (+ 133us) server_negotiation.cc:299] Negotiation successful
0811 08:09:14.628695 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":93,"server-negotiator.queue_time_us":38}
I20260811 08:09:14.630858 8967 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.27.243.254@KRBTEST.COM'} at 127.0.0.1:44136:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260811 08:09:14.631088 8967 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 08:09:14.632570 9204 tablet_service.cc:1467] Processing CreateTablet for tablet b1850624e6f9411db9faea1c9ead044c (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=ebded69bb4e84b0f895085312ebc3f40]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 08:09:14.632556 9431 tablet_service.cc:1467] Processing CreateTablet for tablet b1850624e6f9411db9faea1c9ead044c (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=ebded69bb4e84b0f895085312ebc3f40]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 08:09:14.632604 9642 tablet_service.cc:1467] Processing CreateTablet for tablet b1850624e6f9411db9faea1c9ead044c (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=ebded69bb4e84b0f895085312ebc3f40]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 08:09:14.632733 9642 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b1850624e6f9411db9faea1c9ead044c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:09:14.632733 9431 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b1850624e6f9411db9faea1c9ead044c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:09:14.632735 9204 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b1850624e6f9411db9faea1c9ead044c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:09:14.634037 9784 tablet_bootstrap.cc:492] T b1850624e6f9411db9faea1c9ead044c P 7f31b3d35e9749b08e0eda69535d33cd: Bootstrap starting.
I20260811 08:09:14.634457 9784 tablet_bootstrap.cc:654] T b1850624e6f9411db9faea1c9ead044c P 7f31b3d35e9749b08e0eda69535d33cd: Neither blocks nor log segments found. Creating new log.
I20260811 08:09:14.635133 9784 tablet_bootstrap.cc:492] T b1850624e6f9411db9faea1c9ead044c P 7f31b3d35e9749b08e0eda69535d33cd: No bootstrap required, opened a new log
I20260811 08:09:14.635156 9790 tablet_bootstrap.cc:492] T b1850624e6f9411db9faea1c9ead044c P e4d26088a4674b1d80c2e00d7446fac9: Bootstrap starting.
I20260811 08:09:14.635185 9784 ts_tablet_manager.cc:1397] T b1850624e6f9411db9faea1c9ead044c P 7f31b3d35e9749b08e0eda69535d33cd: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 08:09:14.635329 9784 raft_consensus.cc:348] T b1850624e6f9411db9faea1c9ead044c P 7f31b3d35e9749b08e0eda69535d33cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f31b3d35e9749b08e0eda69535d33cd" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40685 } } peers { permanent_uuid: "e4d26088a4674b1d80c2e00d7446fac9" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 35175 } } peers { permanent_uuid: "9521ffed0d01466ab0aea29084e9d617" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 45485 } }
I20260811 08:09:14.635388 9784 raft_consensus.cc:374] T b1850624e6f9411db9faea1c9ead044c P 7f31b3d35e9749b08e0eda69535d33cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:09:14.635401 9784 raft_consensus.cc:729] T b1850624e6f9411db9faea1c9ead044c P 7f31b3d35e9749b08e0eda69535d33cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f31b3d35e9749b08e0eda69535d33cd, State: Initialized, Role: FOLLOWER
I20260811 08:09:14.635437 9784 consensus_queue.cc:260] T b1850624e6f9411db9faea1c9ead044c P 7f31b3d35e9749b08e0eda69535d33cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f31b3d35e9749b08e0eda69535d33cd" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40685 } } peers { permanent_uuid: "e4d26088a4674b1d80c2e00d7446fac9" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 35175 } } peers { permanent_uuid: "9521ffed0d01466ab0aea29084e9d617" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 45485 } }
I20260811 08:09:14.635521 9784 ts_tablet_manager.cc:1428] T b1850624e6f9411db9faea1c9ead044c P 7f31b3d35e9749b08e0eda69535d33cd: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:14.635548 9790 tablet_bootstrap.cc:654] T b1850624e6f9411db9faea1c9ead044c P e4d26088a4674b1d80c2e00d7446fac9: Neither blocks nor log segments found. Creating new log.
I20260811 08:09:14.635929 9788 tablet_replica.cc:439] T b1850624e6f9411db9faea1c9ead044c P 7f31b3d35e9749b08e0eda69535d33cd: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f31b3d35e9749b08e0eda69535d33cd" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40685 } } peers { permanent_uuid: "e4d26088a4674b1d80c2e00d7446fac9" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 35175 } } peers { permanent_uuid: "9521ffed0d01466ab0aea29084e9d617" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 45485 } } }
I20260811 08:09:14.636047 9788 tablet_replica.cc:442] T b1850624e6f9411db9faea1c9ead044c P 7f31b3d35e9749b08e0eda69535d33cd: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 08:09:14.636330 9790 tablet_bootstrap.cc:492] T b1850624e6f9411db9faea1c9ead044c P e4d26088a4674b1d80c2e00d7446fac9: No bootstrap required, opened a new log
I20260811 08:09:14.636394 9790 ts_tablet_manager.cc:1397] T b1850624e6f9411db9faea1c9ead044c P e4d26088a4674b1d80c2e00d7446fac9: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 08:09:14.636533 9790 raft_consensus.cc:348] T b1850624e6f9411db9faea1c9ead044c P e4d26088a4674b1d80c2e00d7446fac9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f31b3d35e9749b08e0eda69535d33cd" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40685 } } peers { permanent_uuid: "e4d26088a4674b1d80c2e00d7446fac9" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 35175 } } peers { permanent_uuid: "9521ffed0d01466ab0aea29084e9d617" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 45485 } }
I20260811 08:09:14.636586 9790 raft_consensus.cc:374] T b1850624e6f9411db9faea1c9ead044c P e4d26088a4674b1d80c2e00d7446fac9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:09:14.636603 9790 raft_consensus.cc:729] T b1850624e6f9411db9faea1c9ead044c P e4d26088a4674b1d80c2e00d7446fac9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4d26088a4674b1d80c2e00d7446fac9, State: Initialized, Role: FOLLOWER
I20260811 08:09:14.636646 9790 consensus_queue.cc:260] T b1850624e6f9411db9faea1c9ead044c P e4d26088a4674b1d80c2e00d7446fac9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f31b3d35e9749b08e0eda69535d33cd" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40685 } } peers { permanent_uuid: "e4d26088a4674b1d80c2e00d7446fac9" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 35175 } } peers { permanent_uuid: "9521ffed0d01466ab0aea29084e9d617" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 45485 } }
I20260811 08:09:14.636744 9790 ts_tablet_manager.cc:1428] T b1850624e6f9411db9faea1c9ead044c P e4d26088a4674b1d80c2e00d7446fac9: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:14.636798 9792 tablet_replica.cc:439] T b1850624e6f9411db9faea1c9ead044c P e4d26088a4674b1d80c2e00d7446fac9: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f31b3d35e9749b08e0eda69535d33cd" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40685 } } peers { permanent_uuid: "e4d26088a4674b1d80c2e00d7446fac9" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 35175 } } peers { permanent_uuid: "9521ffed0d01466ab0aea29084e9d617" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 45485 } } }
I20260811 08:09:14.636901 9792 tablet_replica.cc:442] T b1850624e6f9411db9faea1c9ead044c P e4d26088a4674b1d80c2e00d7446fac9: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 08:09:14.637355 9783 tablet_bootstrap.cc:492] T b1850624e6f9411db9faea1c9ead044c P 9521ffed0d01466ab0aea29084e9d617: Bootstrap starting.
I20260811 08:09:14.637727 9783 tablet_bootstrap.cc:654] T b1850624e6f9411db9faea1c9ead044c P 9521ffed0d01466ab0aea29084e9d617: Neither blocks nor log segments found. Creating new log.
I20260811 08:09:14.638425 9783 tablet_bootstrap.cc:492] T b1850624e6f9411db9faea1c9ead044c P 9521ffed0d01466ab0aea29084e9d617: No bootstrap required, opened a new log
I20260811 08:09:14.638480 9783 ts_tablet_manager.cc:1397] T b1850624e6f9411db9faea1c9ead044c P 9521ffed0d01466ab0aea29084e9d617: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 08:09:14.638590 9783 raft_consensus.cc:348] T b1850624e6f9411db9faea1c9ead044c P 9521ffed0d01466ab0aea29084e9d617 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f31b3d35e9749b08e0eda69535d33cd" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40685 } } peers { permanent_uuid: "e4d26088a4674b1d80c2e00d7446fac9" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 35175 } } peers { permanent_uuid: "9521ffed0d01466ab0aea29084e9d617" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 45485 } }
I20260811 08:09:14.638664 9783 raft_consensus.cc:374] T b1850624e6f9411db9faea1c9ead044c P 9521ffed0d01466ab0aea29084e9d617 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:09:14.638684 9783 raft_consensus.cc:729] T b1850624e6f9411db9faea1c9ead044c P 9521ffed0d01466ab0aea29084e9d617 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9521ffed0d01466ab0aea29084e9d617, State: Initialized, Role: FOLLOWER
I20260811 08:09:14.638726 9783 consensus_queue.cc:260] T b1850624e6f9411db9faea1c9ead044c P 9521ffed0d01466ab0aea29084e9d617 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f31b3d35e9749b08e0eda69535d33cd" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40685 } } peers { permanent_uuid: "e4d26088a4674b1d80c2e00d7446fac9" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 35175 } } peers { permanent_uuid: "9521ffed0d01466ab0aea29084e9d617" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 45485 } }
I20260811 08:09:14.638893 9783 ts_tablet_manager.cc:1428] T b1850624e6f9411db9faea1c9ead044c P 9521ffed0d01466ab0aea29084e9d617: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:14.638882 9794 tablet_replica.cc:439] T b1850624e6f9411db9faea1c9ead044c P 9521ffed0d01466ab0aea29084e9d617: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f31b3d35e9749b08e0eda69535d33cd" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40685 } } peers { permanent_uuid: "e4d26088a4674b1d80c2e00d7446fac9" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 35175 } } peers { permanent_uuid: "9521ffed0d01466ab0aea29084e9d617" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 45485 } } }
I20260811 08:09:14.638983 9794 tablet_replica.cc:442] T b1850624e6f9411db9faea1c9ead044c P 9521ffed0d01466ab0aea29084e9d617: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 08:09:14.675135 9792 raft_consensus.cc:482] T b1850624e6f9411db9faea1c9ead044c P e4d26088a4674b1d80c2e00d7446fac9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:09:14.675232 9792 raft_consensus.cc:504] T b1850624e6f9411db9faea1c9ead044c P e4d26088a4674b1d80c2e00d7446fac9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f31b3d35e9749b08e0eda69535d33cd" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40685 } } peers { permanent_uuid: "e4d26088a4674b1d80c2e00d7446fac9" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 35175 } } peers { permanent_uuid: "9521ffed0d01466ab0aea29084e9d617" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 45485 } }
I20260811 08:09:14.675595 9792 leader_election.cc:288] T b1850624e6f9411db9faea1c9ead044c P e4d26088a4674b1d80c2e00d7446fac9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7f31b3d35e9749b08e0eda69535d33cd (127.27.243.193:40685), 9521ffed0d01466ab0aea29084e9d617 (127.27.243.195:45485)
I20260811 08:09:14.679574 9779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:14.675896 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.194:52067 (local address 127.27.243.195:45485)
0811 08:09:14.675943 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:14.675945 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:14.675977 (+ 32us) server_negotiation.cc:407] Connection header received
0811 08:09:14.676056 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:14.676057 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:14.676067 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:14.676126 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:09:14.676350 (+ 224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:14.677087 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:14.678631 (+ 1544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:14.679189 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:14.679267 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:14.679276 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 08:09:14.679464 (+ 188us) server_negotiation.cc:299] Negotiation successful
0811 08:09:14.679508 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 08:09:14.679595 9778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:14.675937 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.194:53399 (local address 127.27.243.193:40685)
0811 08:09:14.675977 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:14.675979 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:14.675988 (+ 9us) server_negotiation.cc:407] Connection header received
0811 08:09:14.676056 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:14.676056 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:14.676067 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:14.676126 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:09:14.676352 (+ 226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:14.677119 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:14.678631 (+ 1512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:14.679190 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:14.679267 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:14.679276 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 08:09:14.679489 (+ 213us) server_negotiation.cc:299] Negotiation successful
0811 08:09:14.679538 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 08:09:14.679598 9844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:14.675755 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.195:45485 (local address 127.27.243.194:52067)
0811 08:09:14.675912 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:14.675923 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:14.675987 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:14.676157 (+ 170us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:14.676158 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:14.676161 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:09:14.676274 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:14.676275 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:14.677179 (+ 904us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:14.677180 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:14.678554 (+ 1374us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:14.678557 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:14.679268 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:14.679269 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:14.679358 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:14.679364 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 08:09:14.679420 (+ 56us) client_negotiation.cc:240] Negotiation successful
0811 08:09:14.679474 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"mutex_wait_us":66,"thread_start_us":101,"threads_started":1}
I20260811 08:09:14.679598 9849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:14.675774 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.193:40685 (local address 127.27.243.194:53399)
0811 08:09:14.675911 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:14.675923 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:14.675987 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:14.676157 (+ 170us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:14.676158 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:14.676163 (+ 5us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:09:14.676266 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:14.676268 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:14.677190 (+ 922us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:14.677191 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:14.678554 (+ 1363us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:14.678557 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:14.679270 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:14.679271 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:14.679358 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:14.679363 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 08:09:14.679420 (+ 57us) client_negotiation.cc:240] Negotiation successful
0811 08:09:14.679475 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"mutex_wait_us":119,"thread_start_us":82,"threads_started":1}
I20260811 08:09:14.679953 9673 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1850624e6f9411db9faea1c9ead044c" candidate_uuid: "e4d26088a4674b1d80c2e00d7446fac9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9521ffed0d01466ab0aea29084e9d617" is_pre_election: true
I20260811 08:09:14.680107 9673 raft_consensus.cc:2454] T b1850624e6f9411db9faea1c9ead044c P 9521ffed0d01466ab0aea29084e9d617 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4d26088a4674b1d80c2e00d7446fac9 in term 0.
I20260811 08:09:14.680090 9238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1850624e6f9411db9faea1c9ead044c" candidate_uuid: "e4d26088a4674b1d80c2e00d7446fac9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f31b3d35e9749b08e0eda69535d33cd" is_pre_election: true
I20260811 08:09:14.680178 9238 raft_consensus.cc:2454] T b1850624e6f9411db9faea1c9ead044c P 7f31b3d35e9749b08e0eda69535d33cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4d26088a4674b1d80c2e00d7446fac9 in term 0.
I20260811 08:09:14.680323 9358 leader_election.cc:302] T b1850624e6f9411db9faea1c9ead044c P e4d26088a4674b1d80c2e00d7446fac9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9521ffed0d01466ab0aea29084e9d617, e4d26088a4674b1d80c2e00d7446fac9; no voters:
I20260811 08:09:14.680464 9792 raft_consensus.cc:2781] T b1850624e6f9411db9faea1c9ead044c P e4d26088a4674b1d80c2e00d7446fac9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 08:09:14.680521 9792 raft_consensus.cc:482] T b1850624e6f9411db9faea1c9ead044c P e4d26088a4674b1d80c2e00d7446fac9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 08:09:14.680534 9792 raft_consensus.cc:3037] T b1850624e6f9411db9faea1c9ead044c P e4d26088a4674b1d80c2e00d7446fac9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:09:14.681243 9792 raft_consensus.cc:504] T b1850624e6f9411db9faea1c9ead044c P e4d26088a4674b1d80c2e00d7446fac9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f31b3d35e9749b08e0eda69535d33cd" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40685 } } peers { permanent_uuid: "e4d26088a4674b1d80c2e00d7446fac9" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 35175 } } peers { permanent_uuid: "9521ffed0d01466ab0aea29084e9d617" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 45485 } }
I20260811 08:09:14.681365 9792 leader_election.cc:288] T b1850624e6f9411db9faea1c9ead044c P e4d26088a4674b1d80c2e00d7446fac9 [CANDIDATE]: Term 1 election: Requested vote from peers 7f31b3d35e9749b08e0eda69535d33cd (127.27.243.193:40685), 9521ffed0d01466ab0aea29084e9d617 (127.27.243.195:45485)
I20260811 08:09:14.681505 9673 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1850624e6f9411db9faea1c9ead044c" candidate_uuid: "e4d26088a4674b1d80c2e00d7446fac9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9521ffed0d01466ab0aea29084e9d617"
I20260811 08:09:14.681612 9673 raft_consensus.cc:3037] T b1850624e6f9411db9faea1c9ead044c P 9521ffed0d01466ab0aea29084e9d617 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:09:14.681581 9238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1850624e6f9411db9faea1c9ead044c" candidate_uuid: "e4d26088a4674b1d80c2e00d7446fac9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f31b3d35e9749b08e0eda69535d33cd"
I20260811 08:09:14.681645 9238 raft_consensus.cc:3037] T b1850624e6f9411db9faea1c9ead044c P 7f31b3d35e9749b08e0eda69535d33cd [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:09:14.682336 9238 raft_consensus.cc:2454] T b1850624e6f9411db9faea1c9ead044c P 7f31b3d35e9749b08e0eda69535d33cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4d26088a4674b1d80c2e00d7446fac9 in term 1.
I20260811 08:09:14.682399 9673 raft_consensus.cc:2454] T b1850624e6f9411db9faea1c9ead044c P 9521ffed0d01466ab0aea29084e9d617 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4d26088a4674b1d80c2e00d7446fac9 in term 1.
I20260811 08:09:14.682540 9358 leader_election.cc:302] T b1850624e6f9411db9faea1c9ead044c P e4d26088a4674b1d80c2e00d7446fac9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9521ffed0d01466ab0aea29084e9d617, e4d26088a4674b1d80c2e00d7446fac9; no voters:
I20260811 08:09:14.682623 9792 raft_consensus.cc:2781] T b1850624e6f9411db9faea1c9ead044c P e4d26088a4674b1d80c2e00d7446fac9 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:09:14.682734 9792 raft_consensus.cc:686] T b1850624e6f9411db9faea1c9ead044c P e4d26088a4674b1d80c2e00d7446fac9 [term 1 LEADER]: Becoming Leader. State: Replica: e4d26088a4674b1d80c2e00d7446fac9, State: Running, Role: LEADER
I20260811 08:09:14.682787 9792 consensus_queue.cc:237] T b1850624e6f9411db9faea1c9ead044c P e4d26088a4674b1d80c2e00d7446fac9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f31b3d35e9749b08e0eda69535d33cd" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40685 } } peers { permanent_uuid: "e4d26088a4674b1d80c2e00d7446fac9" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 35175 } } peers { permanent_uuid: "9521ffed0d01466ab0aea29084e9d617" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 45485 } }
I20260811 08:09:14.683109 9850 tablet_replica.cc:439] T b1850624e6f9411db9faea1c9ead044c P e4d26088a4674b1d80c2e00d7446fac9: TxnStatusTablet state changed. Reason: New leader e4d26088a4674b1d80c2e00d7446fac9. Latest consensus state: current_term: 1 leader_uuid: "e4d26088a4674b1d80c2e00d7446fac9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f31b3d35e9749b08e0eda69535d33cd" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40685 } } peers { permanent_uuid: "e4d26088a4674b1d80c2e00d7446fac9" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 35175 } } peers { permanent_uuid: "9521ffed0d01466ab0aea29084e9d617" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 45485 } } }
I20260811 08:09:14.683216 9850 tablet_replica.cc:442] T b1850624e6f9411db9faea1c9ead044c P e4d26088a4674b1d80c2e00d7446fac9: This TxnStatusTablet replica's current role is: LEADER
I20260811 08:09:14.683465 9854 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260811 08:09:14.683560 9854 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260811 08:09:14.683543 8969 catalog_manager.cc:5495] T b1850624e6f9411db9faea1c9ead044c P e4d26088a4674b1d80c2e00d7446fac9 reported cstate change: term changed from 0 to 1, leader changed from <none> to e4d26088a4674b1d80c2e00d7446fac9 (127.27.243.194). New cstate: current_term: 1 leader_uuid: "e4d26088a4674b1d80c2e00d7446fac9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f31b3d35e9749b08e0eda69535d33cd" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4d26088a4674b1d80c2e00d7446fac9" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 35175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9521ffed0d01466ab0aea29084e9d617" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 45485 } health_report { overall_health: UNKNOWN } } }
I20260811 08:09:14.694701 9781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:14.692409 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36696 (local address 127.27.243.194:35175)
0811 08:09:14.692456 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:14.692458 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:14.692467 (+ 9us) server_negotiation.cc:407] Connection header received
0811 08:09:14.692537 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:14.692538 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:14.692555 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:14.692609 (+ 54us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:09:14.692727 (+ 118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:14.693217 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:14.693979 (+ 762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:14.694180 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:14.694233 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:14.694406 (+ 173us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:09:14.694505 (+ 99us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:09:14.694566 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 08:09:14.694611 (+ 45us) server_negotiation.cc:299] Negotiation successful
0811 08:09:14.694632 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 08:09:14.694722 9839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:14.692346 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.194:35175 (local address 127.0.0.1:36696)
0811 08:09:14.692412 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:14.692423 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:14.692471 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:14.692612 (+ 141us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:14.692612 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:14.692613 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 08:09:14.692669 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:14.692671 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:14.693290 (+ 619us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:14.693291 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:14.693910 (+ 619us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:14.693912 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:14.694237 (+ 325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:14.694238 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:14.694305 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:14.694327 (+ 22us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 08:09:14.694558 (+ 231us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 08:09:14.694566 (+ 8us) client_negotiation.cc:769] Sending connection context
0811 08:09:14.694608 (+ 42us) client_negotiation.cc:240] Negotiation successful
0811 08:09:14.694658 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":27}
I20260811 08:09:14.695811 9238 raft_consensus.cc:1261] T b1850624e6f9411db9faea1c9ead044c P 7f31b3d35e9749b08e0eda69535d33cd [term 1 FOLLOWER]: Refusing update from remote peer e4d26088a4674b1d80c2e00d7446fac9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:09:14.695878 9673 raft_consensus.cc:1261] T b1850624e6f9411db9faea1c9ead044c P 9521ffed0d01466ab0aea29084e9d617 [term 1 FOLLOWER]: Refusing update from remote peer e4d26088a4674b1d80c2e00d7446fac9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:09:14.696033 9850 consensus_queue.cc:1035] T b1850624e6f9411db9faea1c9ead044c P e4d26088a4674b1d80c2e00d7446fac9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f31b3d35e9749b08e0eda69535d33cd" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:09:14.696135 9792 consensus_queue.cc:1035] T b1850624e6f9411db9faea1c9ead044c P e4d26088a4674b1d80c2e00d7446fac9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9521ffed0d01466ab0aea29084e9d617" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 45485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:09:14.696812 9794 tablet_replica.cc:439] T b1850624e6f9411db9faea1c9ead044c P 9521ffed0d01466ab0aea29084e9d617: TxnStatusTablet state changed. Reason: New leader e4d26088a4674b1d80c2e00d7446fac9. Latest consensus state: current_term: 1 leader_uuid: "e4d26088a4674b1d80c2e00d7446fac9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f31b3d35e9749b08e0eda69535d33cd" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40685 } } peers { permanent_uuid: "e4d26088a4674b1d80c2e00d7446fac9" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 35175 } } peers { permanent_uuid: "9521ffed0d01466ab0aea29084e9d617" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 45485 } } }
I20260811 08:09:14.696848 9788 tablet_replica.cc:439] T b1850624e6f9411db9faea1c9ead044c P 7f31b3d35e9749b08e0eda69535d33cd: TxnStatusTablet state changed. Reason: New leader e4d26088a4674b1d80c2e00d7446fac9. Latest consensus state: current_term: 1 leader_uuid: "e4d26088a4674b1d80c2e00d7446fac9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f31b3d35e9749b08e0eda69535d33cd" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40685 } } peers { permanent_uuid: "e4d26088a4674b1d80c2e00d7446fac9" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 35175 } } peers { permanent_uuid: "9521ffed0d01466ab0aea29084e9d617" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 45485 } } }
I20260811 08:09:14.696913 9794 tablet_replica.cc:442] T b1850624e6f9411db9faea1c9ead044c P 9521ffed0d01466ab0aea29084e9d617: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 08:09:14.696935 9788 tablet_replica.cc:442] T b1850624e6f9411db9faea1c9ead044c P 7f31b3d35e9749b08e0eda69535d33cd: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 08:09:14.697260 9850 tablet_replica.cc:439] T b1850624e6f9411db9faea1c9ead044c P e4d26088a4674b1d80c2e00d7446fac9: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e4d26088a4674b1d80c2e00d7446fac9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f31b3d35e9749b08e0eda69535d33cd" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40685 } } peers { permanent_uuid: "e4d26088a4674b1d80c2e00d7446fac9" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 35175 } } peers { permanent_uuid: "9521ffed0d01466ab0aea29084e9d617" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 45485 } } }
I20260811 08:09:14.697328 9850 tablet_replica.cc:442] T b1850624e6f9411db9faea1c9ead044c P e4d26088a4674b1d80c2e00d7446fac9: This TxnStatusTablet replica's current role is: LEADER
I20260811 08:09:14.697955 9788 tablet_replica.cc:439] T b1850624e6f9411db9faea1c9ead044c P 7f31b3d35e9749b08e0eda69535d33cd: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e4d26088a4674b1d80c2e00d7446fac9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f31b3d35e9749b08e0eda69535d33cd" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40685 } } peers { permanent_uuid: "e4d26088a4674b1d80c2e00d7446fac9" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 35175 } } peers { permanent_uuid: "9521ffed0d01466ab0aea29084e9d617" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 45485 } } }
I20260811 08:09:14.698031 9788 tablet_replica.cc:442] T b1850624e6f9411db9faea1c9ead044c P 7f31b3d35e9749b08e0eda69535d33cd: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 08:09:14.699267 9850 tablet_replica.cc:439] T b1850624e6f9411db9faea1c9ead044c P e4d26088a4674b1d80c2e00d7446fac9: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e4d26088a4674b1d80c2e00d7446fac9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f31b3d35e9749b08e0eda69535d33cd" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40685 } } peers { permanent_uuid: "e4d26088a4674b1d80c2e00d7446fac9" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 35175 } } peers { permanent_uuid: "9521ffed0d01466ab0aea29084e9d617" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 45485 } } }
I20260811 08:09:14.699353 9850 tablet_replica.cc:442] T b1850624e6f9411db9faea1c9ead044c P e4d26088a4674b1d80c2e00d7446fac9: This TxnStatusTablet replica's current role is: LEADER
I20260811 08:09:14.699689 9797 mvcc.cc:205] Tried to move back new op lower bound from 7317240851231805440 to 7317240851181264896. Current Snapshot: MvccSnapshot[applied={T|T < 7317240851231805440}]
I20260811 08:09:14.699851 9794 tablet_replica.cc:439] T b1850624e6f9411db9faea1c9ead044c P 9521ffed0d01466ab0aea29084e9d617: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e4d26088a4674b1d80c2e00d7446fac9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f31b3d35e9749b08e0eda69535d33cd" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40685 } } peers { permanent_uuid: "e4d26088a4674b1d80c2e00d7446fac9" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 35175 } } peers { permanent_uuid: "9521ffed0d01466ab0aea29084e9d617" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 45485 } } }
I20260811 08:09:14.699929 9794 tablet_replica.cc:442] T b1850624e6f9411db9faea1c9ead044c P 9521ffed0d01466ab0aea29084e9d617: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 08:09:14.703907 9781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:14.701958 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.195:54201 (local address 127.27.243.194:35175)
0811 08:09:14.701996 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:14.701998 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:14.702006 (+ 8us) server_negotiation.cc:407] Connection header received
0811 08:09:14.702055 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:14.702056 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:14.702065 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:14.702108 (+ 43us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:09:14.702195 (+ 87us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:14.702632 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:14.703325 (+ 693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:14.703508 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:14.703559 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:14.703703 (+ 144us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:09:14.703732 (+ 29us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:09:14.703772 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0811 08:09:14.703829 (+ 57us) server_negotiation.cc:299] Negotiation successful
0811 08:09:14.703845 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 08:09:14.703926 9757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:14.701886 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.194:35175 (local address 127.27.243.195:54201)
0811 08:09:14.701954 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:14.701965 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:14.702003 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:14.702109 (+ 106us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:14.702109 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:14.702110 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 08:09:14.702152 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:14.702154 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:14.702697 (+ 543us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:14.702698 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:14.703256 (+ 558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:14.703257 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:14.703565 (+ 308us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:14.703566 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:14.703624 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:14.703638 (+ 14us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 08:09:14.703778 (+ 140us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 08:09:14.703780 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 08:09:14.703819 (+ 39us) client_negotiation.cc:240] Negotiation successful
0811 08:09:14.703867 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
I20260811 08:09:14.706182 9238 raft_consensus.cc:1261] T aa4865e3097248bc9a2aaf3b2602d5cb P 7f31b3d35e9749b08e0eda69535d33cd [term 1 FOLLOWER]: Refusing update from remote peer 9521ffed0d01466ab0aea29084e9d617: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:09:14.706185 9458 raft_consensus.cc:1261] T aa4865e3097248bc9a2aaf3b2602d5cb P e4d26088a4674b1d80c2e00d7446fac9 [term 1 FOLLOWER]: Refusing update from remote peer 9521ffed0d01466ab0aea29084e9d617: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:09:14.706393 9789 consensus_queue.cc:1035] T aa4865e3097248bc9a2aaf3b2602d5cb P 9521ffed0d01466ab0aea29084e9d617 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4d26088a4674b1d80c2e00d7446fac9" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 35175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:09:14.706497 9794 consensus_queue.cc:1035] T aa4865e3097248bc9a2aaf3b2602d5cb P 9521ffed0d01466ab0aea29084e9d617 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f31b3d35e9749b08e0eda69535d33cd" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:09:14.717365 9871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:14.714119 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.195:45485 (local address 127.27.243.194:50979)
0811 08:09:14.714274 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:14.714284 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:14.714345 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:14.714461 (+ 116us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:14.714461 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:14.714463 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 08:09:14.714524 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:14.714525 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:14.715366 (+ 841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:14.715367 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:14.716531 (+ 1164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:14.716534 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:14.716994 (+ 460us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:14.716995 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:14.717051 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:14.717065 (+ 14us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 08:09:14.717231 (+ 166us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 08:09:14.717232 (+ 1us) client_negotiation.cc:769] Sending connection context
0811 08:09:14.717263 (+ 31us) client_negotiation.cc:240] Negotiation successful
0811 08:09:14.717295 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":79,"threads_started":1}
I20260811 08:09:14.717365 9779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:14.714256 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.194:50979 (local address 127.27.243.195:45485)
0811 08:09:14.714294 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:14.714296 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:14.714345 (+ 49us) server_negotiation.cc:407] Connection header received
0811 08:09:14.714393 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:14.714394 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:14.714405 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:14.714460 (+ 55us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:09:14.714571 (+ 111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:14.715284 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:14.716607 (+ 1323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:14.716908 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:14.716977 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:14.717149 (+ 172us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:09:14.717180 (+ 31us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:09:14.717226 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0811 08:09:14.717267 (+ 41us) server_negotiation.cc:299] Negotiation successful
0811 08:09:14.717286 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 08:09:14.724910 8969 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44130:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:09:14.724993 8969 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44130:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:09:14.725600 8969 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c7303b1e1da24c53be2d72763b31d7c6: Sending DeleteTablet for 3 replicas of tablet aa4865e3097248bc9a2aaf3b2602d5cb
I20260811 08:09:14.725837 9642 tablet_service.cc:1514] Processing DeleteTablet for tablet aa4865e3097248bc9a2aaf3b2602d5cb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:09:14 UTC) from {username='oryx', principal='oryx/127.27.243.254@KRBTEST.COM'} at 127.0.0.1:33234
I20260811 08:09:14.725920 9820 tablet_replica.cc:330] T aa4865e3097248bc9a2aaf3b2602d5cb P 9521ffed0d01466ab0aea29084e9d617: stopping tablet replica
I20260811 08:09:14.725893 9204 tablet_service.cc:1514] Processing DeleteTablet for tablet aa4865e3097248bc9a2aaf3b2602d5cb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:09:14 UTC) from {username='oryx', principal='oryx/127.27.243.254@KRBTEST.COM'} at 127.0.0.1:37790
I20260811 08:09:14.725967 9820 raft_consensus.cc:2229] T aa4865e3097248bc9a2aaf3b2602d5cb P 9521ffed0d01466ab0aea29084e9d617 [term 1 LEADER]: Raft consensus shutting down.
I20260811 08:09:14.725992 9821 tablet_replica.cc:330] T aa4865e3097248bc9a2aaf3b2602d5cb P 7f31b3d35e9749b08e0eda69535d33cd: stopping tablet replica
I20260811 08:09:14.725991 9431 tablet_service.cc:1514] Processing DeleteTablet for tablet aa4865e3097248bc9a2aaf3b2602d5cb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:09:14 UTC) from {username='oryx', principal='oryx/127.27.243.254@KRBTEST.COM'} at 127.0.0.1:36680
I20260811 08:09:14.726015 9820 raft_consensus.cc:2258] T aa4865e3097248bc9a2aaf3b2602d5cb P 9521ffed0d01466ab0aea29084e9d617 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:09:14.726042 9821 raft_consensus.cc:2229] T aa4865e3097248bc9a2aaf3b2602d5cb P 7f31b3d35e9749b08e0eda69535d33cd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:09:14.726071 9821 raft_consensus.cc:2258] T aa4865e3097248bc9a2aaf3b2602d5cb P 7f31b3d35e9749b08e0eda69535d33cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:09:14.726068 9819 tablet_replica.cc:330] T aa4865e3097248bc9a2aaf3b2602d5cb P e4d26088a4674b1d80c2e00d7446fac9: stopping tablet replica
I20260811 08:09:14.726109 9819 raft_consensus.cc:2229] T aa4865e3097248bc9a2aaf3b2602d5cb P e4d26088a4674b1d80c2e00d7446fac9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:09:14.726141 9819 raft_consensus.cc:2258] T aa4865e3097248bc9a2aaf3b2602d5cb P e4d26088a4674b1d80c2e00d7446fac9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:09:14.726372 9821 ts_tablet_manager.cc:1905] T aa4865e3097248bc9a2aaf3b2602d5cb P 7f31b3d35e9749b08e0eda69535d33cd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:09:14.726421 9820 ts_tablet_manager.cc:1905] T aa4865e3097248bc9a2aaf3b2602d5cb P 9521ffed0d01466ab0aea29084e9d617: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:09:14.726480 9819 ts_tablet_manager.cc:1905] T aa4865e3097248bc9a2aaf3b2602d5cb P e4d26088a4674b1d80c2e00d7446fac9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:09:14.727926 9819 ts_tablet_manager.cc:1918] T aa4865e3097248bc9a2aaf3b2602d5cb P e4d26088a4674b1d80c2e00d7446fac9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 08:09:14.727945 9821 ts_tablet_manager.cc:1918] T aa4865e3097248bc9a2aaf3b2602d5cb P 7f31b3d35e9749b08e0eda69535d33cd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 08:09:14.727988 9819 log.cc:1196] T aa4865e3097248bc9a2aaf3b2602d5cb P e4d26088a4674b1d80c2e00d7446fac9: Deleting WAL directory at /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435717191469-28623-0/minicluster-data/ts-1/wal/wals/aa4865e3097248bc9a2aaf3b2602d5cb
I20260811 08:09:14.727998 9821 log.cc:1196] T aa4865e3097248bc9a2aaf3b2602d5cb P 7f31b3d35e9749b08e0eda69535d33cd: Deleting WAL directory at /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435717191469-28623-0/minicluster-data/ts-0/wal/wals/aa4865e3097248bc9a2aaf3b2602d5cb
I20260811 08:09:14.728189 9821 ts_tablet_manager.cc:1939] T aa4865e3097248bc9a2aaf3b2602d5cb P 7f31b3d35e9749b08e0eda69535d33cd: Deleting consensus metadata
I20260811 08:09:14.728189 9819 ts_tablet_manager.cc:1939] T aa4865e3097248bc9a2aaf3b2602d5cb P e4d26088a4674b1d80c2e00d7446fac9: Deleting consensus metadata
I20260811 08:09:14.728508 8941 catalog_manager.cc:4841] TS 7f31b3d35e9749b08e0eda69535d33cd (127.27.243.193:40685): tablet aa4865e3097248bc9a2aaf3b2602d5cb (table test-table [id=f1e45b99a3a2481c99b85184c63cf989]) successfully deleted
I20260811 08:09:14.728560 9820 ts_tablet_manager.cc:1918] T aa4865e3097248bc9a2aaf3b2602d5cb P 9521ffed0d01466ab0aea29084e9d617: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 08:09:14.728580 8941 catalog_manager.cc:4841] TS e4d26088a4674b1d80c2e00d7446fac9 (127.27.243.194:35175): tablet aa4865e3097248bc9a2aaf3b2602d5cb (table test-table [id=f1e45b99a3a2481c99b85184c63cf989]) successfully deleted
I20260811 08:09:14.728605 9820 log.cc:1196] T aa4865e3097248bc9a2aaf3b2602d5cb P 9521ffed0d01466ab0aea29084e9d617: Deleting WAL directory at /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435717191469-28623-0/minicluster-data/ts-2/wal/wals/aa4865e3097248bc9a2aaf3b2602d5cb
I20260811 08:09:14.728780 9820 ts_tablet_manager.cc:1939] T aa4865e3097248bc9a2aaf3b2602d5cb P 9521ffed0d01466ab0aea29084e9d617: Deleting consensus metadata
I20260811 08:09:14.729044 8937 catalog_manager.cc:4841] TS 9521ffed0d01466ab0aea29084e9d617 (127.27.243.195:45485): tablet aa4865e3097248bc9a2aaf3b2602d5cb (table test-table [id=f1e45b99a3a2481c99b85184c63cf989]) successfully deleted
Aug 11 08:09:14 dist-test-slave-7lbf krb5kdc[8888](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435754, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 08:09:14 dist-test-slave-7lbf krb5kdc[8888](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.27.243.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:09:14 dist-test-slave-7lbf krb5kdc[8888](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.27.243.254@KRBTEST.COM, Server not found in Kerberos database
W20260811 08:09:14.755489 9057 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:09:14.747916 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44142 (local address 127.27.243.254:39635)
0811 08:09:14.747982 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:14.747984 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:14.748111 (+ 127us) server_negotiation.cc:407] Connection header received
0811 08:09:14.748165 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:14.748166 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:14.748178 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:14.748237 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:14.749006 (+ 769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:14.749767 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:14.750857 (+ 1090us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:14.751069 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:14.751130 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:14.755421 (+ 4291us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44142: BlockingRecv error: recv got EOF from 127.0.0.1:44142 (error 108)
Metrics: {"server-negotiator.queue_time_us":25}
Aug 11 08:09:14 dist-test-slave-7lbf krb5kdc[8888](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435754, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.27.243.254@KRBTEST.COM
I20260811 08:09:14.764652 9057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:14.756285 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44156 (local address 127.27.243.254:39635)
0811 08:09:14.756325 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:14.756327 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:14.756422 (+ 95us) server_negotiation.cc:407] Connection header received
0811 08:09:14.756526 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:14.756527 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:14.756537 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:14.756583 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:14.757118 (+ 535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:14.757738 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:14.758725 (+ 987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:14.758975 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:14.759018 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:14.761689 (+ 2671us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:09:14.761691 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:09:14.761691 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:09:14.761699 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:09:14.763327 (+ 1628us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:14.763717 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:14.763719 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:14.763719 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:14.763775 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:14.764022 (+ 247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:14.764023 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:14.764024 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:14.764155 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:09:14.764230 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 08:09:14.764480 (+ 250us) server_negotiation.cc:299] Negotiation successful
0811 08:09:14.764560 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 08:09:14.767174 8969 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44156:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 08:09:14.767373 8969 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 08:09:14.768994 9642 tablet_service.cc:1467] Processing CreateTablet for tablet 47f78920c65e4c9eb9a53872a5dea1c7 (DEFAULT_TABLE table=test-table [id=1e33d6cd4cf144959fcf59ab3a388381]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:09:14.769068 9204 tablet_service.cc:1467] Processing CreateTablet for tablet 47f78920c65e4c9eb9a53872a5dea1c7 (DEFAULT_TABLE table=test-table [id=1e33d6cd4cf144959fcf59ab3a388381]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:09:14.769142 9642 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 47f78920c65e4c9eb9a53872a5dea1c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:09:14.769207 9204 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 47f78920c65e4c9eb9a53872a5dea1c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:09:14.770691 9431 tablet_service.cc:1467] Processing CreateTablet for tablet 47f78920c65e4c9eb9a53872a5dea1c7 (DEFAULT_TABLE table=test-table [id=1e33d6cd4cf144959fcf59ab3a388381]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:09:14.770742 9783 tablet_bootstrap.cc:492] T 47f78920c65e4c9eb9a53872a5dea1c7 P 9521ffed0d01466ab0aea29084e9d617: Bootstrap starting.
I20260811 08:09:14.770810 9431 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 47f78920c65e4c9eb9a53872a5dea1c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:09:14.771169 9783 tablet_bootstrap.cc:654] T 47f78920c65e4c9eb9a53872a5dea1c7 P 9521ffed0d01466ab0aea29084e9d617: Neither blocks nor log segments found. Creating new log.
I20260811 08:09:14.771770 9783 tablet_bootstrap.cc:492] T 47f78920c65e4c9eb9a53872a5dea1c7 P 9521ffed0d01466ab0aea29084e9d617: No bootstrap required, opened a new log
I20260811 08:09:14.771833 9783 ts_tablet_manager.cc:1397] T 47f78920c65e4c9eb9a53872a5dea1c7 P 9521ffed0d01466ab0aea29084e9d617: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 08:09:14.771976 9783 raft_consensus.cc:348] T 47f78920c65e4c9eb9a53872a5dea1c7 P 9521ffed0d01466ab0aea29084e9d617 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f31b3d35e9749b08e0eda69535d33cd" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40685 } } peers { permanent_uuid: "e4d26088a4674b1d80c2e00d7446fac9" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 35175 } } peers { permanent_uuid: "9521ffed0d01466ab0aea29084e9d617" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 45485 } }
I20260811 08:09:14.772060 9783 raft_consensus.cc:374] T 47f78920c65e4c9eb9a53872a5dea1c7 P 9521ffed0d01466ab0aea29084e9d617 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:09:14.772083 9783 raft_consensus.cc:729] T 47f78920c65e4c9eb9a53872a5dea1c7 P 9521ffed0d01466ab0aea29084e9d617 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9521ffed0d01466ab0aea29084e9d617, State: Initialized, Role: FOLLOWER
I20260811 08:09:14.772135 9783 consensus_queue.cc:260] T 47f78920c65e4c9eb9a53872a5dea1c7 P 9521ffed0d01466ab0aea29084e9d617 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f31b3d35e9749b08e0eda69535d33cd" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40685 } } peers { permanent_uuid: "e4d26088a4674b1d80c2e00d7446fac9" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 35175 } } peers { permanent_uuid: "9521ffed0d01466ab0aea29084e9d617" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 45485 } }
I20260811 08:09:14.772183 9784 tablet_bootstrap.cc:492] T 47f78920c65e4c9eb9a53872a5dea1c7 P 7f31b3d35e9749b08e0eda69535d33cd: Bootstrap starting.
I20260811 08:09:14.772230 9783 ts_tablet_manager.cc:1428] T 47f78920c65e4c9eb9a53872a5dea1c7 P 9521ffed0d01466ab0aea29084e9d617: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 08:09:14.772644 9784 tablet_bootstrap.cc:654] T 47f78920c65e4c9eb9a53872a5dea1c7 P 7f31b3d35e9749b08e0eda69535d33cd: Neither blocks nor log segments found. Creating new log.
I20260811 08:09:14.772986 9790 tablet_bootstrap.cc:492] T 47f78920c65e4c9eb9a53872a5dea1c7 P e4d26088a4674b1d80c2e00d7446fac9: Bootstrap starting.
I20260811 08:09:14.773329 9790 tablet_bootstrap.cc:654] T 47f78920c65e4c9eb9a53872a5dea1c7 P e4d26088a4674b1d80c2e00d7446fac9: Neither blocks nor log segments found. Creating new log.
I20260811 08:09:14.774204 9784 tablet_bootstrap.cc:492] T 47f78920c65e4c9eb9a53872a5dea1c7 P 7f31b3d35e9749b08e0eda69535d33cd: No bootstrap required, opened a new log
I20260811 08:09:14.774262 9784 ts_tablet_manager.cc:1397] T 47f78920c65e4c9eb9a53872a5dea1c7 P 7f31b3d35e9749b08e0eda69535d33cd: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 08:09:14.774418 9784 raft_consensus.cc:348] T 47f78920c65e4c9eb9a53872a5dea1c7 P 7f31b3d35e9749b08e0eda69535d33cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f31b3d35e9749b08e0eda69535d33cd" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40685 } } peers { permanent_uuid: "e4d26088a4674b1d80c2e00d7446fac9" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 35175 } } peers { permanent_uuid: "9521ffed0d01466ab0aea29084e9d617" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 45485 } }
I20260811 08:09:14.774493 9784 raft_consensus.cc:374] T 47f78920c65e4c9eb9a53872a5dea1c7 P 7f31b3d35e9749b08e0eda69535d33cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:09:14.774514 9784 raft_consensus.cc:729] T 47f78920c65e4c9eb9a53872a5dea1c7 P 7f31b3d35e9749b08e0eda69535d33cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f31b3d35e9749b08e0eda69535d33cd, State: Initialized, Role: FOLLOWER
I20260811 08:09:14.774554 9784 consensus_queue.cc:260] T 47f78920c65e4c9eb9a53872a5dea1c7 P 7f31b3d35e9749b08e0eda69535d33cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f31b3d35e9749b08e0eda69535d33cd" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40685 } } peers { permanent_uuid: "e4d26088a4674b1d80c2e00d7446fac9" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 35175 } } peers { permanent_uuid: "9521ffed0d01466ab0aea29084e9d617" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 45485 } }
I20260811 08:09:14.774644 9784 ts_tablet_manager.cc:1428] T 47f78920c65e4c9eb9a53872a5dea1c7 P 7f31b3d35e9749b08e0eda69535d33cd: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 08:09:14.774827 9790 tablet_bootstrap.cc:492] T 47f78920c65e4c9eb9a53872a5dea1c7 P e4d26088a4674b1d80c2e00d7446fac9: No bootstrap required, opened a new log
I20260811 08:09:14.774948 9790 ts_tablet_manager.cc:1397] T 47f78920c65e4c9eb9a53872a5dea1c7 P e4d26088a4674b1d80c2e00d7446fac9: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 08:09:14.775275 9790 raft_consensus.cc:348] T 47f78920c65e4c9eb9a53872a5dea1c7 P e4d26088a4674b1d80c2e00d7446fac9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f31b3d35e9749b08e0eda69535d33cd" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40685 } } peers { permanent_uuid: "e4d26088a4674b1d80c2e00d7446fac9" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 35175 } } peers { permanent_uuid: "9521ffed0d01466ab0aea29084e9d617" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 45485 } }
I20260811 08:09:14.775393 9790 raft_consensus.cc:374] T 47f78920c65e4c9eb9a53872a5dea1c7 P e4d26088a4674b1d80c2e00d7446fac9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:09:14.775535 9790 raft_consensus.cc:729] T 47f78920c65e4c9eb9a53872a5dea1c7 P e4d26088a4674b1d80c2e00d7446fac9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4d26088a4674b1d80c2e00d7446fac9, State: Initialized, Role: FOLLOWER
I20260811 08:09:14.775660 9790 consensus_queue.cc:260] T 47f78920c65e4c9eb9a53872a5dea1c7 P e4d26088a4674b1d80c2e00d7446fac9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f31b3d35e9749b08e0eda69535d33cd" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40685 } } peers { permanent_uuid: "e4d26088a4674b1d80c2e00d7446fac9" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 35175 } } peers { permanent_uuid: "9521ffed0d01466ab0aea29084e9d617" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 45485 } }
I20260811 08:09:14.775925 9790 ts_tablet_manager.cc:1428] T 47f78920c65e4c9eb9a53872a5dea1c7 P e4d26088a4674b1d80c2e00d7446fac9: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 08:09:14.974411 9863 raft_consensus.cc:482] T 47f78920c65e4c9eb9a53872a5dea1c7 P e4d26088a4674b1d80c2e00d7446fac9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:09:14.974517 9863 raft_consensus.cc:504] T 47f78920c65e4c9eb9a53872a5dea1c7 P e4d26088a4674b1d80c2e00d7446fac9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f31b3d35e9749b08e0eda69535d33cd" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40685 } } peers { permanent_uuid: "e4d26088a4674b1d80c2e00d7446fac9" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 35175 } } peers { permanent_uuid: "9521ffed0d01466ab0aea29084e9d617" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 45485 } }
I20260811 08:09:14.974668 9863 leader_election.cc:288] T 47f78920c65e4c9eb9a53872a5dea1c7 P e4d26088a4674b1d80c2e00d7446fac9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7f31b3d35e9749b08e0eda69535d33cd (127.27.243.193:40685), 9521ffed0d01466ab0aea29084e9d617 (127.27.243.195:45485)
I20260811 08:09:14.974897 9238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47f78920c65e4c9eb9a53872a5dea1c7" candidate_uuid: "e4d26088a4674b1d80c2e00d7446fac9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f31b3d35e9749b08e0eda69535d33cd" is_pre_election: true
I20260811 08:09:14.975010 9238 raft_consensus.cc:2454] T 47f78920c65e4c9eb9a53872a5dea1c7 P 7f31b3d35e9749b08e0eda69535d33cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4d26088a4674b1d80c2e00d7446fac9 in term 0.
I20260811 08:09:14.974954 9673 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47f78920c65e4c9eb9a53872a5dea1c7" candidate_uuid: "e4d26088a4674b1d80c2e00d7446fac9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9521ffed0d01466ab0aea29084e9d617" is_pre_election: true
I20260811 08:09:14.975059 9673 raft_consensus.cc:2454] T 47f78920c65e4c9eb9a53872a5dea1c7 P 9521ffed0d01466ab0aea29084e9d617 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4d26088a4674b1d80c2e00d7446fac9 in term 0.
I20260811 08:09:14.975255 9359 leader_election.cc:302] T 47f78920c65e4c9eb9a53872a5dea1c7 P e4d26088a4674b1d80c2e00d7446fac9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f31b3d35e9749b08e0eda69535d33cd, e4d26088a4674b1d80c2e00d7446fac9; no voters:
I20260811 08:09:14.975378 9863 raft_consensus.cc:2781] T 47f78920c65e4c9eb9a53872a5dea1c7 P e4d26088a4674b1d80c2e00d7446fac9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 08:09:14.975440 9863 raft_consensus.cc:482] T 47f78920c65e4c9eb9a53872a5dea1c7 P e4d26088a4674b1d80c2e00d7446fac9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 08:09:14.975457 9863 raft_consensus.cc:3037] T 47f78920c65e4c9eb9a53872a5dea1c7 P e4d26088a4674b1d80c2e00d7446fac9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:09:14.976207 9863 raft_consensus.cc:504] T 47f78920c65e4c9eb9a53872a5dea1c7 P e4d26088a4674b1d80c2e00d7446fac9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f31b3d35e9749b08e0eda69535d33cd" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40685 } } peers { permanent_uuid: "e4d26088a4674b1d80c2e00d7446fac9" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 35175 } } peers { permanent_uuid: "9521ffed0d01466ab0aea29084e9d617" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 45485 } }
I20260811 08:09:14.976353 9863 leader_election.cc:288] T 47f78920c65e4c9eb9a53872a5dea1c7 P e4d26088a4674b1d80c2e00d7446fac9 [CANDIDATE]: Term 1 election: Requested vote from peers 7f31b3d35e9749b08e0eda69535d33cd (127.27.243.193:40685), 9521ffed0d01466ab0aea29084e9d617 (127.27.243.195:45485)
I20260811 08:09:14.976521 9238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47f78920c65e4c9eb9a53872a5dea1c7" candidate_uuid: "e4d26088a4674b1d80c2e00d7446fac9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f31b3d35e9749b08e0eda69535d33cd"
I20260811 08:09:14.976542 9673 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47f78920c65e4c9eb9a53872a5dea1c7" candidate_uuid: "e4d26088a4674b1d80c2e00d7446fac9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9521ffed0d01466ab0aea29084e9d617"
I20260811 08:09:14.976601 9238 raft_consensus.cc:3037] T 47f78920c65e4c9eb9a53872a5dea1c7 P 7f31b3d35e9749b08e0eda69535d33cd [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:09:14.976612 9673 raft_consensus.cc:3037] T 47f78920c65e4c9eb9a53872a5dea1c7 P 9521ffed0d01466ab0aea29084e9d617 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:09:14.977257 9238 raft_consensus.cc:2454] T 47f78920c65e4c9eb9a53872a5dea1c7 P 7f31b3d35e9749b08e0eda69535d33cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4d26088a4674b1d80c2e00d7446fac9 in term 1.
I20260811 08:09:14.977296 9673 raft_consensus.cc:2454] T 47f78920c65e4c9eb9a53872a5dea1c7 P 9521ffed0d01466ab0aea29084e9d617 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4d26088a4674b1d80c2e00d7446fac9 in term 1.
I20260811 08:09:14.977459 9358 leader_election.cc:302] T 47f78920c65e4c9eb9a53872a5dea1c7 P e4d26088a4674b1d80c2e00d7446fac9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9521ffed0d01466ab0aea29084e9d617, e4d26088a4674b1d80c2e00d7446fac9; no voters:
I20260811 08:09:14.977578 9863 raft_consensus.cc:2781] T 47f78920c65e4c9eb9a53872a5dea1c7 P e4d26088a4674b1d80c2e00d7446fac9 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:09:14.977650 9863 raft_consensus.cc:686] T 47f78920c65e4c9eb9a53872a5dea1c7 P e4d26088a4674b1d80c2e00d7446fac9 [term 1 LEADER]: Becoming Leader. State: Replica: e4d26088a4674b1d80c2e00d7446fac9, State: Running, Role: LEADER
I20260811 08:09:14.977712 9863 consensus_queue.cc:237] T 47f78920c65e4c9eb9a53872a5dea1c7 P e4d26088a4674b1d80c2e00d7446fac9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f31b3d35e9749b08e0eda69535d33cd" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40685 } } peers { permanent_uuid: "e4d26088a4674b1d80c2e00d7446fac9" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 35175 } } peers { permanent_uuid: "9521ffed0d01466ab0aea29084e9d617" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 45485 } }
I20260811 08:09:14.978329 8969 catalog_manager.cc:5495] T 47f78920c65e4c9eb9a53872a5dea1c7 P e4d26088a4674b1d80c2e00d7446fac9 reported cstate change: term changed from 0 to 1, leader changed from <none> to e4d26088a4674b1d80c2e00d7446fac9 (127.27.243.194). New cstate: current_term: 1 leader_uuid: "e4d26088a4674b1d80c2e00d7446fac9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f31b3d35e9749b08e0eda69535d33cd" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4d26088a4674b1d80c2e00d7446fac9" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 35175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9521ffed0d01466ab0aea29084e9d617" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 45485 } health_report { overall_health: UNKNOWN } } }
I20260811 08:09:15.007849 9781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:15.005676 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36702 (local address 127.27.243.194:35175)
0811 08:09:15.005739 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:15.005741 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:15.005749 (+ 8us) server_negotiation.cc:407] Connection header received
0811 08:09:15.005772 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:15.005773 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:15.005782 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:15.005858 (+ 76us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:09:15.005974 (+ 116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:15.006458 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:15.007212 (+ 754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:15.007448 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:15.007516 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:15.007651 (+ 135us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:09:15.007680 (+ 29us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:09:15.007716 (+ 36us) server_negotiation.cc:1035] Waiting for connection context
0811 08:09:15.007753 (+ 37us) server_negotiation.cc:299] Negotiation successful
0811 08:09:15.007768 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 08:09:15.008756 9673 raft_consensus.cc:1261] T 47f78920c65e4c9eb9a53872a5dea1c7 P 9521ffed0d01466ab0aea29084e9d617 [term 1 FOLLOWER]: Refusing update from remote peer e4d26088a4674b1d80c2e00d7446fac9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:09:15.008766 9238 raft_consensus.cc:1261] T 47f78920c65e4c9eb9a53872a5dea1c7 P 7f31b3d35e9749b08e0eda69535d33cd [term 1 FOLLOWER]: Refusing update from remote peer e4d26088a4674b1d80c2e00d7446fac9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:09:15.009042 9850 consensus_queue.cc:1035] T 47f78920c65e4c9eb9a53872a5dea1c7 P e4d26088a4674b1d80c2e00d7446fac9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9521ffed0d01466ab0aea29084e9d617" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 45485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:09:15.009150 9863 consensus_queue.cc:1035] T 47f78920c65e4c9eb9a53872a5dea1c7 P e4d26088a4674b1d80c2e00d7446fac9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f31b3d35e9749b08e0eda69535d33cd" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:09:15.012622 8967 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44156:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:09:15.012714 8967 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44156:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:09:15.013267 8967 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c7303b1e1da24c53be2d72763b31d7c6: Sending DeleteTablet for 3 replicas of tablet 47f78920c65e4c9eb9a53872a5dea1c7
I20260811 08:09:15.013548 9642 tablet_service.cc:1514] Processing DeleteTablet for tablet 47f78920c65e4c9eb9a53872a5dea1c7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:09:15 UTC) from {username='oryx', principal='oryx/127.27.243.254@KRBTEST.COM'} at 127.0.0.1:33234
I20260811 08:09:15.013571 9431 tablet_service.cc:1514] Processing DeleteTablet for tablet 47f78920c65e4c9eb9a53872a5dea1c7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:09:15 UTC) from {username='oryx', principal='oryx/127.27.243.254@KRBTEST.COM'} at 127.0.0.1:36680
I20260811 08:09:15.013648 9820 tablet_replica.cc:330] T 47f78920c65e4c9eb9a53872a5dea1c7 P 9521ffed0d01466ab0aea29084e9d617: stopping tablet replica
I20260811 08:09:15.013660 9819 tablet_replica.cc:330] T 47f78920c65e4c9eb9a53872a5dea1c7 P e4d26088a4674b1d80c2e00d7446fac9: stopping tablet replica
I20260811 08:09:15.013698 9820 raft_consensus.cc:2229] T 47f78920c65e4c9eb9a53872a5dea1c7 P 9521ffed0d01466ab0aea29084e9d617 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:09:15.013705 9819 raft_consensus.cc:2229] T 47f78920c65e4c9eb9a53872a5dea1c7 P e4d26088a4674b1d80c2e00d7446fac9 [term 1 LEADER]: Raft consensus shutting down.
I20260811 08:09:15.013737 9820 raft_consensus.cc:2258] T 47f78920c65e4c9eb9a53872a5dea1c7 P 9521ffed0d01466ab0aea29084e9d617 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:09:15.013795 9819 raft_consensus.cc:2258] T 47f78920c65e4c9eb9a53872a5dea1c7 P e4d26088a4674b1d80c2e00d7446fac9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:09:15.013506 9204 tablet_service.cc:1514] Processing DeleteTablet for tablet 47f78920c65e4c9eb9a53872a5dea1c7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:09:15 UTC) from {username='oryx', principal='oryx/127.27.243.254@KRBTEST.COM'} at 127.0.0.1:37790
I20260811 08:09:15.014022 9821 tablet_replica.cc:330] T 47f78920c65e4c9eb9a53872a5dea1c7 P 7f31b3d35e9749b08e0eda69535d33cd: stopping tablet replica
I20260811 08:09:15.014072 9821 raft_consensus.cc:2229] T 47f78920c65e4c9eb9a53872a5dea1c7 P 7f31b3d35e9749b08e0eda69535d33cd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:09:15.014117 9821 raft_consensus.cc:2258] T 47f78920c65e4c9eb9a53872a5dea1c7 P 7f31b3d35e9749b08e0eda69535d33cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:09:15.014225 9820 ts_tablet_manager.cc:1905] T 47f78920c65e4c9eb9a53872a5dea1c7 P 9521ffed0d01466ab0aea29084e9d617: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:09:15.014170 8967 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44156:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 08:09:15.014310 8967 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 08:09:15.014410 9819 ts_tablet_manager.cc:1905] T 47f78920c65e4c9eb9a53872a5dea1c7 P e4d26088a4674b1d80c2e00d7446fac9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:09:15.015743 9431 tablet_service.cc:1467] Processing CreateTablet for tablet bfee3582ea1f400e8503bcb1c79348a8 (DEFAULT_TABLE table=test-table [id=c513283bfe9e4211b7397a75a3b266f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:09:15.015877 9204 tablet_service.cc:1467] Processing CreateTablet for tablet bfee3582ea1f400e8503bcb1c79348a8 (DEFAULT_TABLE table=test-table [id=c513283bfe9e4211b7397a75a3b266f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:09:15.015895 9820 ts_tablet_manager.cc:1918] T 47f78920c65e4c9eb9a53872a5dea1c7 P 9521ffed0d01466ab0aea29084e9d617: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:09:15.015938 9820 log.cc:1196] T 47f78920c65e4c9eb9a53872a5dea1c7 P 9521ffed0d01466ab0aea29084e9d617: Deleting WAL directory at /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435717191469-28623-0/minicluster-data/ts-2/wal/wals/47f78920c65e4c9eb9a53872a5dea1c7
I20260811 08:09:15.015980 9204 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bfee3582ea1f400e8503bcb1c79348a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:09:15.015977 9819 ts_tablet_manager.cc:1918] T 47f78920c65e4c9eb9a53872a5dea1c7 P e4d26088a4674b1d80c2e00d7446fac9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:09:15.016047 9819 log.cc:1196] T 47f78920c65e4c9eb9a53872a5dea1c7 P e4d26088a4674b1d80c2e00d7446fac9: Deleting WAL directory at /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435717191469-28623-0/minicluster-data/ts-1/wal/wals/47f78920c65e4c9eb9a53872a5dea1c7
I20260811 08:09:15.016139 9820 ts_tablet_manager.cc:1939] T 47f78920c65e4c9eb9a53872a5dea1c7 P 9521ffed0d01466ab0aea29084e9d617: Deleting consensus metadata
I20260811 08:09:15.016288 9819 ts_tablet_manager.cc:1939] T 47f78920c65e4c9eb9a53872a5dea1c7 P e4d26088a4674b1d80c2e00d7446fac9: Deleting consensus metadata
I20260811 08:09:15.016459 9431 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bfee3582ea1f400e8503bcb1c79348a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:09:15.017184 9784 tablet_bootstrap.cc:492] T bfee3582ea1f400e8503bcb1c79348a8 P 7f31b3d35e9749b08e0eda69535d33cd: Bootstrap starting.
I20260811 08:09:15.017319 8937 catalog_manager.cc:4841] TS 9521ffed0d01466ab0aea29084e9d617 (127.27.243.195:45485): tablet 47f78920c65e4c9eb9a53872a5dea1c7 (table test-table [id=1e33d6cd4cf144959fcf59ab3a388381]) successfully deleted
I20260811 08:09:15.017652 9784 tablet_bootstrap.cc:654] T bfee3582ea1f400e8503bcb1c79348a8 P 7f31b3d35e9749b08e0eda69535d33cd: Neither blocks nor log segments found. Creating new log.
I20260811 08:09:15.018050 9642 tablet_service.cc:1467] Processing CreateTablet for tablet bfee3582ea1f400e8503bcb1c79348a8 (DEFAULT_TABLE table=test-table [id=c513283bfe9e4211b7397a75a3b266f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:09:15.018069 8941 catalog_manager.cc:4841] TS e4d26088a4674b1d80c2e00d7446fac9 (127.27.243.194:35175): tablet 47f78920c65e4c9eb9a53872a5dea1c7 (table test-table [id=1e33d6cd4cf144959fcf59ab3a388381]) successfully deleted
I20260811 08:09:15.018151 9642 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bfee3582ea1f400e8503bcb1c79348a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:09:15.018357 9821 ts_tablet_manager.cc:1905] T 47f78920c65e4c9eb9a53872a5dea1c7 P 7f31b3d35e9749b08e0eda69535d33cd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:09:15.019232 9783 tablet_bootstrap.cc:492] T bfee3582ea1f400e8503bcb1c79348a8 P 9521ffed0d01466ab0aea29084e9d617: Bootstrap starting.
I20260811 08:09:15.019506 9784 tablet_bootstrap.cc:492] T bfee3582ea1f400e8503bcb1c79348a8 P 7f31b3d35e9749b08e0eda69535d33cd: No bootstrap required, opened a new log
I20260811 08:09:15.019546 9784 ts_tablet_manager.cc:1397] T bfee3582ea1f400e8503bcb1c79348a8 P 7f31b3d35e9749b08e0eda69535d33cd: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 08:09:15.019587 9783 tablet_bootstrap.cc:654] T bfee3582ea1f400e8503bcb1c79348a8 P 9521ffed0d01466ab0aea29084e9d617: Neither blocks nor log segments found. Creating new log.
I20260811 08:09:15.019694 9784 raft_consensus.cc:348] T bfee3582ea1f400e8503bcb1c79348a8 P 7f31b3d35e9749b08e0eda69535d33cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f31b3d35e9749b08e0eda69535d33cd" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40685 } } peers { permanent_uuid: "e4d26088a4674b1d80c2e00d7446fac9" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 35175 } } peers { permanent_uuid: "9521ffed0d01466ab0aea29084e9d617" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 45485 } }
I20260811 08:09:15.019752 9821 ts_tablet_manager.cc:1918] T 47f78920c65e4c9eb9a53872a5dea1c7 P 7f31b3d35e9749b08e0eda69535d33cd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:09:15.019801 9790 tablet_bootstrap.cc:492] T bfee3582ea1f400e8503bcb1c79348a8 P e4d26088a4674b1d80c2e00d7446fac9: Bootstrap starting.
I20260811 08:09:15.019832 9821 log.cc:1196] T 47f78920c65e4c9eb9a53872a5dea1c7 P 7f31b3d35e9749b08e0eda69535d33cd: Deleting WAL directory at /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435717191469-28623-0/minicluster-data/ts-0/wal/wals/47f78920c65e4c9eb9a53872a5dea1c7
I20260811 08:09:15.020051 9821 ts_tablet_manager.cc:1939] T 47f78920c65e4c9eb9a53872a5dea1c7 P 7f31b3d35e9749b08e0eda69535d33cd: Deleting consensus metadata
I20260811 08:09:15.020105 9790 tablet_bootstrap.cc:654] T bfee3582ea1f400e8503bcb1c79348a8 P e4d26088a4674b1d80c2e00d7446fac9: Neither blocks nor log segments found. Creating new log.
I20260811 08:09:15.019757 9784 raft_consensus.cc:374] T bfee3582ea1f400e8503bcb1c79348a8 P 7f31b3d35e9749b08e0eda69535d33cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:09:15.020344 9784 raft_consensus.cc:729] T bfee3582ea1f400e8503bcb1c79348a8 P 7f31b3d35e9749b08e0eda69535d33cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f31b3d35e9749b08e0eda69535d33cd, State: Initialized, Role: FOLLOWER
I20260811 08:09:15.020393 9784 consensus_queue.cc:260] T bfee3582ea1f400e8503bcb1c79348a8 P 7f31b3d35e9749b08e0eda69535d33cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f31b3d35e9749b08e0eda69535d33cd" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40685 } } peers { permanent_uuid: "e4d26088a4674b1d80c2e00d7446fac9" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 35175 } } peers { permanent_uuid: "9521ffed0d01466ab0aea29084e9d617" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 45485 } }
I20260811 08:09:15.020511 9784 ts_tablet_manager.cc:1428] T bfee3582ea1f400e8503bcb1c79348a8 P 7f31b3d35e9749b08e0eda69535d33cd: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 08:09:15.020711 8941 catalog_manager.cc:4841] TS 7f31b3d35e9749b08e0eda69535d33cd (127.27.243.193:40685): tablet 47f78920c65e4c9eb9a53872a5dea1c7 (table test-table [id=1e33d6cd4cf144959fcf59ab3a388381]) successfully deleted
I20260811 08:09:15.020819 9790 tablet_bootstrap.cc:492] T bfee3582ea1f400e8503bcb1c79348a8 P e4d26088a4674b1d80c2e00d7446fac9: No bootstrap required, opened a new log
I20260811 08:09:15.020879 9790 ts_tablet_manager.cc:1397] T bfee3582ea1f400e8503bcb1c79348a8 P e4d26088a4674b1d80c2e00d7446fac9: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 08:09:15.020980 9790 raft_consensus.cc:348] T bfee3582ea1f400e8503bcb1c79348a8 P e4d26088a4674b1d80c2e00d7446fac9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f31b3d35e9749b08e0eda69535d33cd" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40685 } } peers { permanent_uuid: "e4d26088a4674b1d80c2e00d7446fac9" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 35175 } } peers { permanent_uuid: "9521ffed0d01466ab0aea29084e9d617" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 45485 } }
I20260811 08:09:15.021042 9790 raft_consensus.cc:374] T bfee3582ea1f400e8503bcb1c79348a8 P e4d26088a4674b1d80c2e00d7446fac9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:09:15.021060 9790 raft_consensus.cc:729] T bfee3582ea1f400e8503bcb1c79348a8 P e4d26088a4674b1d80c2e00d7446fac9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4d26088a4674b1d80c2e00d7446fac9, State: Initialized, Role: FOLLOWER
I20260811 08:09:15.021096 9790 consensus_queue.cc:260] T bfee3582ea1f400e8503bcb1c79348a8 P e4d26088a4674b1d80c2e00d7446fac9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f31b3d35e9749b08e0eda69535d33cd" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40685 } } peers { permanent_uuid: "e4d26088a4674b1d80c2e00d7446fac9" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 35175 } } peers { permanent_uuid: "9521ffed0d01466ab0aea29084e9d617" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 45485 } }
I20260811 08:09:15.021180 9790 ts_tablet_manager.cc:1428] T bfee3582ea1f400e8503bcb1c79348a8 P e4d26088a4674b1d80c2e00d7446fac9: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:15.021677 9783 tablet_bootstrap.cc:492] T bfee3582ea1f400e8503bcb1c79348a8 P 9521ffed0d01466ab0aea29084e9d617: No bootstrap required, opened a new log
I20260811 08:09:15.021730 9783 ts_tablet_manager.cc:1397] T bfee3582ea1f400e8503bcb1c79348a8 P 9521ffed0d01466ab0aea29084e9d617: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260811 08:09:15.021832 9783 raft_consensus.cc:348] T bfee3582ea1f400e8503bcb1c79348a8 P 9521ffed0d01466ab0aea29084e9d617 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f31b3d35e9749b08e0eda69535d33cd" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40685 } } peers { permanent_uuid: "e4d26088a4674b1d80c2e00d7446fac9" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 35175 } } peers { permanent_uuid: "9521ffed0d01466ab0aea29084e9d617" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 45485 } }
I20260811 08:09:15.021934 9783 raft_consensus.cc:374] T bfee3582ea1f400e8503bcb1c79348a8 P 9521ffed0d01466ab0aea29084e9d617 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:09:15.021955 9783 raft_consensus.cc:729] T bfee3582ea1f400e8503bcb1c79348a8 P 9521ffed0d01466ab0aea29084e9d617 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9521ffed0d01466ab0aea29084e9d617, State: Initialized, Role: FOLLOWER
I20260811 08:09:15.021998 9783 consensus_queue.cc:260] T bfee3582ea1f400e8503bcb1c79348a8 P 9521ffed0d01466ab0aea29084e9d617 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f31b3d35e9749b08e0eda69535d33cd" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40685 } } peers { permanent_uuid: "e4d26088a4674b1d80c2e00d7446fac9" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 35175 } } peers { permanent_uuid: "9521ffed0d01466ab0aea29084e9d617" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 45485 } }
I20260811 08:09:15.022094 9783 ts_tablet_manager.cc:1428] T bfee3582ea1f400e8503bcb1c79348a8 P 9521ffed0d01466ab0aea29084e9d617: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 08:09:15.027360 9794 raft_consensus.cc:482] T bfee3582ea1f400e8503bcb1c79348a8 P 9521ffed0d01466ab0aea29084e9d617 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:09:15.027415 9794 raft_consensus.cc:504] T bfee3582ea1f400e8503bcb1c79348a8 P 9521ffed0d01466ab0aea29084e9d617 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f31b3d35e9749b08e0eda69535d33cd" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40685 } } peers { permanent_uuid: "e4d26088a4674b1d80c2e00d7446fac9" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 35175 } } peers { permanent_uuid: "9521ffed0d01466ab0aea29084e9d617" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 45485 } }
I20260811 08:09:15.027520 9794 leader_election.cc:288] T bfee3582ea1f400e8503bcb1c79348a8 P 9521ffed0d01466ab0aea29084e9d617 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7f31b3d35e9749b08e0eda69535d33cd (127.27.243.193:40685), e4d26088a4674b1d80c2e00d7446fac9 (127.27.243.194:35175)
I20260811 08:09:15.027701 9238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfee3582ea1f400e8503bcb1c79348a8" candidate_uuid: "9521ffed0d01466ab0aea29084e9d617" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f31b3d35e9749b08e0eda69535d33cd" is_pre_election: true
I20260811 08:09:15.027736 9458 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfee3582ea1f400e8503bcb1c79348a8" candidate_uuid: "9521ffed0d01466ab0aea29084e9d617" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4d26088a4674b1d80c2e00d7446fac9" is_pre_election: true
I20260811 08:09:15.027805 9458 raft_consensus.cc:2454] T bfee3582ea1f400e8503bcb1c79348a8 P e4d26088a4674b1d80c2e00d7446fac9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9521ffed0d01466ab0aea29084e9d617 in term 0.
I20260811 08:09:15.027804 9238 raft_consensus.cc:2454] T bfee3582ea1f400e8503bcb1c79348a8 P 7f31b3d35e9749b08e0eda69535d33cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9521ffed0d01466ab0aea29084e9d617 in term 0.
I20260811 08:09:15.027961 9572 leader_election.cc:302] T bfee3582ea1f400e8503bcb1c79348a8 P 9521ffed0d01466ab0aea29084e9d617 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9521ffed0d01466ab0aea29084e9d617, e4d26088a4674b1d80c2e00d7446fac9; no voters:
I20260811 08:09:15.028070 9794 raft_consensus.cc:2781] T bfee3582ea1f400e8503bcb1c79348a8 P 9521ffed0d01466ab0aea29084e9d617 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 08:09:15.028128 9794 raft_consensus.cc:482] T bfee3582ea1f400e8503bcb1c79348a8 P 9521ffed0d01466ab0aea29084e9d617 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 08:09:15.028160 9794 raft_consensus.cc:3037] T bfee3582ea1f400e8503bcb1c79348a8 P 9521ffed0d01466ab0aea29084e9d617 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:09:15.028877 9794 raft_consensus.cc:504] T bfee3582ea1f400e8503bcb1c79348a8 P 9521ffed0d01466ab0aea29084e9d617 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f31b3d35e9749b08e0eda69535d33cd" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40685 } } peers { permanent_uuid: "e4d26088a4674b1d80c2e00d7446fac9" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 35175 } } peers { permanent_uuid: "9521ffed0d01466ab0aea29084e9d617" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 45485 } }
I20260811 08:09:15.029013 9794 leader_election.cc:288] T bfee3582ea1f400e8503bcb1c79348a8 P 9521ffed0d01466ab0aea29084e9d617 [CANDIDATE]: Term 1 election: Requested vote from peers 7f31b3d35e9749b08e0eda69535d33cd (127.27.243.193:40685), e4d26088a4674b1d80c2e00d7446fac9 (127.27.243.194:35175)
I20260811 08:09:15.029188 9458 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfee3582ea1f400e8503bcb1c79348a8" candidate_uuid: "9521ffed0d01466ab0aea29084e9d617" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4d26088a4674b1d80c2e00d7446fac9"
I20260811 08:09:15.029260 9458 raft_consensus.cc:3037] T bfee3582ea1f400e8503bcb1c79348a8 P e4d26088a4674b1d80c2e00d7446fac9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:09:15.029224 9238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfee3582ea1f400e8503bcb1c79348a8" candidate_uuid: "9521ffed0d01466ab0aea29084e9d617" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f31b3d35e9749b08e0eda69535d33cd"
I20260811 08:09:15.029296 9238 raft_consensus.cc:3037] T bfee3582ea1f400e8503bcb1c79348a8 P 7f31b3d35e9749b08e0eda69535d33cd [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:09:15.029939 9458 raft_consensus.cc:2454] T bfee3582ea1f400e8503bcb1c79348a8 P e4d26088a4674b1d80c2e00d7446fac9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9521ffed0d01466ab0aea29084e9d617 in term 1.
I20260811 08:09:15.030086 9572 leader_election.cc:302] T bfee3582ea1f400e8503bcb1c79348a8 P 9521ffed0d01466ab0aea29084e9d617 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9521ffed0d01466ab0aea29084e9d617, e4d26088a4674b1d80c2e00d7446fac9; no voters:
I20260811 08:09:15.030102 9238 raft_consensus.cc:2454] T bfee3582ea1f400e8503bcb1c79348a8 P 7f31b3d35e9749b08e0eda69535d33cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9521ffed0d01466ab0aea29084e9d617 in term 1.
I20260811 08:09:15.030274 9794 raft_consensus.cc:2781] T bfee3582ea1f400e8503bcb1c79348a8 P 9521ffed0d01466ab0aea29084e9d617 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:09:15.030339 9794 raft_consensus.cc:686] T bfee3582ea1f400e8503bcb1c79348a8 P 9521ffed0d01466ab0aea29084e9d617 [term 1 LEADER]: Becoming Leader. State: Replica: 9521ffed0d01466ab0aea29084e9d617, State: Running, Role: LEADER
I20260811 08:09:15.030388 9794 consensus_queue.cc:237] T bfee3582ea1f400e8503bcb1c79348a8 P 9521ffed0d01466ab0aea29084e9d617 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f31b3d35e9749b08e0eda69535d33cd" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40685 } } peers { permanent_uuid: "e4d26088a4674b1d80c2e00d7446fac9" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 35175 } } peers { permanent_uuid: "9521ffed0d01466ab0aea29084e9d617" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 45485 } }
I20260811 08:09:15.030965 8967 catalog_manager.cc:5495] T bfee3582ea1f400e8503bcb1c79348a8 P 9521ffed0d01466ab0aea29084e9d617 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9521ffed0d01466ab0aea29084e9d617 (127.27.243.195). New cstate: current_term: 1 leader_uuid: "9521ffed0d01466ab0aea29084e9d617" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f31b3d35e9749b08e0eda69535d33cd" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4d26088a4674b1d80c2e00d7446fac9" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 35175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9521ffed0d01466ab0aea29084e9d617" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 45485 } health_report { overall_health: HEALTHY } } }
I20260811 08:09:15.039261 9779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:15.036509 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33258 (local address 127.27.243.195:45485)
0811 08:09:15.036554 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:15.036556 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:15.036567 (+ 11us) server_negotiation.cc:407] Connection header received
0811 08:09:15.036609 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:15.036610 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:15.036624 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:15.036692 (+ 68us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:09:15.036793 (+ 101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:15.037499 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:15.038504 (+ 1005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:15.038812 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:15.038891 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:15.038985 (+ 94us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:09:15.039018 (+ 33us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:09:15.039092 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 08:09:15.039149 (+ 57us) server_negotiation.cc:299] Negotiation successful
0811 08:09:15.039173 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 08:09:15.041468 9458 raft_consensus.cc:1261] T bfee3582ea1f400e8503bcb1c79348a8 P e4d26088a4674b1d80c2e00d7446fac9 [term 1 FOLLOWER]: Refusing update from remote peer 9521ffed0d01466ab0aea29084e9d617: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:09:15.041501 9238 raft_consensus.cc:1261] T bfee3582ea1f400e8503bcb1c79348a8 P 7f31b3d35e9749b08e0eda69535d33cd [term 1 FOLLOWER]: Refusing update from remote peer 9521ffed0d01466ab0aea29084e9d617: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:09:15.041694 9794 consensus_queue.cc:1035] T bfee3582ea1f400e8503bcb1c79348a8 P 9521ffed0d01466ab0aea29084e9d617 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f31b3d35e9749b08e0eda69535d33cd" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 40685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:09:15.041795 9789 consensus_queue.cc:1035] T bfee3582ea1f400e8503bcb1c79348a8 P 9521ffed0d01466ab0aea29084e9d617 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4d26088a4674b1d80c2e00d7446fac9" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 35175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:09:15.051558 8967 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44156:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:09:15.051651 8967 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44156:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:09:15.052254 8967 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c7303b1e1da24c53be2d72763b31d7c6: Sending DeleteTablet for 3 replicas of tablet bfee3582ea1f400e8503bcb1c79348a8
I20260811 08:09:15.052488 9204 tablet_service.cc:1514] Processing DeleteTablet for tablet bfee3582ea1f400e8503bcb1c79348a8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:09:15 UTC) from {username='oryx', principal='oryx/127.27.243.254@KRBTEST.COM'} at 127.0.0.1:37790
I20260811 08:09:15.052585 9821 tablet_replica.cc:330] T bfee3582ea1f400e8503bcb1c79348a8 P 7f31b3d35e9749b08e0eda69535d33cd: stopping tablet replica
I20260811 08:09:15.052634 9821 raft_consensus.cc:2229] T bfee3582ea1f400e8503bcb1c79348a8 P 7f31b3d35e9749b08e0eda69535d33cd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:09:15.052670 9821 raft_consensus.cc:2258] T bfee3582ea1f400e8503bcb1c79348a8 P 7f31b3d35e9749b08e0eda69535d33cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:09:15.052922 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 9093
I20260811 08:09:15.063597 9642 tablet_service.cc:1514] Processing DeleteTablet for tablet bfee3582ea1f400e8503bcb1c79348a8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:09:15 UTC) from {username='oryx', principal='oryx/127.27.243.254@KRBTEST.COM'} at 127.0.0.1:33234
I20260811 08:09:15.063725 9820 tablet_replica.cc:330] T bfee3582ea1f400e8503bcb1c79348a8 P 9521ffed0d01466ab0aea29084e9d617: stopping tablet replica
I20260811 08:09:15.063788 9820 raft_consensus.cc:2229] T bfee3582ea1f400e8503bcb1c79348a8 P 9521ffed0d01466ab0aea29084e9d617 [term 1 LEADER]: Raft consensus shutting down.
I20260811 08:09:15.063874 9820 raft_consensus.cc:2258] T bfee3582ea1f400e8503bcb1c79348a8 P 9521ffed0d01466ab0aea29084e9d617 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:09:15.064250 9820 ts_tablet_manager.cc:1905] T bfee3582ea1f400e8503bcb1c79348a8 P 9521ffed0d01466ab0aea29084e9d617: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:09:15.065872 9820 ts_tablet_manager.cc:1918] T bfee3582ea1f400e8503bcb1c79348a8 P 9521ffed0d01466ab0aea29084e9d617: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 08:09:15.065936 9820 log.cc:1196] T bfee3582ea1f400e8503bcb1c79348a8 P 9521ffed0d01466ab0aea29084e9d617: Deleting WAL directory at /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435717191469-28623-0/minicluster-data/ts-2/wal/wals/bfee3582ea1f400e8503bcb1c79348a8
I20260811 08:09:15.066138 9820 ts_tablet_manager.cc:1939] T bfee3582ea1f400e8503bcb1c79348a8 P 9521ffed0d01466ab0aea29084e9d617: Deleting consensus metadata
I20260811 08:09:15.067384 8937 catalog_manager.cc:4841] TS 9521ffed0d01466ab0aea29084e9d617 (127.27.243.195:45485): tablet bfee3582ea1f400e8503bcb1c79348a8 (table test-table [id=c513283bfe9e4211b7397a75a3b266f4]) successfully deleted
I20260811 08:09:15.067610 9431 tablet_service.cc:1514] Processing DeleteTablet for tablet bfee3582ea1f400e8503bcb1c79348a8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:09:15 UTC) from {username='oryx', principal='oryx/127.27.243.254@KRBTEST.COM'} at 127.0.0.1:36680
I20260811 08:09:15.068786 9819 tablet_replica.cc:330] T bfee3582ea1f400e8503bcb1c79348a8 P e4d26088a4674b1d80c2e00d7446fac9: stopping tablet replica
I20260811 08:09:15.068841 9819 raft_consensus.cc:2229] T bfee3582ea1f400e8503bcb1c79348a8 P e4d26088a4674b1d80c2e00d7446fac9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:09:15.068878 9819 raft_consensus.cc:2258] T bfee3582ea1f400e8503bcb1c79348a8 P e4d26088a4674b1d80c2e00d7446fac9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:09:15.069866 9819 ts_tablet_manager.cc:1905] T bfee3582ea1f400e8503bcb1c79348a8 P e4d26088a4674b1d80c2e00d7446fac9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:09:15.070991 9819 ts_tablet_manager.cc:1918] T bfee3582ea1f400e8503bcb1c79348a8 P e4d26088a4674b1d80c2e00d7446fac9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 08:09:15.071030 9819 log.cc:1196] T bfee3582ea1f400e8503bcb1c79348a8 P e4d26088a4674b1d80c2e00d7446fac9: Deleting WAL directory at /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435717191469-28623-0/minicluster-data/ts-1/wal/wals/bfee3582ea1f400e8503bcb1c79348a8
I20260811 08:09:15.071172 9819 ts_tablet_manager.cc:1939] T bfee3582ea1f400e8503bcb1c79348a8 P e4d26088a4674b1d80c2e00d7446fac9: Deleting consensus metadata
I20260811 08:09:15.072160 8941 catalog_manager.cc:4841] TS e4d26088a4674b1d80c2e00d7446fac9 (127.27.243.194:35175): tablet bfee3582ea1f400e8503bcb1c79348a8 (table test-table [id=c513283bfe9e4211b7397a75a3b266f4]) successfully deleted
W20260811 08:09:15.074661 8941 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.27.243.193:40685 (error 108)
I20260811 08:09:15.075001 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 9333
I20260811 08:09:15.086611 9928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:15.085559 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.193:40685 (local address 127.0.0.1:37796)
0811 08:09:15.086519 (+ 960us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:15.086569 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.193:40685: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":939,"thread_start_us":899,"threads_started":1}
W20260811 08:09:15.086773 8941 catalog_manager.cc:4584] TS 7f31b3d35e9749b08e0eda69535d33cd (127.27.243.193:40685): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet bfee3582ea1f400e8503bcb1c79348a8: Network error: Client connection negotiation failed: client connection to 127.27.243.193:40685: connect: Connection refused (error 111)
I20260811 08:09:15.091786 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 9549
I20260811 08:09:15.104205 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 8910
2026-08-11T08:09:15Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (2813 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786435717191469-28623-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:09:15 dist-test-slave-7lbf krb5kdc[9932](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:09:15 dist-test-slave-7lbf krb5kdc[9932](info): set up 2 sockets
Aug 11 08:09:15 dist-test-slave-7lbf krb5kdc[9932](info): commencing operation
krb5kdc: starting...
W20260811 08:09:16.262079 28623 mini_kdc.cc:121] Time spent starting KDC: real 1.132s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786435717191469-28623-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786435717191469-28623-0/krb5kdc/test-user.keytab.
Aug 11 08:09:16 dist-test-slave-7lbf krb5kdc[9932](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435756, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:09:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:09:16Z Disabled control of system clock
WARNING: no policy specified for kudu/127.27.243.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.243.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.243.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab.
Entry for principal kudu/127.27.243.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab.
I20260811 08:09:16.380245 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786435717191469-28623-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786435717191469-28623-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786435717191469-28623-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.243.254:45903
--webserver_interface=127.27.243.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab
--principal=kudu/127.27.243.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:42889
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.243.254:45903
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:09:16.462867 9952 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:09:16.463085 9952 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:09:16.463116 9952 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:09:16.464251 9952 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:09:16.464291 9952 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:09:16.464309 9952 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:09:16.464325 9952 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:09:16.464339 9952 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:09:16.465833 9952 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:42889
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786435717191469-28623-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786435717191469-28623-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.243.254:45903
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.243.254:45903
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.243.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9952
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786435717191469-28623-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:09:16.466084 9952 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:09:16.466298 9952 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:09:16.471052 9958 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:09:16.471068 9952 server_base.cc:1034] running on GCE node
W20260811 08:09:16.471138 9960 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:09:16.471053 9963 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:09:16.471441 9952 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:09:16.471776 9952 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:09:16.472932 9952 hybrid_clock.cc:648] HybridClock initialized: now 1786435756472919 us; error 32 us; skew 500 ppm
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-11T08:09:16Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1368 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:09:16 dist-test-slave-7lbf krb5kdc[9971](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:09:16 dist-test-slave-7lbf krb5kdc[9971](info): set up 2 sockets
Aug 11 08:09:16 dist-test-slave-7lbf krb5kdc[9971](info): commencing operation
krb5kdc: starting...
W20260811 08:09:17.631891 28623 mini_kdc.cc:121] Time spent starting KDC: real 1.133s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/krb5kdc/test-user.keytab.
Aug 11 08:09:17 dist-test-slave-7lbf krb5kdc[9971](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435757, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:09:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:09:17Z Disabled control of system clock
WARNING: no policy specified for kudu/127.27.243.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.243.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.243.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab.
Entry for principal kudu/127.27.243.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab.
I20260811 08:09:17.750126 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.243.254:35905
--webserver_interface=127.27.243.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab
--principal=kudu/127.27.243.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:36647
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.243.254:35905
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:09:17.831375 9991 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:09:17.831578 9991 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:09:17.831609 9991 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:09:17.832737 9991 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:09:17.832780 9991 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:09:17.832806 9991 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:09:17.832823 9991 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:09:17.832839 9991 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:09:17.834321 9991 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:36647
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.243.254:35905
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab
--principal=kudu/127.27.243.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.243.254:35905
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.243.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9991
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:09:17.834563 9991 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:09:17.834766 9991 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:09:17.839339 10000 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:09:17.839354 10002 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:09:17.839475 9991 server_base.cc:1034] running on GCE node
W20260811 08:09:17.839394 10005 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:09:17.839776 9991 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:09:17.840057 9991 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:09:17.841203 9991 hybrid_clock.cc:648] HybridClock initialized: now 1786435757841186 us; error 36 us; skew 500 ppm
Aug 11 08:09:17 dist-test-slave-7lbf krb5kdc[9971](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435757, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:09:17.843657 9991 init.cc:377] Logged in from keytab as kudu/127.27.243.254@KRBTEST.COM (short username kudu)
I20260811 08:09:17.844095 9991 webserver.cc:460] Webserver started at http://127.27.243.254:41751/ using document root <none> and password file <none>
I20260811 08:09:17.844347 9991 fs_manager.cc:359] Metadata directory not provided
I20260811 08:09:17.844391 9991 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:09:17.844481 9991 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:09:17.845441 9991 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/master-0/data/instance:
uuid: "991cb0d94828470bb4378bd05e4dab7b"
format_stamp: "Formatted at 2026-08-11 08:09:17 on dist-test-slave-7lbf"
server_key: "1a7810eb9b1eacbf4824f33060f070b4"
server_key_iv: "8b271be7862c23cb1b24442a35d17574"
server_key_version: "encryptionkey@0"
I20260811 08:09:17.845790 9991 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/master-0/wal/instance:
uuid: "991cb0d94828470bb4378bd05e4dab7b"
format_stamp: "Formatted at 2026-08-11 08:09:17 on dist-test-slave-7lbf"
server_key: "1a7810eb9b1eacbf4824f33060f070b4"
server_key_iv: "8b271be7862c23cb1b24442a35d17574"
server_key_version: "encryptionkey@0"
I20260811 08:09:17.846967 9991 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:09:17.847602 10022 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:17.847739 9991 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 08:09:17.847818 9991 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/master-0/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/master-0/wal
uuid: "991cb0d94828470bb4378bd05e4dab7b"
format_stamp: "Formatted at 2026-08-11 08:09:17 on dist-test-slave-7lbf"
server_key: "1a7810eb9b1eacbf4824f33060f070b4"
server_key_iv: "8b271be7862c23cb1b24442a35d17574"
server_key_version: "encryptionkey@0"
I20260811 08:09:17.847886 9991 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:09:17.869755 9991 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:09:17.871611 9991 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:09:17.871743 9991 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:09:17.875563 9991 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.254:35905
I20260811 08:09:17.875603 10104 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.254:35905 every 8 connection(s)
I20260811 08:09:17.875982 9991 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
I20260811 08:09:17.876925 10107 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:09:17.879508 10107 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 991cb0d94828470bb4378bd05e4dab7b: Bootstrap starting.
I20260811 08:09:17.880096 10107 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 991cb0d94828470bb4378bd05e4dab7b: Neither blocks nor log segments found. Creating new log.
I20260811 08:09:17.880362 10107 log.cc:824] T 00000000000000000000000000000000 P 991cb0d94828470bb4378bd05e4dab7b: Log is configured to *not* fsync() on all Append() calls
I20260811 08:09:17.881050 10107 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 991cb0d94828470bb4378bd05e4dab7b: No bootstrap required, opened a new log
I20260811 08:09:17.882658 10107 raft_consensus.cc:348] T 00000000000000000000000000000000 P 991cb0d94828470bb4378bd05e4dab7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "991cb0d94828470bb4378bd05e4dab7b" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 35905 } }
I20260811 08:09:17.882793 10107 raft_consensus.cc:374] T 00000000000000000000000000000000 P 991cb0d94828470bb4378bd05e4dab7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:09:17.882824 10107 raft_consensus.cc:729] T 00000000000000000000000000000000 P 991cb0d94828470bb4378bd05e4dab7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 991cb0d94828470bb4378bd05e4dab7b, State: Initialized, Role: FOLLOWER
I20260811 08:09:17.882949 10107 consensus_queue.cc:260] T 00000000000000000000000000000000 P 991cb0d94828470bb4378bd05e4dab7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "991cb0d94828470bb4378bd05e4dab7b" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 35905 } }
I20260811 08:09:17.883018 10107 raft_consensus.cc:388] T 00000000000000000000000000000000 P 991cb0d94828470bb4378bd05e4dab7b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:09:17.883037 10107 raft_consensus.cc:482] T 00000000000000000000000000000000 P 991cb0d94828470bb4378bd05e4dab7b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:09:17.883064 10107 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 991cb0d94828470bb4378bd05e4dab7b [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:09:17.883556 10107 raft_consensus.cc:504] T 00000000000000000000000000000000 P 991cb0d94828470bb4378bd05e4dab7b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "991cb0d94828470bb4378bd05e4dab7b" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 35905 } }
I20260811 08:09:17.883646 10107 leader_election.cc:302] T 00000000000000000000000000000000 P 991cb0d94828470bb4378bd05e4dab7b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 991cb0d94828470bb4378bd05e4dab7b; no voters:
I20260811 08:09:17.883790 10107 leader_election.cc:288] T 00000000000000000000000000000000 P 991cb0d94828470bb4378bd05e4dab7b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:09:17.883832 10115 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 991cb0d94828470bb4378bd05e4dab7b [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:09:17.883987 10115 raft_consensus.cc:686] T 00000000000000000000000000000000 P 991cb0d94828470bb4378bd05e4dab7b [term 1 LEADER]: Becoming Leader. State: Replica: 991cb0d94828470bb4378bd05e4dab7b, State: Running, Role: LEADER
I20260811 08:09:17.884027 10107 sys_catalog.cc:564] T 00000000000000000000000000000000 P 991cb0d94828470bb4378bd05e4dab7b [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:09:17.884074 10115 consensus_queue.cc:237] T 00000000000000000000000000000000 P 991cb0d94828470bb4378bd05e4dab7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "991cb0d94828470bb4378bd05e4dab7b" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 35905 } }
I20260811 08:09:17.884452 10117 sys_catalog.cc:455] T 00000000000000000000000000000000 P 991cb0d94828470bb4378bd05e4dab7b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "991cb0d94828470bb4378bd05e4dab7b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "991cb0d94828470bb4378bd05e4dab7b" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 35905 } } }
I20260811 08:09:17.884537 10117 sys_catalog.cc:458] T 00000000000000000000000000000000 P 991cb0d94828470bb4378bd05e4dab7b [sys.catalog]: This master's current role is: LEADER
I20260811 08:09:17.884673 10119 sys_catalog.cc:455] T 00000000000000000000000000000000 P 991cb0d94828470bb4378bd05e4dab7b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 991cb0d94828470bb4378bd05e4dab7b. Latest consensus state: current_term: 1 leader_uuid: "991cb0d94828470bb4378bd05e4dab7b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "991cb0d94828470bb4378bd05e4dab7b" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 35905 } } }
I20260811 08:09:17.884769 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 9991
I20260811 08:09:17.884822 10119 sys_catalog.cc:458] T 00000000000000000000000000000000 P 991cb0d94828470bb4378bd05e4dab7b [sys.catalog]: This master's current role is: LEADER
I20260811 08:09:17.884903 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/master-0/wal/instance
I20260811 08:09:17.885114 28623 external_mini_cluster.cc:1428] Setting key 30523ac1b1348695620ed91a4ada5a9e
W20260811 08:09:17.885766 10152 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 991cb0d94828470bb4378bd05e4dab7b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 08:09:17.885824 10152 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 08:09:17.885918 10151 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:09:17.886103 10151 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:09:17.887897 10151 catalog_manager.cc:1347] Generated new cluster ID: 73dfb58dcbb14182876a07a72471db91
I20260811 08:09:17.887953 10151 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 08:09:17 dist-test-slave-7lbf krb5kdc[9971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435757, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.243.254@KRBTEST.COM
I20260811 08:09:17.898278 10156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:17.885588 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42888 (local address 127.27.243.254:35905)
0811 08:09:17.889639 (+ 4051us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:17.889647 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:17.889674 (+ 27us) server_negotiation.cc:407] Connection header received
0811 08:09:17.889762 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:17.889768 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:17.889808 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:17.889929 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:17.890562 (+ 633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:17.891494 (+ 932us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:17.892234 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:17.892641 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:17.892735 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:17.894882 (+ 2147us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:09:17.894885 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:09:17.894886 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:09:17.894896 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:09:17.896654 (+ 1758us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:17.897013 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:17.897017 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:17.897017 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:17.897106 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:17.897310 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:17.897311 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:17.897312 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:17.897578 (+ 266us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:09:17.897745 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0811 08:09:17.897916 (+ 171us) server_negotiation.cc:299] Negotiation successful
0811 08:09:17.898056 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4002,"thread_start_us":72,"threads_started":1}
I20260811 08:09:17.904146 10151 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:09:17.904621 10151 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:09:17.911041 10151 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 991cb0d94828470bb4378bd05e4dab7b: Generated new TSK 0
I20260811 08:09:17.911194 10151 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.27.243.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.243.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.243.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.193.keytab.
Entry for principal kudu/127.27.243.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.193.keytab.
I20260811 08:09:17.937681 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.243.193:0
--local_ip_for_outbound_sockets=127.27.243.193
--webserver_interface=127.27.243.193
--webserver_port=0
--tserver_master_addrs=127.27.243.254:35905
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.193.keytab
--principal=kudu/127.27.243.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:36647
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:09:18.019973 10162 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:09:18.020190 10162 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:09:18.020216 10162 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:09:18.021658 10162 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:09:18.021713 10162 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:09:18.021746 10162 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.243.193
I20260811 08:09:18.023305 10162 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:36647
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.193.keytab
--principal=kudu/127.27.243.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.243.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.243.193
--webserver_port=0
--tserver_master_addrs=127.27.243.254:35905
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10162
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.243.193
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:09:18.023541 10162 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:09:18.023906 10162 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:09:18.028677 10171 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:09:18.028683 10172 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:09:18.028699 10162 server_base.cc:1034] running on GCE node
W20260811 08:09:18.028697 10174 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:09:18.029085 10162 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:09:18.029302 10162 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:09:18.030459 10162 hybrid_clock.cc:648] HybridClock initialized: now 1786435758030441 us; error 29 us; skew 500 ppm
Aug 11 08:09:18 dist-test-slave-7lbf krb5kdc[9971](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435758, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:09:18.032876 10162 init.cc:377] Logged in from keytab as kudu/127.27.243.193@KRBTEST.COM (short username kudu)
I20260811 08:09:18.033275 10162 webserver.cc:460] Webserver started at http://127.27.243.193:45651/ using document root <none> and password file <none>
I20260811 08:09:18.033486 10162 fs_manager.cc:359] Metadata directory not provided
I20260811 08:09:18.033562 10162 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:09:18.033692 10162 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:09:18.034715 10162 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/ts-0/data/instance:
uuid: "1c5542f6540b48a99e7819d5125c5250"
format_stamp: "Formatted at 2026-08-11 08:09:18 on dist-test-slave-7lbf"
server_key: "7a59eece1d3b0d648fff436fec97575e"
server_key_iv: "82d0ac7632c9942c834481fb031ada88"
server_key_version: "encryptionkey@0"
I20260811 08:09:18.035037 10162 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/ts-0/wal/instance:
uuid: "1c5542f6540b48a99e7819d5125c5250"
format_stamp: "Formatted at 2026-08-11 08:09:18 on dist-test-slave-7lbf"
server_key: "7a59eece1d3b0d648fff436fec97575e"
server_key_iv: "82d0ac7632c9942c834481fb031ada88"
server_key_version: "encryptionkey@0"
I20260811 08:09:18.036262 10162 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 08:09:18.036974 10185 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:18.037127 10162 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 08:09:18.037210 10162 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/ts-0/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/ts-0/wal
uuid: "1c5542f6540b48a99e7819d5125c5250"
format_stamp: "Formatted at 2026-08-11 08:09:18 on dist-test-slave-7lbf"
server_key: "7a59eece1d3b0d648fff436fec97575e"
server_key_iv: "82d0ac7632c9942c834481fb031ada88"
server_key_version: "encryptionkey@0"
I20260811 08:09:18.037273 10162 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:09:18.050650 10162 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:09:18.052397 10162 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:09:18.052526 10162 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:09:18.052718 10162 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:09:18.053006 10162 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:09:18.053046 10162 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:18.053074 10162 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:09:18.053090 10162 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:18.058524 10162 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.193:40523
I20260811 08:09:18.058591 10378 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.193:40523 every 8 connection(s)
I20260811 08:09:18.058864 10162 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/ts-0/data/info.pb
I20260811 08:09:18.062623 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 10162
I20260811 08:09:18.062731 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/ts-0/wal/instance
I20260811 08:09:18.062912 28623 external_mini_cluster.cc:1428] Setting key 5073c4e43711274ea5d56945c6bd7d74
Aug 11 08:09:18 dist-test-slave-7lbf krb5kdc[9971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435758, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.193@KRBTEST.COM for kudu/127.27.243.254@KRBTEST.COM
I20260811 08:09:18.068135 10156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:18.059591 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.193:38715 (local address 127.27.243.254:35905)
0811 08:09:18.059656 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:18.059659 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:18.059826 (+ 167us) server_negotiation.cc:407] Connection header received
0811 08:09:18.060349 (+ 523us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:18.060351 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:18.060367 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:18.060428 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:18.061343 (+ 915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:18.061906 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:18.062904 (+ 998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:18.063176 (+ 272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:18.063235 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:18.065349 (+ 2114us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:09:18.065351 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:09:18.065351 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:09:18.065358 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:09:18.066800 (+ 1442us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:18.067232 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:18.067233 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:18.067234 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:18.067291 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:18.067545 (+ 254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:18.067546 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:18.067546 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:18.067647 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:09:18.067700 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 08:09:18.067990 (+ 290us) server_negotiation.cc:299] Negotiation successful
0811 08:09:18.068070 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 08:09:18.068372 10381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:18.059534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:35905 (local address 127.27.243.193:38715)
0811 08:09:18.059707 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:18.059745 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:18.060246 (+ 501us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:18.060500 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:18.060504 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:18.061054 (+ 550us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:09:18.061237 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:18.061242 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:18.061991 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:18.061992 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:18.062815 (+ 823us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:18.062818 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:18.063259 (+ 441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:18.063260 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:18.063419 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:18.063786 (+ 367us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:09:18.063794 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:09:18.065255 (+ 1461us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:09:18.066868 (+ 1613us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:09:18.066877 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:09:18.066879 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:09:18.067155 (+ 276us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:09:18.067355 (+ 200us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:09:18.067356 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:09:18.067356 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:09:18.067488 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:09:18.067698 (+ 210us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:09:18.067704 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:09:18.067857 (+ 153us) client_negotiation.cc:769] Sending connection context
0811 08:09:18.067973 (+ 116us) client_negotiation.cc:240] Negotiation successful
0811 08:09:18.068129 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":90,"threads_started":1}
I20260811 08:09:18.068923 10379 heartbeater.cc:347] Connected to a master server at 127.27.243.254:35905
I20260811 08:09:18.069025 10379 heartbeater.cc:464] Registering TS with master...
I20260811 08:09:18.069216 10379 heartbeater.cc:511] Master 127.27.243.254:35905 requested a full tablet report, sending...
I20260811 08:09:18.069737 10048 ts_manager.cc:194] Registered new tserver with Master: 1c5542f6540b48a99e7819d5125c5250 (127.27.243.193:40523)
I20260811 08:09:18.070372 10048 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.243.193@KRBTEST.COM'} at 127.27.243.193:38715
WARNING: no policy specified for kudu/127.27.243.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.243.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.243.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.194.keytab.
Entry for principal kudu/127.27.243.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.194.keytab.
I20260811 08:09:18.089329 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.243.194:0
--local_ip_for_outbound_sockets=127.27.243.194
--webserver_interface=127.27.243.194
--webserver_port=0
--tserver_master_addrs=127.27.243.254:35905
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.194.keytab
--principal=kudu/127.27.243.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:36647
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:09:18.170953 10384 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:09:18.171159 10384 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:09:18.171182 10384 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:09:18.172319 10384 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:09:18.172359 10384 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:09:18.172386 10384 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.243.194
I20260811 08:09:18.173867 10384 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:36647
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.194.keytab
--principal=kudu/127.27.243.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.243.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.243.194
--webserver_port=0
--tserver_master_addrs=127.27.243.254:35905
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10384
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.243.194
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:09:18.174093 10384 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:09:18.174302 10384 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:09:18.178999 10396 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:09:18.179018 10399 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:09:18.179100 10397 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:09:18.179196 10384 server_base.cc:1034] running on GCE node
I20260811 08:09:18.179425 10384 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:09:18.179626 10384 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:09:18.180763 10384 hybrid_clock.cc:648] HybridClock initialized: now 1786435758180755 us; error 35 us; skew 500 ppm
Aug 11 08:09:18 dist-test-slave-7lbf krb5kdc[9971](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435758, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:09:18.183192 10384 init.cc:377] Logged in from keytab as kudu/127.27.243.194@KRBTEST.COM (short username kudu)
I20260811 08:09:18.183617 10384 webserver.cc:460] Webserver started at http://127.27.243.194:44185/ using document root <none> and password file <none>
I20260811 08:09:18.183841 10384 fs_manager.cc:359] Metadata directory not provided
I20260811 08:09:18.183897 10384 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:09:18.184026 10384 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:09:18.185154 10384 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/ts-1/data/instance:
uuid: "22df5e0328a74e548ba2d03d95d8d45a"
format_stamp: "Formatted at 2026-08-11 08:09:18 on dist-test-slave-7lbf"
server_key: "241a954c5c59a7bc399d934ed8d83bf2"
server_key_iv: "c4f5d9ab206c0f3d091e41005b257c0e"
server_key_version: "encryptionkey@0"
I20260811 08:09:18.185492 10384 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/ts-1/wal/instance:
uuid: "22df5e0328a74e548ba2d03d95d8d45a"
format_stamp: "Formatted at 2026-08-11 08:09:18 on dist-test-slave-7lbf"
server_key: "241a954c5c59a7bc399d934ed8d83bf2"
server_key_iv: "c4f5d9ab206c0f3d091e41005b257c0e"
server_key_version: "encryptionkey@0"
I20260811 08:09:18.186755 10384 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:09:18.187410 10412 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:18.187567 10384 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 08:09:18.187644 10384 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/ts-1/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/ts-1/wal
uuid: "22df5e0328a74e548ba2d03d95d8d45a"
format_stamp: "Formatted at 2026-08-11 08:09:18 on dist-test-slave-7lbf"
server_key: "241a954c5c59a7bc399d934ed8d83bf2"
server_key_iv: "c4f5d9ab206c0f3d091e41005b257c0e"
server_key_version: "encryptionkey@0"
I20260811 08:09:18.187713 10384 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:09:18.196481 10384 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:09:18.198485 10384 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:09:18.198604 10384 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:09:18.198832 10384 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:09:18.199152 10384 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:09:18.199186 10384 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:18.199213 10384 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:09:18.199240 10384 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:18.205325 10384 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.194:36037
I20260811 08:09:18.205387 10594 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.194:36037 every 8 connection(s)
I20260811 08:09:18.205709 10384 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/ts-1/data/info.pb
Aug 11 08:09:18 dist-test-slave-7lbf krb5kdc[9971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435758, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.194@KRBTEST.COM for kudu/127.27.243.254@KRBTEST.COM
I20260811 08:09:18.214094 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 10384
I20260811 08:09:18.214195 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/ts-1/wal/instance
I20260811 08:09:18.214383 28623 external_mini_cluster.cc:1428] Setting key 0e30bf6676738d9613b7b964f2f211d8
I20260811 08:09:18.214699 10156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:18.206417 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.194:33327 (local address 127.27.243.254:35905)
0811 08:09:18.206490 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:18.206492 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:18.206667 (+ 175us) server_negotiation.cc:407] Connection header received
0811 08:09:18.207203 (+ 536us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:18.207205 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:18.207218 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:18.207271 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:18.208213 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:18.208733 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:18.209822 (+ 1089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:18.210031 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:18.210089 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:18.212128 (+ 2039us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:09:18.212129 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:09:18.212129 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:09:18.212137 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:09:18.213295 (+ 1158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:18.213741 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:18.213743 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:18.213743 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:18.213801 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:18.214026 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:18.214027 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:18.214027 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:18.214143 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:09:18.214199 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 08:09:18.214528 (+ 329us) server_negotiation.cc:299] Negotiation successful
0811 08:09:18.214616 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 08:09:18.214848 10598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:18.206371 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:35905 (local address 127.27.243.194:33327)
0811 08:09:18.206541 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:18.206582 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:18.207096 (+ 514us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:18.207344 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:18.207348 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:18.207915 (+ 567us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:09:18.208109 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:18.208115 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:18.208830 (+ 715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:18.208831 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:18.209733 (+ 902us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:18.209737 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:18.210102 (+ 365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:18.210103 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:18.210218 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:18.210669 (+ 451us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:09:18.210677 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:09:18.212039 (+ 1362us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:09:18.213395 (+ 1356us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:09:18.213403 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:09:18.213405 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:09:18.213672 (+ 267us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:09:18.213856 (+ 184us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:09:18.213857 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:09:18.213857 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:09:18.213968 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:09:18.214198 (+ 230us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:09:18.214206 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:09:18.214367 (+ 161us) client_negotiation.cc:769] Sending connection context
0811 08:09:18.214469 (+ 102us) client_negotiation.cc:240] Negotiation successful
0811 08:09:18.214629 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":86,"threads_started":1}
I20260811 08:09:18.215338 10595 heartbeater.cc:347] Connected to a master server at 127.27.243.254:35905
I20260811 08:09:18.215437 10595 heartbeater.cc:464] Registering TS with master...
I20260811 08:09:18.215608 10595 heartbeater.cc:511] Master 127.27.243.254:35905 requested a full tablet report, sending...
I20260811 08:09:18.215982 10048 ts_manager.cc:194] Registered new tserver with Master: 22df5e0328a74e548ba2d03d95d8d45a (127.27.243.194:36037)
I20260811 08:09:18.216353 10048 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.243.194@KRBTEST.COM'} at 127.27.243.194:33327
WARNING: no policy specified for kudu/127.27.243.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.243.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.243.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.195.keytab.
Entry for principal kudu/127.27.243.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.195.keytab.
I20260811 08:09:18.238405 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.243.195:0
--local_ip_for_outbound_sockets=127.27.243.195
--webserver_interface=127.27.243.195
--webserver_port=0
--tserver_master_addrs=127.27.243.254:35905
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.195.keytab
--principal=kudu/127.27.243.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:36647
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:09:18.321130 10602 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:09:18.321352 10602 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:09:18.321376 10602 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:09:18.322525 10602 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:09:18.322561 10602 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:09:18.322585 10602 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.243.195
I20260811 08:09:18.323989 10602 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:36647
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.195.keytab
--principal=kudu/127.27.243.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.243.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.243.195
--webserver_port=0
--tserver_master_addrs=127.27.243.254:35905
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10602
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.243.195
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:09:18.324188 10602 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:09:18.324383 10602 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:09:18.329324 10617 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:09:18.329432 10602 server_base.cc:1034] running on GCE node
W20260811 08:09:18.329504 10611 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:09:18.329319 10613 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:09:18.329756 10602 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:09:18.329994 10602 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:09:18.331140 10602 hybrid_clock.cc:648] HybridClock initialized: now 1786435758331127 us; error 29 us; skew 500 ppm
Aug 11 08:09:18 dist-test-slave-7lbf krb5kdc[9971](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435758, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:09:18.333691 10602 init.cc:377] Logged in from keytab as kudu/127.27.243.195@KRBTEST.COM (short username kudu)
I20260811 08:09:18.334168 10602 webserver.cc:460] Webserver started at http://127.27.243.195:42625/ using document root <none> and password file <none>
I20260811 08:09:18.334389 10602 fs_manager.cc:359] Metadata directory not provided
I20260811 08:09:18.334441 10602 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:09:18.334573 10602 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:09:18.335608 10602 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/ts-2/data/instance:
uuid: "f7d5f7d7937e4fe9ab2d5a6c5a8a5f44"
format_stamp: "Formatted at 2026-08-11 08:09:18 on dist-test-slave-7lbf"
server_key: "e7fcd52f6dfa80c94118c12219671f99"
server_key_iv: "2f9a5144ff05f0289d6bb4dec6cd6b3a"
server_key_version: "encryptionkey@0"
I20260811 08:09:18.335937 10602 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/ts-2/wal/instance:
uuid: "f7d5f7d7937e4fe9ab2d5a6c5a8a5f44"
format_stamp: "Formatted at 2026-08-11 08:09:18 on dist-test-slave-7lbf"
server_key: "e7fcd52f6dfa80c94118c12219671f99"
server_key_iv: "2f9a5144ff05f0289d6bb4dec6cd6b3a"
server_key_version: "encryptionkey@0"
I20260811 08:09:18.337393 10602 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 08:09:18.338233 10626 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:18.338433 10602 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 08:09:18.338527 10602 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/ts-2/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/ts-2/wal
uuid: "f7d5f7d7937e4fe9ab2d5a6c5a8a5f44"
format_stamp: "Formatted at 2026-08-11 08:09:18 on dist-test-slave-7lbf"
server_key: "e7fcd52f6dfa80c94118c12219671f99"
server_key_iv: "2f9a5144ff05f0289d6bb4dec6cd6b3a"
server_key_version: "encryptionkey@0"
I20260811 08:09:18.338595 10602 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:09:18.350000 10602 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:09:18.352070 10602 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:09:18.352192 10602 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:09:18.352421 10602 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:09:18.352721 10602 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:09:18.352756 10602 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:18.352778 10602 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:09:18.352802 10602 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:18.358479 10602 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.195:36709
I20260811 08:09:18.358527 10816 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.195:36709 every 8 connection(s)
I20260811 08:09:18.358834 10602 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/ts-2/data/info.pb
I20260811 08:09:18.363550 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 10602
I20260811 08:09:18.363665 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/ts-2/wal/instance
I20260811 08:09:18.363853 28623 external_mini_cluster.cc:1428] Setting key cdd6ff0547d0aae36b32eb08334d35b3
Aug 11 08:09:18 dist-test-slave-7lbf krb5kdc[9971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435758, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.195@KRBTEST.COM for kudu/127.27.243.254@KRBTEST.COM
I20260811 08:09:18.367868 10156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:18.359512 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.195:45457 (local address 127.27.243.254:35905)
0811 08:09:18.359569 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:18.359571 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:18.359775 (+ 204us) server_negotiation.cc:407] Connection header received
0811 08:09:18.360277 (+ 502us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:18.360278 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:18.360289 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:18.360354 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:18.361266 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:18.361820 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:18.362806 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:18.363036 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:18.363091 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:18.365387 (+ 2296us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:09:18.365388 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:09:18.365389 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:09:18.365396 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:09:18.366590 (+ 1194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:18.366974 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:18.366976 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:18.366976 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:18.367043 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:18.367259 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:18.367260 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:18.367260 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:18.367383 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:09:18.367441 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 08:09:18.367683 (+ 242us) server_negotiation.cc:299] Negotiation successful
0811 08:09:18.367757 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260811 08:09:18.367904 10820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:18.359478 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:35905 (local address 127.27.243.195:45457)
0811 08:09:18.359643 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:18.359685 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:18.360179 (+ 494us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:18.360426 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:18.360430 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:18.360990 (+ 560us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:09:18.361183 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:18.361187 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:18.361908 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:18.361909 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:18.362727 (+ 818us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:18.362729 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:18.363099 (+ 370us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:18.363099 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:18.363202 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:18.363699 (+ 497us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:09:18.363710 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:09:18.365305 (+ 1595us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:09:18.366657 (+ 1352us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:09:18.366664 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:09:18.366666 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:09:18.366885 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:09:18.367110 (+ 225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:09:18.367110 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:09:18.367111 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:09:18.367204 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:09:18.367434 (+ 230us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:09:18.367437 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:09:18.367549 (+ 112us) client_negotiation.cc:769] Sending connection context
0811 08:09:18.367626 (+ 77us) client_negotiation.cc:240] Negotiation successful
0811 08:09:18.367742 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":85,"threads_started":1}
I20260811 08:09:18.368320 10818 heartbeater.cc:347] Connected to a master server at 127.27.243.254:35905
I20260811 08:09:18.368415 10818 heartbeater.cc:464] Registering TS with master...
I20260811 08:09:18.368595 10818 heartbeater.cc:511] Master 127.27.243.254:35905 requested a full tablet report, sending...
I20260811 08:09:18.368984 10048 ts_manager.cc:194] Registered new tserver with Master: f7d5f7d7937e4fe9ab2d5a6c5a8a5f44 (127.27.243.195:36709)
I20260811 08:09:18.369355 10048 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.243.195@KRBTEST.COM'} at 127.27.243.195:45457
I20260811 08:09:18.375581 28623 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.27.243.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.27.243.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.27.243.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/krb5kdc/oryx_127.27.243.193.keytab.
Entry for principal oryx/127.27.243.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/krb5kdc/oryx_127.27.243.193.keytab.
WARNING: no policy specified for oryx/127.27.243.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.27.243.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.27.243.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/krb5kdc/oryx_127.27.243.194.keytab.
Entry for principal oryx/127.27.243.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/krb5kdc/oryx_127.27.243.194.keytab.
WARNING: no policy specified for oryx/127.27.243.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.27.243.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.27.243.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/krb5kdc/oryx_127.27.243.195.keytab.
Entry for principal oryx/127.27.243.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/krb5kdc/oryx_127.27.243.195.keytab.
I20260811 08:09:18.442411 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 10162
I20260811 08:09:18.454167 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 10384
I20260811 08:09:18.462563 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 10602
I20260811 08:09:18.477789 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 9991
I20260811 08:09:18.487118 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.243.254:35905
--webserver_interface=127.27.243.254
--webserver_port=41751
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab
--principal=kudu/127.27.243.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:36647
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.243.254:35905
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:09:18.567962 10830 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:09:18.568166 10830 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:09:18.568194 10830 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:09:18.569301 10830 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:09:18.569350 10830 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:09:18.569371 10830 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:09:18.569386 10830 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:09:18.569401 10830 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:09:18.570960 10830 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:36647
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.243.254:35905
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab
--principal=kudu/127.27.243.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.243.254:35905
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.243.254
--webserver_port=41751
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10830
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:09:18.571202 10830 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:09:18.571408 10830 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:09:18.575865 10842 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:09:18.575944 10841 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:09:18.575877 10844 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:09:18.576224 10830 server_base.cc:1034] running on GCE node
I20260811 08:09:18.576414 10830 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:09:18.576660 10830 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:09:18.577798 10830 hybrid_clock.cc:648] HybridClock initialized: now 1786435758577773 us; error 38 us; skew 500 ppm
Aug 11 08:09:18 dist-test-slave-7lbf krb5kdc[9971](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435758, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:09:18.580156 10830 init.cc:377] Logged in from keytab as kudu/127.27.243.254@KRBTEST.COM (short username kudu)
I20260811 08:09:18.580585 10830 webserver.cc:460] Webserver started at http://127.27.243.254:41751/ using document root <none> and password file <none>
I20260811 08:09:18.580793 10830 fs_manager.cc:359] Metadata directory not provided
I20260811 08:09:18.580892 10830 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:09:18.582177 10830 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.000s
I20260811 08:09:18.582777 10860 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:18.582955 10830 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 08:09:18.583040 10830 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/master-0/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/master-0/wal
uuid: "991cb0d94828470bb4378bd05e4dab7b"
format_stamp: "Formatted at 2026-08-11 08:09:17 on dist-test-slave-7lbf"
server_key: "1a7810eb9b1eacbf4824f33060f070b4"
server_key_iv: "8b271be7862c23cb1b24442a35d17574"
server_key_version: "encryptionkey@0"
I20260811 08:09:18.583352 10830 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:09:18.595141 10830 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:09:18.596933 10830 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:09:18.597069 10830 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:09:18.601171 10830 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.254:35905
I20260811 08:09:18.601203 10951 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.254:35905 every 8 connection(s)
I20260811 08:09:18.601613 10830 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
I20260811 08:09:18.601938 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 10830
I20260811 08:09:18.602236 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.243.193:40523
--local_ip_for_outbound_sockets=127.27.243.193
--tserver_master_addrs=127.27.243.254:35905
--webserver_port=45651
--webserver_interface=127.27.243.193
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.193.keytab
--principal=kudu/127.27.243.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:36647
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.27.243.193
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/krb5kdc/oryx_127.27.243.193.keytab with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 08:09:18.603127 10954 sys_catalog.cc:263] Verifying existing consensus state
I20260811 08:09:18.603790 10954 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 991cb0d94828470bb4378bd05e4dab7b: Bootstrap starting.
I20260811 08:09:18.614648 10954 log.cc:824] T 00000000000000000000000000000000 P 991cb0d94828470bb4378bd05e4dab7b: Log is configured to *not* fsync() on all Append() calls
I20260811 08:09:18.616715 10954 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 991cb0d94828470bb4378bd05e4dab7b: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 08:09:18.617017 10954 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 991cb0d94828470bb4378bd05e4dab7b: Bootstrap complete.
I20260811 08:09:18.620187 10954 raft_consensus.cc:348] T 00000000000000000000000000000000 P 991cb0d94828470bb4378bd05e4dab7b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "991cb0d94828470bb4378bd05e4dab7b" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 35905 } }
I20260811 08:09:18.620502 10954 raft_consensus.cc:729] T 00000000000000000000000000000000 P 991cb0d94828470bb4378bd05e4dab7b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 991cb0d94828470bb4378bd05e4dab7b, State: Initialized, Role: FOLLOWER
I20260811 08:09:18.620653 10954 consensus_queue.cc:260] T 00000000000000000000000000000000 P 991cb0d94828470bb4378bd05e4dab7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "991cb0d94828470bb4378bd05e4dab7b" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 35905 } }
I20260811 08:09:18.620715 10954 raft_consensus.cc:388] T 00000000000000000000000000000000 P 991cb0d94828470bb4378bd05e4dab7b [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:09:18.620757 10954 raft_consensus.cc:482] T 00000000000000000000000000000000 P 991cb0d94828470bb4378bd05e4dab7b [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:09:18.620800 10954 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 991cb0d94828470bb4378bd05e4dab7b [term 1 FOLLOWER]: Advancing to term 2
I20260811 08:09:18.622107 10954 raft_consensus.cc:504] T 00000000000000000000000000000000 P 991cb0d94828470bb4378bd05e4dab7b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "991cb0d94828470bb4378bd05e4dab7b" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 35905 } }
I20260811 08:09:18.622223 10954 leader_election.cc:302] T 00000000000000000000000000000000 P 991cb0d94828470bb4378bd05e4dab7b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 991cb0d94828470bb4378bd05e4dab7b; no voters:
I20260811 08:09:18.622406 10954 leader_election.cc:288] T 00000000000000000000000000000000 P 991cb0d94828470bb4378bd05e4dab7b [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 08:09:18.622453 10960 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 991cb0d94828470bb4378bd05e4dab7b [term 2 FOLLOWER]: Leader election won for term 2
I20260811 08:09:18.622638 10960 raft_consensus.cc:686] T 00000000000000000000000000000000 P 991cb0d94828470bb4378bd05e4dab7b [term 2 LEADER]: Becoming Leader. State: Replica: 991cb0d94828470bb4378bd05e4dab7b, State: Running, Role: LEADER
I20260811 08:09:18.622699 10954 sys_catalog.cc:564] T 00000000000000000000000000000000 P 991cb0d94828470bb4378bd05e4dab7b [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:09:18.622740 10960 consensus_queue.cc:237] T 00000000000000000000000000000000 P 991cb0d94828470bb4378bd05e4dab7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "991cb0d94828470bb4378bd05e4dab7b" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 35905 } }
I20260811 08:09:18.622985 10960 sys_catalog.cc:455] T 00000000000000000000000000000000 P 991cb0d94828470bb4378bd05e4dab7b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 991cb0d94828470bb4378bd05e4dab7b. Latest consensus state: current_term: 2 leader_uuid: "991cb0d94828470bb4378bd05e4dab7b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "991cb0d94828470bb4378bd05e4dab7b" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 35905 } } }
I20260811 08:09:18.623080 10960 sys_catalog.cc:458] T 00000000000000000000000000000000 P 991cb0d94828470bb4378bd05e4dab7b [sys.catalog]: This master's current role is: LEADER
I20260811 08:09:18.622987 10963 sys_catalog.cc:455] T 00000000000000000000000000000000 P 991cb0d94828470bb4378bd05e4dab7b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "991cb0d94828470bb4378bd05e4dab7b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "991cb0d94828470bb4378bd05e4dab7b" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 35905 } } }
I20260811 08:09:18.623595 10963 sys_catalog.cc:458] T 00000000000000000000000000000000 P 991cb0d94828470bb4378bd05e4dab7b [sys.catalog]: This master's current role is: LEADER
I20260811 08:09:18.623653 10968 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:09:18.624145 10968 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:09:18.624265 10968 catalog_manager.cc:1259] Loaded cluster ID: 73dfb58dcbb14182876a07a72471db91
I20260811 08:09:18.624296 10968 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:09:18.625488 10968 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:09:18.625689 10968 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 991cb0d94828470bb4378bd05e4dab7b: Loaded TSK: 0
I20260811 08:09:18.625912 10968 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 08:09:18.692097 10957 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:09:18.692292 10957 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:09:18.692313 10957 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:09:18.693451 10957 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:09:18.693492 10957 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:09:18.693544 10957 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.243.193
I20260811 08:09:18.695008 10957 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:36647
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/krb5kdc/oryx_127.27.243.193.keytab
--principal=oryx/127.27.243.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.243.193:40523
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.243.193
--webserver_port=45651
--tserver_master_addrs=127.27.243.254:35905
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10957
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.243.193
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:09:18.695230 10957 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:09:18.695448 10957 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:09:18.701126 10999 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:09:18.701140 11000 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:09:18.701162 11003 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:09:18.701565 10957 server_base.cc:1034] running on GCE node
I20260811 08:09:18.701751 10957 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:09:18.701996 10957 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:09:18.703140 10957 hybrid_clock.cc:648] HybridClock initialized: now 1786435758703127 us; error 36 us; skew 500 ppm
Aug 11 08:09:18 dist-test-slave-7lbf krb5kdc[9971](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435758, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.243.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:09:18.709378 10957 init.cc:377] Logged in from keytab as oryx/127.27.243.193@KRBTEST.COM (short username oryx)
I20260811 08:09:18.709867 10957 webserver.cc:460] Webserver started at http://127.27.243.193:45651/ using document root <none> and password file <none>
I20260811 08:09:18.710089 10957 fs_manager.cc:359] Metadata directory not provided
I20260811 08:09:18.710155 10957 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:09:18.711650 10957 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 08:09:18.712256 11016 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:18.712423 10957 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 08:09:18.712509 10957 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/ts-0/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/ts-0/wal
uuid: "1c5542f6540b48a99e7819d5125c5250"
format_stamp: "Formatted at 2026-08-11 08:09:18 on dist-test-slave-7lbf"
server_key: "7a59eece1d3b0d648fff436fec97575e"
server_key_iv: "82d0ac7632c9942c834481fb031ada88"
server_key_version: "encryptionkey@0"
I20260811 08:09:18.712842 10957 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:09:18.739611 10957 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:09:18.741930 10957 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:09:18.742079 10957 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:09:18.742313 10957 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:09:18.742666 10957 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:09:18.742712 10957 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:18.742743 10957 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:09:18.742763 10957 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:18.749225 10957 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.193:40523
I20260811 08:09:18.749287 11221 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.193:40523 every 8 connection(s)
I20260811 08:09:18.749635 10957 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/ts-0/data/info.pb
Aug 11 08:09:18 dist-test-slave-7lbf krb5kdc[9971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.243.193@KRBTEST.COM for oryx/127.27.243.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:09:18 dist-test-slave-7lbf krb5kdc[9971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.243.193@KRBTEST.COM for oryx/127.27.243.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:09:18.757870 11226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:18.750285 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:35905 (local address 127.27.243.193:56519)
0811 08:09:18.750478 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:18.750527 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:18.751042 (+ 515us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:18.751511 (+ 469us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:18.751514 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:18.752075 (+ 561us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:09:18.752264 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:18.752269 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:18.753318 (+ 1049us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:18.753318 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:18.754181 (+ 863us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:18.754184 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:18.754794 (+ 610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:18.754795 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:18.754927 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:18.755387 (+ 460us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:09:18.755395 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:09:18.757720 (+ 2325us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.243.254:35905: Server oryx/127.27.243.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":89,"threads_started":1}
W20260811 08:09:18.758013 11227 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:09:18.750332 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.193:56519 (local address 127.27.243.254:35905)
0811 08:09:18.750606 (+ 274us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:18.750616 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:18.750695 (+ 79us) server_negotiation.cc:407] Connection header received
0811 08:09:18.751229 (+ 534us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:18.751235 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:18.751288 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:18.751401 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:18.752368 (+ 967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:18.753231 (+ 863us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:18.754282 (+ 1051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:18.754702 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:18.754790 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:18.757853 (+ 3063us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.243.193:56519: BlockingRecv error: recv got EOF from 127.27.243.193:56519 (error 108)
Metrics: {"server-negotiator.queue_time_us":203,"thread_start_us":98,"threads_started":1}
W20260811 08:09:18.758123 11222 heartbeater.cc:644] Failed to heartbeat to 127.27.243.254:35905 (0 consecutive failures): Not authorized: Failed to ping master at 127.27.243.254:35905: Client connection negotiation failed: client connection to 127.27.243.254:35905: Server oryx/127.27.243.254@KRBTEST.COM not found in Kerberos database
I20260811 08:09:18.758857 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 10957
I20260811 08:09:18.759164 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.243.194:36037
--local_ip_for_outbound_sockets=127.27.243.194
--tserver_master_addrs=127.27.243.254:35905
--webserver_port=44185
--webserver_interface=127.27.243.194
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.194.keytab
--principal=kudu/127.27.243.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:36647
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.27.243.194
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/krb5kdc/oryx_127.27.243.194.keytab with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 08:09:18 dist-test-slave-7lbf krb5kdc[9971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.243.193@KRBTEST.COM for oryx/127.27.243.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:09:18 dist-test-slave-7lbf krb5kdc[9971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.243.193@KRBTEST.COM for oryx/127.27.243.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:09:18.762418 11226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:18.758400 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:35905 (local address 127.27.243.193:35011)
0811 08:09:18.758464 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:18.758474 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:18.758514 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:18.758637 (+ 123us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:18.758637 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:18.758767 (+ 130us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:09:18.758810 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:18.758812 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:18.759497 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:18.759498 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:18.759995 (+ 497us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:18.759997 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:18.760343 (+ 346us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:18.760344 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:18.760408 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:18.760783 (+ 375us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:09:18.760788 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:09:18.762354 (+ 1566us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.243.254:35905: Server oryx/127.27.243.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":46}
W20260811 08:09:18.762815 11227 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:09:18.758460 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.193:35011 (local address 127.27.243.254:35905)
0811 08:09:18.758541 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:18.758543 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:18.758551 (+ 8us) server_negotiation.cc:407] Connection header received
0811 08:09:18.758573 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:18.758574 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:18.758583 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:18.758630 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:18.758876 (+ 246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:18.759421 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:18.760074 (+ 653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:18.760283 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:18.760336 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:18.762447 (+ 2111us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.243.193:35011: BlockingRecv error: recv got EOF from 127.27.243.193:35011 (error 108)
Metrics: {"server-negotiator.queue_time_us":33}
Aug 11 08:09:18 dist-test-slave-7lbf krb5kdc[9971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.243.193@KRBTEST.COM for oryx/127.27.243.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:09:18 dist-test-slave-7lbf krb5kdc[9971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.243.193@KRBTEST.COM for oryx/127.27.243.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:09:18.766573 11226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:18.762643 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:35905 (local address 127.27.243.193:37023)
0811 08:09:18.762727 (+ 84us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:18.762739 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:18.762785 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:18.762948 (+ 163us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:18.762949 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:18.763066 (+ 117us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:09:18.763092 (+ 26us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:18.763093 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:18.763681 (+ 588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:18.763682 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:18.764175 (+ 493us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:18.764176 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:18.764509 (+ 333us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:18.764509 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:18.764570 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:18.764986 (+ 416us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:09:18.764990 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:09:18.766529 (+ 1539us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.243.254:35905: Server oryx/127.27.243.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":65}
W20260811 08:09:18.766690 11222 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 08:09:18.766705 11229 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:09:18.762693 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.193:37023 (local address 127.27.243.254:35905)
0811 08:09:18.762829 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:18.762831 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:18.762839 (+ 8us) server_negotiation.cc:407] Connection header received
0811 08:09:18.762860 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:18.762860 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:18.762870 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:18.762942 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:18.763159 (+ 217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:18.763614 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:18.764242 (+ 628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:18.764447 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:18.764502 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:18.766640 (+ 2138us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.243.193:37023: BlockingRecv error: recv got EOF from 127.27.243.193:37023 (error 108)
Metrics: {"server-negotiator.queue_time_us":115,"thread_start_us":79,"threads_started":1}
W20260811 08:09:18.843060 11228 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:09:18.843261 11228 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:09:18.843284 11228 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:09:18.844449 11228 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:09:18.844492 11228 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:09:18.844518 11228 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.243.194
I20260811 08:09:18.845989 11228 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:36647
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/krb5kdc/oryx_127.27.243.194.keytab
--principal=oryx/127.27.243.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.243.194:36037
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.243.194
--webserver_port=44185
--tserver_master_addrs=127.27.243.254:35905
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11228
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.243.194
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:09:18.846208 11228 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:09:18.846402 11228 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:09:18.851279 11235 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:09:18.851270 11239 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:09:18.851269 11236 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:09:18.851621 11228 server_base.cc:1034] running on GCE node
I20260811 08:09:18.851825 11228 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:09:18.852046 11228 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:09:18.853186 11228 hybrid_clock.cc:648] HybridClock initialized: now 1786435758853174 us; error 31 us; skew 500 ppm
Aug 11 08:09:18 dist-test-slave-7lbf krb5kdc[9971](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435758, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.243.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:09:18.855748 11228 init.cc:377] Logged in from keytab as oryx/127.27.243.194@KRBTEST.COM (short username oryx)
I20260811 08:09:18.856211 11228 webserver.cc:460] Webserver started at http://127.27.243.194:44185/ using document root <none> and password file <none>
I20260811 08:09:18.856443 11228 fs_manager.cc:359] Metadata directory not provided
I20260811 08:09:18.856508 11228 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:09:18.857867 11228 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 08:09:18.858469 11252 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:18.858618 11228 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 08:09:18.858705 11228 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/ts-1/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/ts-1/wal
uuid: "22df5e0328a74e548ba2d03d95d8d45a"
format_stamp: "Formatted at 2026-08-11 08:09:18 on dist-test-slave-7lbf"
server_key: "241a954c5c59a7bc399d934ed8d83bf2"
server_key_iv: "c4f5d9ab206c0f3d091e41005b257c0e"
server_key_version: "encryptionkey@0"
I20260811 08:09:18.859045 11228 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:09:18.888338 11228 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:09:18.890623 11228 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:09:18.890769 11228 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:09:18.891007 11228 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:09:18.891321 11228 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:09:18.891356 11228 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:18.891387 11228 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:09:18.891412 11228 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:18.897324 11228 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.194:36037
I20260811 08:09:18.897375 11443 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.194:36037 every 8 connection(s)
I20260811 08:09:18.897742 11228 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/ts-1/data/info.pb
Aug 11 08:09:18 dist-test-slave-7lbf krb5kdc[9971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.243.194@KRBTEST.COM for oryx/127.27.243.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:09:18 dist-test-slave-7lbf krb5kdc[9971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.243.194@KRBTEST.COM for oryx/127.27.243.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:09:18.904932 11449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:18.898435 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:35905 (local address 127.27.243.194:46057)
0811 08:09:18.898575 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:18.898612 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:18.899120 (+ 508us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:18.899365 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:18.899369 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:18.899917 (+ 548us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:09:18.900120 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:18.900124 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:18.900797 (+ 673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:18.900798 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:18.901674 (+ 876us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:18.901677 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:18.902041 (+ 364us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:18.902042 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:18.902162 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:18.902616 (+ 454us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:09:18.902625 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:09:18.904734 (+ 2109us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.243.254:35905: Server oryx/127.27.243.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":74,"threads_started":1}
W20260811 08:09:18.904946 11229 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:09:18.898423 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.194:46057 (local address 127.27.243.254:35905)
0811 08:09:18.898478 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:18.898480 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:18.898691 (+ 211us) server_negotiation.cc:407] Connection header received
0811 08:09:18.899219 (+ 528us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:18.899220 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:18.899236 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:18.899286 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:18.900214 (+ 928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:18.900711 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:18.901753 (+ 1042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:18.901970 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:18.902026 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:18.904892 (+ 2866us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.243.194:46057: BlockingRecv error: recv got EOF from 127.27.243.194:46057 (error 108)
Metrics: {"server-negotiator.queue_time_us":27}
W20260811 08:09:18.905220 11446 heartbeater.cc:644] Failed to heartbeat to 127.27.243.254:35905 (0 consecutive failures): Not authorized: Failed to ping master at 127.27.243.254:35905: Client connection negotiation failed: client connection to 127.27.243.254:35905: Server oryx/127.27.243.254@KRBTEST.COM not found in Kerberos database
I20260811 08:09:18.905243 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 11228
I20260811 08:09:18.905541 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.243.195:36709
--local_ip_for_outbound_sockets=127.27.243.195
--tserver_master_addrs=127.27.243.254:35905
--webserver_port=42625
--webserver_interface=127.27.243.195
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.195.keytab
--principal=kudu/127.27.243.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:36647
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.27.243.195
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/krb5kdc/oryx_127.27.243.195.keytab with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 08:09:18 dist-test-slave-7lbf krb5kdc[9971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.243.194@KRBTEST.COM for oryx/127.27.243.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:09:18 dist-test-slave-7lbf krb5kdc[9971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.243.194@KRBTEST.COM for oryx/127.27.243.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:09:18.909693 11449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:18.905465 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:35905 (local address 127.27.243.194:40305)
0811 08:09:18.905507 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:18.905534 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:18.905575 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:18.905719 (+ 144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:18.905719 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:18.905833 (+ 114us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:09:18.905880 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:18.905881 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:18.906647 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:18.906648 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:18.907210 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:18.907212 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:18.907533 (+ 321us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:18.907534 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:18.907594 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:18.907979 (+ 385us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:09:18.907984 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:09:18.909631 (+ 1647us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.243.254:35905: Server oryx/127.27.243.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":25}
W20260811 08:09:18.909755 11229 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:09:18.905532 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.194:40305 (local address 127.27.243.254:35905)
0811 08:09:18.905575 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:18.905577 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:18.905585 (+ 8us) server_negotiation.cc:407] Connection header received
0811 08:09:18.905627 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:18.905627 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:18.905638 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:18.905681 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:18.905954 (+ 273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:18.906568 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:18.907289 (+ 721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:18.907477 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:18.907520 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:18.909706 (+ 2186us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.243.194:40305: BlockingRecv error: recv got EOF from 127.27.243.194:40305 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
Aug 11 08:09:18 dist-test-slave-7lbf krb5kdc[9971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.243.194@KRBTEST.COM for oryx/127.27.243.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:09:18 dist-test-slave-7lbf krb5kdc[9971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.243.194@KRBTEST.COM for oryx/127.27.243.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:09:18.914065 11449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:18.910043 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:35905 (local address 127.27.243.194:39423)
0811 08:09:18.910083 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:18.910092 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:18.910128 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:18.910271 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:18.910271 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:18.910389 (+ 118us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:09:18.910415 (+ 26us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:18.910416 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:18.911231 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:18.911232 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:18.911706 (+ 474us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:18.911708 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:18.912106 (+ 398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:18.912107 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:18.912139 (+ 32us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:18.912483 (+ 344us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:09:18.912487 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:09:18.914023 (+ 1536us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.243.254:35905: Server oryx/127.27.243.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":24}
W20260811 08:09:18.914178 11229 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:09:18.910127 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.194:39423 (local address 127.27.243.254:35905)
0811 08:09:18.910165 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:18.910167 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:18.910175 (+ 8us) server_negotiation.cc:407] Connection header received
0811 08:09:18.910197 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:18.910197 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:18.910208 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:18.910267 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:18.910475 (+ 208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:18.911160 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:18.911775 (+ 615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:18.912043 (+ 268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:18.912113 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:18.914122 (+ 2009us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.243.194:39423: BlockingRecv error: recv got EOF from 127.27.243.194:39423 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260811 08:09:18.914284 11446 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 08:09:18.989363 11450 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:09:18.989604 11450 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:09:18.989629 11450 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:09:18.990777 11450 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:09:18.990828 11450 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:09:18.990855 11450 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.243.195
I20260811 08:09:18.992287 11450 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:36647
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/krb5kdc/oryx_127.27.243.195.keytab
--principal=oryx/127.27.243.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.243.195:36709
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.243.195
--webserver_port=42625
--tserver_master_addrs=127.27.243.254:35905
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11450
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.243.195
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:09:18.992511 11450 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:09:18.992745 11450 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:09:18.997659 11459 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:09:18.997575 11462 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:09:18.997591 11450 server_base.cc:1034] running on GCE node
W20260811 08:09:18.997630 11466 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:09:18.998055 11450 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:09:18.998291 11450 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:09:18.999441 11450 hybrid_clock.cc:648] HybridClock initialized: now 1786435758999425 us; error 32 us; skew 500 ppm
Aug 11 08:09:18 dist-test-slave-7lbf krb5kdc[9971](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435758, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.243.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:09:19.001997 11450 init.cc:377] Logged in from keytab as oryx/127.27.243.195@KRBTEST.COM (short username oryx)
I20260811 08:09:19.002461 11450 webserver.cc:460] Webserver started at http://127.27.243.195:42625/ using document root <none> and password file <none>
I20260811 08:09:19.002683 11450 fs_manager.cc:359] Metadata directory not provided
I20260811 08:09:19.002748 11450 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:09:19.004081 11450 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:09:19.004618 11481 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:19.004773 11450 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:19.004904 11450 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/ts-2/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/ts-2/wal
uuid: "f7d5f7d7937e4fe9ab2d5a6c5a8a5f44"
format_stamp: "Formatted at 2026-08-11 08:09:18 on dist-test-slave-7lbf"
server_key: "e7fcd52f6dfa80c94118c12219671f99"
server_key_iv: "2f9a5144ff05f0289d6bb4dec6cd6b3a"
server_key_version: "encryptionkey@0"
I20260811 08:09:19.005236 11450 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:09:19.027864 11450 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:09:19.029974 11450 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:09:19.030133 11450 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:09:19.030390 11450 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:09:19.030730 11450 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:09:19.030769 11450 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:19.030812 11450 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:09:19.030840 11450 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:19.037019 11450 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.195:36709
I20260811 08:09:19.037066 11677 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.195:36709 every 8 connection(s)
I20260811 08:09:19.037420 11450 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435717191469-28623-0/minicluster-data/ts-2/data/info.pb
I20260811 08:09:19.041656 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 11450
Aug 11 08:09:19 dist-test-slave-7lbf krb5kdc[9971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.243.195@KRBTEST.COM for oryx/127.27.243.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:09:19 dist-test-slave-7lbf krb5kdc[9971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.243.195@KRBTEST.COM for oryx/127.27.243.254@KRBTEST.COM, Server not found in Kerberos database
W20260811 08:09:19.044945 11229 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:09:19.038162 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.195:59419 (local address 127.27.243.254:35905)
0811 08:09:19.038214 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:19.038217 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:19.038454 (+ 237us) server_negotiation.cc:407] Connection header received
0811 08:09:19.038920 (+ 466us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:19.038922 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:19.038933 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:19.038989 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:19.039914 (+ 925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:19.040424 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:19.041413 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:19.041659 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:19.041731 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:19.044884 (+ 3153us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.243.195:59419: BlockingRecv error: recv got EOF from 127.27.243.195:59419 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 08:09:19.044986 11685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:19.038158 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:35905 (local address 127.27.243.195:59419)
0811 08:09:19.038326 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:19.038369 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:19.038829 (+ 460us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:19.039048 (+ 219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:19.039052 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:19.039630 (+ 578us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:09:19.039823 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:19.039828 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:19.040500 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:19.040500 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:19.041326 (+ 826us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:19.041328 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:19.041750 (+ 422us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:19.041752 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:19.041933 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:19.042469 (+ 536us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:09:19.042477 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:09:19.044791 (+ 2314us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.243.254:35905: Server oryx/127.27.243.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":95,"threads_started":1}
W20260811 08:09:19.045295 11680 heartbeater.cc:644] Failed to heartbeat to 127.27.243.254:35905 (0 consecutive failures): Not authorized: Failed to ping master at 127.27.243.254:35905: Client connection negotiation failed: client connection to 127.27.243.254:35905: Server oryx/127.27.243.254@KRBTEST.COM not found in Kerberos database
Aug 11 08:09:19 dist-test-slave-7lbf krb5kdc[9971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.243.195@KRBTEST.COM for oryx/127.27.243.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:09:19 dist-test-slave-7lbf krb5kdc[9971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.243.195@KRBTEST.COM for oryx/127.27.243.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:09:19.049450 11227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:19.042188 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42902 (local address 127.27.243.254:35905)
0811 08:09:19.042235 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:19.042237 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:19.042246 (+ 9us) server_negotiation.cc:407] Connection header received
0811 08:09:19.042269 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:19.042270 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:19.042283 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:19.042348 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:19.042981 (+ 633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:19.043521 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:19.044478 (+ 957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:19.044760 (+ 282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:19.044846 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:19.046337 (+ 1491us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:09:19.046342 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:09:19.046343 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:09:19.046356 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:09:19.048103 (+ 1747us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:19.048455 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:19.048459 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:19.048459 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:19.048556 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:19.048757 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:19.048758 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:19.048758 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:19.048982 (+ 224us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:09:19.049125 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0811 08:09:19.049255 (+ 130us) server_negotiation.cc:299] Negotiation successful
0811 08:09:19.049367 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
W20260811 08:09:19.049530 11229 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:09:19.045589 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.195:58233 (local address 127.27.243.254:35905)
0811 08:09:19.045622 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:19.045623 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:19.045656 (+ 33us) server_negotiation.cc:407] Connection header received
0811 08:09:19.045731 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:19.045732 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:19.045739 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:19.045781 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:19.046054 (+ 273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:19.046596 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:19.047226 (+ 630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:19.047411 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:19.047462 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:19.049457 (+ 1995us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.243.195:58233: BlockingRecv error: recv got EOF from 127.27.243.195:58233 (error 108)
Metrics: {"server-negotiator.queue_time_us":15}
I20260811 08:09:19.049536 11685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:19.045567 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:35905 (local address 127.27.243.195:58233)
0811 08:09:19.045612 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:19.045621 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:19.045670 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:19.045791 (+ 121us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:19.045791 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:19.045925 (+ 134us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:09:19.045982 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:19.045984 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:19.046671 (+ 687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:19.046672 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:19.047157 (+ 485us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:19.047159 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:19.047469 (+ 310us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:19.047470 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:19.047533 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:19.047934 (+ 401us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:09:19.047938 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:09:19.049370 (+ 1432us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.243.254:35905: Server oryx/127.27.243.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":31}
Aug 11 08:09:19 dist-test-slave-7lbf krb5kdc[9971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.243.195@KRBTEST.COM for oryx/127.27.243.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:09:19 dist-test-slave-7lbf krb5kdc[9971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.243.195@KRBTEST.COM for oryx/127.27.243.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:09:19.053328 11685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:19.049754 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:35905 (local address 127.27.243.195:58845)
0811 08:09:19.049790 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:19.049799 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:19.049831 (+ 32us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:19.049974 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:19.049975 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:19.050091 (+ 116us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:09:19.050115 (+ 24us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:19.050117 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:19.050770 (+ 653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:19.050771 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:19.051237 (+ 466us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:19.051238 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:19.051541 (+ 303us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:19.051541 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:19.051574 (+ 33us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:19.051879 (+ 305us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:09:19.051883 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:09:19.053289 (+ 1406us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.243.254:35905: Server oryx/127.27.243.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":23}
W20260811 08:09:19.053426 11229 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:09:19.049798 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.195:58845 (local address 127.27.243.254:35905)
0811 08:09:19.049829 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:19.049831 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:19.049838 (+ 7us) server_negotiation.cc:407] Connection header received
0811 08:09:19.049886 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:19.049886 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:19.049894 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:19.049936 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:19.050173 (+ 237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:19.050698 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:19.051308 (+ 610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:19.051481 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:19.051532 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:19.053371 (+ 1839us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.243.195:58845: BlockingRecv error: recv got EOF from 127.27.243.195:58845 (error 108)
Metrics: {"server-negotiator.queue_time_us":15}
W20260811 08:09:19.053460 11680 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 11 08:09:19 dist-test-slave-7lbf krb5kdc[9971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.243.193@KRBTEST.COM for oryx/127.27.243.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:09:19 dist-test-slave-7lbf krb5kdc[9971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.243.193@KRBTEST.COM for oryx/127.27.243.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:09:19.771673 11687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:19.767105 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:35905 (local address 127.27.243.193:44835)
0811 08:09:19.767262 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:19.767274 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:19.767332 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:19.767464 (+ 132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:19.767464 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:19.767633 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:09:19.767684 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:19.767686 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:19.768369 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:19.768369 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:19.768932 (+ 563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:19.768934 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:19.769287 (+ 353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:19.769288 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:19.769331 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:19.769780 (+ 449us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:09:19.769784 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:09:19.771601 (+ 1817us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.243.254:35905: Server oryx/127.27.243.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":71,"threads_started":1}
W20260811 08:09:19.771772 11688 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:09:19.767202 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.193:44835 (local address 127.27.243.254:35905)
0811 08:09:19.767341 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:19.767343 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:19.767359 (+ 16us) server_negotiation.cc:407] Connection header received
0811 08:09:19.767383 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:19.767383 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:19.767393 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:19.767452 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:19.767789 (+ 337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:19.768303 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:19.769009 (+ 706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:19.769227 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:19.769284 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:19.771703 (+ 2419us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.243.193:44835: BlockingRecv error: recv got EOF from 127.27.243.193:44835 (error 108)
Metrics: {"server-negotiator.queue_time_us":117,"thread_start_us":60,"threads_started":1}
Aug 11 08:09:19 dist-test-slave-7lbf krb5kdc[9971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.243.194@KRBTEST.COM for oryx/127.27.243.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:09:19 dist-test-slave-7lbf krb5kdc[9971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.243.194@KRBTEST.COM for oryx/127.27.243.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:09:19.919180 11689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:19.914657 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:35905 (local address 127.27.243.194:50523)
0811 08:09:19.914808 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:19.914820 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:19.914918 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:19.915045 (+ 127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:19.915046 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:19.915225 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:09:19.915274 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:19.915275 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:19.915971 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:19.915972 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:19.916532 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:19.916534 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:19.916869 (+ 335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:19.916870 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:19.916927 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:19.917318 (+ 391us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:09:19.917322 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:09:19.919088 (+ 1766us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.243.254:35905: Server oryx/127.27.243.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":67,"threads_started":1}
W20260811 08:09:19.919245 11688 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:09:19.914726 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.194:50523 (local address 127.27.243.254:35905)
0811 08:09:19.914806 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:19.914808 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:19.914906 (+ 98us) server_negotiation.cc:407] Connection header received
0811 08:09:19.914968 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:19.914968 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:19.914982 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:19.915034 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:19.915341 (+ 307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:19.915892 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:19.916611 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:19.916800 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:19.916855 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:19.919191 (+ 2336us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.243.194:50523: BlockingRecv error: recv got EOF from 127.27.243.194:50523 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
Aug 11 08:09:20 dist-test-slave-7lbf krb5kdc[9971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.243.195@KRBTEST.COM for oryx/127.27.243.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:09:20 dist-test-slave-7lbf krb5kdc[9971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.243.195@KRBTEST.COM for oryx/127.27.243.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:09:20.058322 11691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:20.053796 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:35905 (local address 127.27.243.195:32965)
0811 08:09:20.053926 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:20.053938 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:20.054004 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:20.054131 (+ 127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:20.054132 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:20.054306 (+ 174us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:09:20.054362 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:20.054364 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:20.055007 (+ 643us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:20.055008 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:20.055572 (+ 564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:20.055575 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:20.055911 (+ 336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:20.055911 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:20.055968 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:20.056390 (+ 422us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:09:20.056394 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:09:20.058233 (+ 1839us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.243.254:35905: Server oryx/127.27.243.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":68,"threads_started":1}
W20260811 08:09:20.058390 11688 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:09:20.053862 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.195:32965 (local address 127.27.243.254:35905)
0811 08:09:20.053919 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:20.053921 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:20.053986 (+ 65us) server_negotiation.cc:407] Connection header received
0811 08:09:20.054054 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:20.054055 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:20.054069 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:20.054114 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:20.054436 (+ 322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:20.054933 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:20.055653 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:20.055842 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:20.055904 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:20.058337 (+ 2433us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.243.195:32965: BlockingRecv error: recv got EOF from 127.27.243.195:32965 (error 108)
Metrics: {"server-negotiator.queue_time_us":30}
Aug 11 08:09:20 dist-test-slave-7lbf krb5kdc[9971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.243.193@KRBTEST.COM for oryx/127.27.243.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:09:20 dist-test-slave-7lbf krb5kdc[9971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.243.193@KRBTEST.COM for oryx/127.27.243.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:09:20.776918 11695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:20.772225 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:35905 (local address 127.27.243.193:48449)
0811 08:09:20.772388 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:20.772400 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:20.772457 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:20.772657 (+ 200us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:20.772658 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:20.772833 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:09:20.772884 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:20.772886 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:20.773554 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:20.773555 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:20.774106 (+ 551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:20.774109 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:20.774594 (+ 485us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:20.774594 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:20.774632 (+ 38us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:20.775053 (+ 421us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:09:20.775057 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:09:20.776839 (+ 1782us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.243.254:35905: Server oryx/127.27.243.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":73,"threads_started":1}
W20260811 08:09:20.776997 11696 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:09:20.772311 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.193:48449 (local address 127.27.243.254:35905)
0811 08:09:20.772434 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:20.772435 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:20.772445 (+ 10us) server_negotiation.cc:407] Connection header received
0811 08:09:20.772541 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:20.772542 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:20.772554 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:20.772603 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:20.772952 (+ 349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:20.773453 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:20.774209 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:20.774513 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:20.774599 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:20.776936 (+ 2337us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.243.193:48449: BlockingRecv error: recv got EOF from 127.27.243.193:48449 (error 108)
Metrics: {"server-negotiator.queue_time_us":102,"thread_start_us":59,"threads_started":1}
Aug 11 08:09:20 dist-test-slave-7lbf krb5kdc[9971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.243.194@KRBTEST.COM for oryx/127.27.243.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:09:20 dist-test-slave-7lbf krb5kdc[9971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.243.194@KRBTEST.COM for oryx/127.27.243.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:09:20.924418 11697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:20.919679 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:35905 (local address 127.27.243.194:59579)
0811 08:09:20.919885 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:20.919895 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:20.919956 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:20.920081 (+ 125us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:20.920082 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:20.920248 (+ 166us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:09:20.920312 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:20.920314 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:20.920979 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:20.920980 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:20.921555 (+ 575us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:20.921558 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:20.921961 (+ 403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:20.921962 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:20.922017 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:20.922509 (+ 492us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:09:20.922513 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:09:20.924359 (+ 1846us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.243.254:35905: Server oryx/127.27.243.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":79,"threads_started":1}
W20260811 08:09:20.924517 11696 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:09:20.919775 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.194:59579 (local address 127.27.243.254:35905)
0811 08:09:20.919824 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:20.919827 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:20.919947 (+ 120us) server_negotiation.cc:407] Connection header received
0811 08:09:20.920013 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:20.920014 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:20.920026 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:20.920065 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:20.920370 (+ 305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:20.920901 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:20.921652 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:20.921866 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:20.921927 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:20.924457 (+ 2530us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.243.194:59579: BlockingRecv error: recv got EOF from 127.27.243.194:59579 (error 108)
Metrics: {"server-negotiator.queue_time_us":26}
Aug 11 08:09:21 dist-test-slave-7lbf krb5kdc[9971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.243.195@KRBTEST.COM for oryx/127.27.243.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:09:21 dist-test-slave-7lbf krb5kdc[9971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.243.195@KRBTEST.COM for oryx/127.27.243.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:09:21.063603 11698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:21.058872 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:35905 (local address 127.27.243.195:52219)
0811 08:09:21.059061 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:21.059085 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:21.059153 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:21.059344 (+ 191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:21.059346 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:21.059520 (+ 174us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:09:21.059574 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:21.059576 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:21.060209 (+ 633us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:21.060209 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:21.060739 (+ 530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:21.060741 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:21.061039 (+ 298us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:21.061040 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:21.061081 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:21.061632 (+ 551us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:09:21.061637 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:09:21.063542 (+ 1905us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.243.254:35905: Server oryx/127.27.243.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":91,"threads_started":1}
W20260811 08:09:21.063719 11696 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:09:21.058997 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.195:52219 (local address 127.27.243.254:35905)
0811 08:09:21.059052 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:21.059054 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:21.059140 (+ 86us) server_negotiation.cc:407] Connection header received
0811 08:09:21.059231 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:21.059232 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:21.059244 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:21.059303 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:21.059637 (+ 334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:21.060137 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:21.060800 (+ 663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:21.060987 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:21.061032 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:21.063650 (+ 2618us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.243.195:52219: BlockingRecv error: recv got EOF from 127.27.243.195:52219 (error 108)
Metrics: {"server-negotiator.queue_time_us":27}
Aug 11 08:09:21 dist-test-slave-7lbf krb5kdc[9971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.243.193@KRBTEST.COM for oryx/127.27.243.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:09:21 dist-test-slave-7lbf krb5kdc[9971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.243.193@KRBTEST.COM for oryx/127.27.243.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:09:21.782181 11699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:21.777398 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:35905 (local address 127.27.243.193:34815)
0811 08:09:21.777591 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:21.777605 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:21.777671 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:21.777825 (+ 154us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:21.777826 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:21.778007 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:09:21.778059 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:21.778060 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:21.778834 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:21.778836 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:21.779502 (+ 666us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:21.779506 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:21.779865 (+ 359us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:21.779866 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:21.779918 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:21.780343 (+ 425us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:09:21.780348 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:09:21.782120 (+ 1772us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.243.254:35905: Server oryx/127.27.243.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":77,"threads_started":1}
W20260811 08:09:21.782296 11701 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:09:21.777541 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.193:34815 (local address 127.27.243.254:35905)
0811 08:09:21.777678 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:21.777680 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:21.777689 (+ 9us) server_negotiation.cc:407] Connection header received
0811 08:09:21.777727 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:21.777728 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:21.777739 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:21.777788 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:21.778123 (+ 335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:21.778693 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:21.779587 (+ 894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:21.779788 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:21.779842 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:21.782217 (+ 2375us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.243.193:34815: BlockingRecv error: recv got EOF from 127.27.243.193:34815 (error 108)
Metrics: {"server-negotiator.queue_time_us":116,"thread_start_us":70,"threads_started":1}
Aug 11 08:09:21 dist-test-slave-7lbf krb5kdc[9971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.243.194@KRBTEST.COM for oryx/127.27.243.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:09:21 dist-test-slave-7lbf krb5kdc[9971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.243.194@KRBTEST.COM for oryx/127.27.243.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:09:21.929529 11702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:21.924893 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:35905 (local address 127.27.243.194:37485)
0811 08:09:21.925033 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:21.925043 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:21.925105 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:21.925231 (+ 126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:21.925232 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:21.925422 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:09:21.925475 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:21.925477 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:21.926182 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:21.926183 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:21.926790 (+ 607us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:21.926793 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:21.927149 (+ 356us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:21.927150 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:21.927200 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:21.927661 (+ 461us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:09:21.927666 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:09:21.929449 (+ 1783us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.243.254:35905: Server oryx/127.27.243.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":77,"threads_started":1}
W20260811 08:09:21.929637 11701 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:09:21.924972 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.194:37485 (local address 127.27.243.254:35905)
0811 08:09:21.925044 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:21.925046 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:21.925089 (+ 43us) server_negotiation.cc:407] Connection header received
0811 08:09:21.925151 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:21.925152 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:21.925163 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:21.925220 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:21.925556 (+ 336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:21.926083 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:21.926884 (+ 801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:21.927083 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:21.927136 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:21.929576 (+ 2440us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.243.194:37485: BlockingRecv error: recv got EOF from 127.27.243.194:37485 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
Aug 11 08:09:22 dist-test-slave-7lbf krb5kdc[9971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.243.195@KRBTEST.COM for oryx/127.27.243.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:09:22 dist-test-slave-7lbf krb5kdc[9971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.243.195@KRBTEST.COM for oryx/127.27.243.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:09:22.068675 11704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:22.064067 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:35905 (local address 127.27.243.195:50149)
0811 08:09:22.064225 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:22.064236 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:22.064308 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:22.064424 (+ 116us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:22.064424 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:22.064593 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:09:22.064646 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:22.064647 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:22.065262 (+ 615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:22.065263 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:22.065889 (+ 626us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:22.065892 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:22.066260 (+ 368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:22.066261 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:22.066300 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:22.066733 (+ 433us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:09:22.066738 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:09:22.068614 (+ 1876us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.243.254:35905: Server oryx/127.27.243.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":84,"threads_started":1}
W20260811 08:09:22.068784 11701 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:09:22.064158 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.195:50149 (local address 127.27.243.254:35905)
0811 08:09:22.064229 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:22.064231 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:22.064319 (+ 88us) server_negotiation.cc:407] Connection header received
0811 08:09:22.064348 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:22.064348 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:22.064361 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:22.064409 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:22.064694 (+ 285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:22.065179 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:22.065986 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:22.066195 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:22.066252 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:22.068716 (+ 2464us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.243.195:50149: BlockingRecv error: recv got EOF from 127.27.243.195:50149 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
Aug 11 08:09:22 dist-test-slave-7lbf krb5kdc[9971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.243.193@KRBTEST.COM for oryx/127.27.243.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:09:22 dist-test-slave-7lbf krb5kdc[9971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.243.193@KRBTEST.COM for oryx/127.27.243.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:09:22.787881 11705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:22.782687 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:35905 (local address 127.27.243.193:38423)
0811 08:09:22.782832 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:22.782845 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:22.782914 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:22.783083 (+ 169us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:22.783084 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:22.783283 (+ 199us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:09:22.783333 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:22.783336 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:22.784167 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:22.784168 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:22.784707 (+ 539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:22.784709 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:22.785114 (+ 405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:22.785115 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:22.785158 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:22.785691 (+ 533us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:09:22.785697 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:09:22.787800 (+ 2103us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.243.254:35905: Server oryx/127.27.243.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":66,"threads_started":1}
W20260811 08:09:22.788053 11706 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:09:22.782772 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.193:38423 (local address 127.27.243.254:35905)
0811 08:09:22.782952 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:22.782954 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:22.782964 (+ 10us) server_negotiation.cc:407] Connection header received
0811 08:09:22.782988 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:22.782989 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:22.783000 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:22.783072 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:22.783411 (+ 339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:22.784088 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:22.784824 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:22.785044 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:22.785107 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:22.787947 (+ 2840us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.243.193:38423: BlockingRecv error: recv got EOF from 127.27.243.193:38423 (error 108)
Metrics: {"server-negotiator.queue_time_us":151,"thread_start_us":96,"threads_started":1}
Aug 11 08:09:22 dist-test-slave-7lbf krb5kdc[9971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.243.194@KRBTEST.COM for oryx/127.27.243.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:09:22 dist-test-slave-7lbf krb5kdc[9971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.243.194@KRBTEST.COM for oryx/127.27.243.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:09:22.934612 11707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:22.930052 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:35905 (local address 127.27.243.194:34705)
0811 08:09:22.930184 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:22.930201 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:22.930263 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:22.930377 (+ 114us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:22.930377 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:22.930554 (+ 177us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:09:22.930605 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:22.930607 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:22.931218 (+ 611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:22.931219 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:22.931748 (+ 529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:22.931750 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:22.932130 (+ 380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:22.932131 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:22.932180 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:22.932642 (+ 462us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:09:22.932646 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:09:22.934553 (+ 1907us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.243.254:35905: Server oryx/127.27.243.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":58,"threads_started":1}
W20260811 08:09:22.934701 11706 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:09:22.930141 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.194:34705 (local address 127.27.243.254:35905)
0811 08:09:22.930199 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:22.930201 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:22.930255 (+ 54us) server_negotiation.cc:407] Connection header received
0811 08:09:22.930313 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:22.930314 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:22.930325 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:22.930364 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:22.930653 (+ 289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:22.931147 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:22.931843 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:22.932051 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:22.932112 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:22.934639 (+ 2527us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.243.194:34705: BlockingRecv error: recv got EOF from 127.27.243.194:34705 (error 108)
Metrics: {"server-negotiator.queue_time_us":34}
Aug 11 08:09:23 dist-test-slave-7lbf krb5kdc[9971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.243.195@KRBTEST.COM for oryx/127.27.243.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:09:23 dist-test-slave-7lbf krb5kdc[9971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.243.195@KRBTEST.COM for oryx/127.27.243.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:09:23.073647 11709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:23.069200 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:35905 (local address 127.27.243.195:56333)
0811 08:09:23.069363 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:23.069375 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:23.069444 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:23.069602 (+ 158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:23.069603 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:23.069777 (+ 174us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:09:23.069827 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:23.069829 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:23.070501 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:23.070503 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:23.071080 (+ 577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:23.071082 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:23.071384 (+ 302us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:23.071384 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:23.071422 (+ 38us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:23.071854 (+ 432us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:09:23.071858 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:09:23.073559 (+ 1701us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.243.254:35905: Server oryx/127.27.243.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":74,"threads_started":1}
W20260811 08:09:23.073698 11706 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:09:23.069305 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.195:56333 (local address 127.27.243.254:35905)
0811 08:09:23.069365 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:23.069367 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:23.069434 (+ 67us) server_negotiation.cc:407] Connection header received
0811 08:09:23.069487 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:23.069487 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:23.069500 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:23.069561 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:23.069919 (+ 358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:23.070421 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:23.071148 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:23.071331 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:23.071379 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:23.073644 (+ 2265us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.243.195:56333: BlockingRecv error: recv got EOF from 127.27.243.195:56333 (error 108)
Metrics: {"server-negotiator.queue_time_us":34}
Aug 11 08:09:23 dist-test-slave-7lbf krb5kdc[9971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.243.193@KRBTEST.COM for oryx/127.27.243.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:09:23 dist-test-slave-7lbf krb5kdc[9971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.243.193@KRBTEST.COM for oryx/127.27.243.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:09:23.795943 11711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:23.788333 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:35905 (local address 127.27.243.193:49335)
0811 08:09:23.788498 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:23.788508 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:23.788577 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:23.788723 (+ 146us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:23.788724 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:23.788911 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:09:23.788964 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:23.788966 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:23.789634 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:23.789635 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:23.790169 (+ 534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:23.790171 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:23.790577 (+ 406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:23.790579 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:23.790636 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:23.793809 (+ 3173us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:09:23.793814 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:09:23.795876 (+ 2062us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.243.254:35905: Server oryx/127.27.243.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":101,"threads_started":1}
W20260811 08:09:23.796072 11713 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:09:23.788416 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.193:49335 (local address 127.27.243.254:35905)
0811 08:09:23.788522 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:23.788524 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:23.788570 (+ 46us) server_negotiation.cc:407] Connection header received
0811 08:09:23.788637 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:23.788638 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:23.788651 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:23.788697 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:23.789024 (+ 327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:23.789572 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:23.790248 (+ 676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:23.790460 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:23.790529 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:23.795987 (+ 5458us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.243.193:49335: BlockingRecv error: recv got EOF from 127.27.243.193:49335 (error 108)
Metrics: {"server-negotiator.queue_time_us":88,"thread_start_us":54,"threads_started":1}
Aug 11 08:09:23 dist-test-slave-7lbf krb5kdc[9971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.243.194@KRBTEST.COM for oryx/127.27.243.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:09:23 dist-test-slave-7lbf krb5kdc[9971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.243.194@KRBTEST.COM for oryx/127.27.243.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:09:23.939905 11714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:23.935044 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:35905 (local address 127.27.243.194:33699)
0811 08:09:23.935205 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:23.935219 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:23.935287 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:23.935426 (+ 139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:23.935427 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:23.935610 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:09:23.935661 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:23.935662 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:23.936351 (+ 689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:23.936352 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:23.936878 (+ 526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:23.936879 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:23.937208 (+ 329us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:23.937208 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:23.937262 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:23.937840 (+ 578us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:09:23.937845 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:09:23.939832 (+ 1987us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.243.254:35905: Server oryx/127.27.243.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":62,"threads_started":1}
W20260811 08:09:23.940039 11713 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:09:23.935183 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.194:33699 (local address 127.27.243.254:35905)
0811 08:09:23.935242 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:23.935244 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:23.935266 (+ 22us) server_negotiation.cc:407] Connection header received
0811 08:09:23.935347 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:23.935348 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:23.935361 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:23.935415 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:23.935737 (+ 322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:23.936265 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:23.936956 (+ 691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:23.937147 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:23.937203 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:23.939976 (+ 2773us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.243.194:33699: BlockingRecv error: recv got EOF from 127.27.243.194:33699 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
Aug 11 08:09:24 dist-test-slave-7lbf krb5kdc[9971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.243.195@KRBTEST.COM for oryx/127.27.243.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:09:24 dist-test-slave-7lbf krb5kdc[9971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.243.195@KRBTEST.COM for oryx/127.27.243.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:09:24.078670 11718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:24.074102 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:35905 (local address 127.27.243.195:55543)
0811 08:09:24.074244 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:24.074255 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:24.074312 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:24.074423 (+ 111us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:24.074424 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:24.074596 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:09:24.074648 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:24.074650 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:24.075328 (+ 678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:24.075328 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:24.075887 (+ 559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:24.075888 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:24.076241 (+ 353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:24.076243 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:24.076299 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:24.076772 (+ 473us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:09:24.076777 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:09:24.078611 (+ 1834us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.243.254:35905: Server oryx/127.27.243.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":93,"threads_started":1}
W20260811 08:09:24.078853 11713 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:09:24.074160 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.195:55543 (local address 127.27.243.254:35905)
0811 08:09:24.074213 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:24.074215 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:24.074310 (+ 95us) server_negotiation.cc:407] Connection header received
0811 08:09:24.074352 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:24.074353 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:24.074368 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:24.074417 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:24.074744 (+ 327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:24.075263 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:24.075960 (+ 697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:24.076157 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:24.076207 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:24.078732 (+ 2525us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.243.195:55543: BlockingRecv error: recv got EOF from 127.27.243.195:55543 (error 108)
Metrics: {"server-negotiator.queue_time_us":28}
Aug 11 08:09:24 dist-test-slave-7lbf krb5kdc[9971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.243.193@KRBTEST.COM for oryx/127.27.243.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:09:24 dist-test-slave-7lbf krb5kdc[9971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.243.193@KRBTEST.COM for oryx/127.27.243.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:09:24.802384 11723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:24.796403 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:35905 (local address 127.27.243.193:36063)
0811 08:09:24.796525 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:24.796536 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:24.796592 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:24.796746 (+ 154us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:24.796747 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:24.796974 (+ 227us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:09:24.797034 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:24.797036 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:24.798044 (+ 1008us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:24.798046 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:24.799105 (+ 1059us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:24.799110 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:24.799751 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:24.799752 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:24.799815 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:24.800334 (+ 519us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:09:24.800340 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:09:24.802286 (+ 1946us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.243.254:35905: Server oryx/127.27.243.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":85,"thread_start_us":58,"threads_started":1}
W20260811 08:09:24.802457 11725 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:09:24.796450 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.193:36063 (local address 127.27.243.254:35905)
0811 08:09:24.796580 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:24.796582 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:24.796592 (+ 10us) server_negotiation.cc:407] Connection header received
0811 08:09:24.796665 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:24.796666 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:24.796679 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:24.796740 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:24.797118 (+ 378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:24.797938 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:24.799216 (+ 1278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:24.799615 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:24.799681 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:24.802383 (+ 2702us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.243.193:36063: BlockingRecv error: recv got EOF from 127.27.243.193:36063 (error 108)
Metrics: {"server-negotiator.queue_time_us":108,"thread_start_us":67,"threads_started":1}
Aug 11 08:09:24 dist-test-slave-7lbf krb5kdc[9971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.243.194@KRBTEST.COM for oryx/127.27.243.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:09:24 dist-test-slave-7lbf krb5kdc[9971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.243.194@KRBTEST.COM for oryx/127.27.243.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:09:24.945201 11726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:24.940421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:35905 (local address 127.27.243.194:58719)
0811 08:09:24.940561 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:24.940571 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:24.940630 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:24.940776 (+ 146us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:24.940777 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:24.940960 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:09:24.941014 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:24.941016 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:24.941780 (+ 764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:24.941782 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:24.942451 (+ 669us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:24.942455 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:24.942852 (+ 397us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:24.942853 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:24.942898 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:24.943293 (+ 395us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:09:24.943296 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:09:24.945138 (+ 1842us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.243.254:35905: Server oryx/127.27.243.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":71,"threads_started":1}
W20260811 08:09:24.945286 11725 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:09:24.940505 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.194:58719 (local address 127.27.243.254:35905)
0811 08:09:24.940570 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:24.940572 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:24.940627 (+ 55us) server_negotiation.cc:407] Connection header received
0811 08:09:24.940675 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:24.940676 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:24.940687 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:24.940745 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:24.941105 (+ 360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:24.941706 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:24.942530 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:24.942790 (+ 260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:24.942839 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:24.945227 (+ 2388us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.243.194:58719: BlockingRecv error: recv got EOF from 127.27.243.194:58719 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
Aug 11 08:09:25 dist-test-slave-7lbf krb5kdc[9971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.243.195@KRBTEST.COM for oryx/127.27.243.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:09:25 dist-test-slave-7lbf krb5kdc[9971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.243.195@KRBTEST.COM for oryx/127.27.243.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:09:25.083774 11728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:25.079157 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:35905 (local address 127.27.243.195:45219)
0811 08:09:25.079305 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:25.079321 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:25.079389 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:25.079506 (+ 117us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:25.079507 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:25.079668 (+ 161us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:09:25.079720 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:25.079721 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:25.080321 (+ 600us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:25.080322 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:25.080859 (+ 537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:25.080861 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:25.081239 (+ 378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:25.081240 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:25.081294 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:25.081815 (+ 521us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:09:25.081821 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:09:25.083715 (+ 1894us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.243.254:35905: Server oryx/127.27.243.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":76,"threads_started":1}
W20260811 08:09:25.083871 11725 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:09:25.079249 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.195:45219 (local address 127.27.243.254:35905)
0811 08:09:25.079329 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:25.079331 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:25.079380 (+ 49us) server_negotiation.cc:407] Connection header received
0811 08:09:25.079432 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:25.079433 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:25.079445 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:25.079495 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:25.079766 (+ 271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:25.080253 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:25.080946 (+ 693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:25.081144 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:25.081208 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:25.083805 (+ 2597us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.243.195:45219: BlockingRecv error: recv got EOF from 127.27.243.195:45219 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
Aug 11 08:09:25 dist-test-slave-7lbf krb5kdc[9971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.243.193@KRBTEST.COM for oryx/127.27.243.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:09:25 dist-test-slave-7lbf krb5kdc[9971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.243.193@KRBTEST.COM for oryx/127.27.243.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:09:25.807524 11729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:25.802920 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:35905 (local address 127.27.243.193:55855)
0811 08:09:25.803080 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:25.803091 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:25.803143 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:25.803369 (+ 226us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:25.803370 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:25.803542 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:09:25.803594 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:25.803596 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:25.804310 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:25.804312 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:25.804870 (+ 558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:25.804873 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:25.805190 (+ 317us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:25.805190 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:25.805227 (+ 37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:25.805687 (+ 460us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:09:25.805692 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:09:25.807463 (+ 1771us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.243.254:35905: Server oryx/127.27.243.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":96,"threads_started":1}
W20260811 08:09:25.807700 11731 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:09:25.803038 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.193:55855 (local address 127.27.243.254:35905)
0811 08:09:25.803186 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:25.803188 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:25.803197 (+ 9us) server_negotiation.cc:407] Connection header received
0811 08:09:25.803221 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:25.803222 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:25.803233 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:25.803306 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:25.803685 (+ 379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:25.804230 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:25.804939 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:25.805133 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:25.805185 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:25.807620 (+ 2435us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.243.193:55855: BlockingRecv error: recv got EOF from 127.27.243.193:55855 (error 108)
Metrics: {"server-negotiator.queue_time_us":128,"thread_start_us":71,"threads_started":1}
Aug 11 08:09:25 dist-test-slave-7lbf krb5kdc[9971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.243.194@KRBTEST.COM for oryx/127.27.243.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:09:25 dist-test-slave-7lbf krb5kdc[9971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.243.194@KRBTEST.COM for oryx/127.27.243.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:09:25.950286 11737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:25.945699 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:35905 (local address 127.27.243.194:45207)
0811 08:09:25.945829 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:25.945839 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:25.945898 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:25.946060 (+ 162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:25.946062 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:25.946300 (+ 238us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:09:25.946365 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:25.946368 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:25.947071 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:25.947073 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:25.947618 (+ 545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:25.947620 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:25.947974 (+ 354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:25.947975 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:25.948014 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:25.948440 (+ 426us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:09:25.948445 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:09:25.950224 (+ 1779us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.243.254:35905: Server oryx/127.27.243.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":61,"threads_started":1}
W20260811 08:09:25.950400 11731 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:09:25.945839 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.194:45207 (local address 127.27.243.254:35905)
0811 08:09:25.945912 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:25.945915 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:25.945923 (+ 8us) server_negotiation.cc:407] Connection header received
0811 08:09:25.945950 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:25.945951 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:25.945964 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:25.946020 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:25.946447 (+ 427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:25.946995 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:25.947694 (+ 699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:25.947918 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:25.947967 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:25.950336 (+ 2369us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.243.194:45207: BlockingRecv error: recv got EOF from 127.27.243.194:45207 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
Aug 11 08:09:26 dist-test-slave-7lbf krb5kdc[9971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.243.195@KRBTEST.COM for oryx/127.27.243.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:09:26 dist-test-slave-7lbf krb5kdc[9971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.243.195@KRBTEST.COM for oryx/127.27.243.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:09:26.088742 11738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:26.084239 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:35905 (local address 127.27.243.195:58839)
0811 08:09:26.084367 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:26.084377 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:26.084436 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:26.084559 (+ 123us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:26.084560 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:26.084720 (+ 160us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:09:26.084771 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:26.084773 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:26.085559 (+ 786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:26.085560 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:26.086148 (+ 588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:26.086151 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:26.086479 (+ 328us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:26.086479 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:26.086552 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:26.087015 (+ 463us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:09:26.087021 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:09:26.088682 (+ 1661us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.243.254:35905: Server oryx/127.27.243.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":58,"threads_started":1}
W20260811 08:09:26.088845 11731 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:09:26.084323 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.195:58839 (local address 127.27.243.254:35905)
0811 08:09:26.084374 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:26.084376 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:26.084429 (+ 53us) server_negotiation.cc:407] Connection header received
0811 08:09:26.084479 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:26.084480 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:26.084493 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:26.084547 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:26.084820 (+ 273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:26.085467 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:26.086217 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:26.086418 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:26.086472 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:26.088782 (+ 2310us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.243.195:58839: BlockingRecv error: recv got EOF from 127.27.243.195:58839 (error 108)
Metrics: {"server-negotiator.queue_time_us":29}
Aug 11 08:09:26 dist-test-slave-7lbf krb5kdc[9971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.243.193@KRBTEST.COM for oryx/127.27.243.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:09:26 dist-test-slave-7lbf krb5kdc[9971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.243.193@KRBTEST.COM for oryx/127.27.243.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:09:26.812549 11739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:26.808008 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:35905 (local address 127.27.243.193:38519)
0811 08:09:26.808151 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:26.808164 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:26.808229 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:26.808394 (+ 165us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:26.808394 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:26.808570 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:09:26.808636 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:26.808639 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:26.809285 (+ 646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:26.809286 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:26.809856 (+ 570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:26.809858 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:26.810205 (+ 347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:26.810206 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:26.810257 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:26.810721 (+ 464us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:09:26.810730 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:09:26.812482 (+ 1752us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.243.254:35905: Server oryx/127.27.243.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":72,"threads_started":1}
W20260811 08:09:26.812666 11741 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:09:26.808115 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.193:38519 (local address 127.27.243.254:35905)
0811 08:09:26.808263 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:26.808265 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:26.808273 (+ 8us) server_negotiation.cc:407] Connection header received
0811 08:09:26.808296 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:26.808296 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:26.808307 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:26.808386 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:26.808692 (+ 306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:26.809217 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:26.809929 (+ 712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:26.810134 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:26.810189 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:26.812587 (+ 2398us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.243.193:38519: BlockingRecv error: recv got EOF from 127.27.243.193:38519 (error 108)
Metrics: {"server-negotiator.queue_time_us":127,"thread_start_us":93,"threads_started":1}
Aug 11 08:09:26 dist-test-slave-7lbf krb5kdc[9971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.243.194@KRBTEST.COM for oryx/127.27.243.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:09:26 dist-test-slave-7lbf krb5kdc[9971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.243.194@KRBTEST.COM for oryx/127.27.243.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:09:26.955715 11743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:26.950847 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:35905 (local address 127.27.243.194:50689)
0811 08:09:26.950993 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:26.951005 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:26.951074 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:26.951209 (+ 135us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:26.951210 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:26.951403 (+ 193us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:09:26.951459 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:26.951461 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:26.952217 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:26.952218 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:26.952768 (+ 550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:26.952770 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:26.953115 (+ 345us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:26.953116 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:26.953156 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:26.953628 (+ 472us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:09:26.953633 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:09:26.955620 (+ 1987us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.243.254:35905: Server oryx/127.27.243.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":76,"threads_started":1}
W20260811 08:09:26.955785 11741 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:09:26.950939 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.194:50689 (local address 127.27.243.254:35905)
0811 08:09:26.951004 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:26.951006 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:26.951063 (+ 57us) server_negotiation.cc:407] Connection header received
0811 08:09:26.951125 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:26.951125 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:26.951139 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:26.951191 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:26.951514 (+ 323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:26.952148 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:26.952864 (+ 716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:26.953057 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:26.953104 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:26.955731 (+ 2627us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.243.194:50689: BlockingRecv error: recv got EOF from 127.27.243.194:50689 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
Aug 11 08:09:27 dist-test-slave-7lbf krb5kdc[9971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.243.195@KRBTEST.COM for oryx/127.27.243.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:09:27 dist-test-slave-7lbf krb5kdc[9971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.243.195@KRBTEST.COM for oryx/127.27.243.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:09:27.093958 11744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:27.089267 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:35905 (local address 127.27.243.195:57543)
0811 08:09:27.089439 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:27.089451 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:27.089509 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:27.089657 (+ 148us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:27.089658 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:27.089855 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:09:27.089907 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:27.089909 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:27.090572 (+ 663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:27.090573 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:27.091140 (+ 567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:27.091142 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:27.091519 (+ 377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:27.091520 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:27.091570 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:27.092000 (+ 430us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:09:27.092005 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:09:27.093885 (+ 1880us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.243.254:35905: Server oryx/127.27.243.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":113,"threads_started":1}
W20260811 08:09:27.094180 11741 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:09:27.089338 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.195:57543 (local address 127.27.243.254:35905)
0811 08:09:27.089415 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:27.089417 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:27.089503 (+ 86us) server_negotiation.cc:407] Connection header received
0811 08:09:27.089572 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:27.089573 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:27.089587 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:27.089638 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:27.089970 (+ 332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:27.090480 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:27.091221 (+ 741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:27.091430 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:27.091484 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:27.094018 (+ 2534us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.243.195:57543: BlockingRecv error: recv got EOF from 127.27.243.195:57543 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
Aug 11 08:09:27 dist-test-slave-7lbf krb5kdc[9971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.243.193@KRBTEST.COM for oryx/127.27.243.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:09:27 dist-test-slave-7lbf krb5kdc[9971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.243.193@KRBTEST.COM for oryx/127.27.243.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:09:27.817847 11745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:27.813026 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:35905 (local address 127.27.243.193:32913)
0811 08:09:27.813178 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:27.813190 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:27.813250 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:27.813428 (+ 178us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:27.813429 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:27.813664 (+ 235us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:09:27.813729 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:27.813732 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:27.814520 (+ 788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:27.814520 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:27.815103 (+ 583us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:27.815106 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:27.815464 (+ 358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:27.815465 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:27.815512 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:27.815930 (+ 418us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:09:27.815934 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:09:27.817754 (+ 1820us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.243.254:35905: Server oryx/127.27.243.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":65,"threads_started":1}
W20260811 08:09:27.817924 11746 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:09:27.813138 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.193:32913 (local address 127.27.243.254:35905)
0811 08:09:27.813248 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:27.813250 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:27.813259 (+ 9us) server_negotiation.cc:407] Connection header received
0811 08:09:27.813306 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:27.813307 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:27.813317 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:27.813387 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:27.813794 (+ 407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:27.814448 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:27.815190 (+ 742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:27.815394 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:27.815453 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:27.817862 (+ 2409us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.243.193:32913: BlockingRecv error: recv got EOF from 127.27.243.193:32913 (error 108)
Metrics: {"server-negotiator.queue_time_us":91,"thread_start_us":49,"threads_started":1}
Aug 11 08:09:27 dist-test-slave-7lbf krb5kdc[9971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.243.194@KRBTEST.COM for oryx/127.27.243.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:09:27 dist-test-slave-7lbf krb5kdc[9971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.243.194@KRBTEST.COM for oryx/127.27.243.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:09:27.961047 11749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:27.956239 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:35905 (local address 127.27.243.194:40639)
0811 08:09:27.956425 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:27.956437 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:27.956504 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:27.956634 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:27.956635 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:27.956870 (+ 235us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:09:27.956926 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:27.956928 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:27.957649 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:27.957650 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:27.958186 (+ 536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:27.958188 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:27.958536 (+ 348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:27.958537 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:27.958595 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:27.959041 (+ 446us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:09:27.959046 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:09:27.960936 (+ 1890us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.243.254:35905: Server oryx/127.27.243.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":103,"threads_started":1}
W20260811 08:09:27.961100 11746 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:09:27.956369 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.194:40639 (local address 127.27.243.254:35905)
0811 08:09:27.956429 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:27.956431 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:27.956500 (+ 69us) server_negotiation.cc:407] Connection header received
0811 08:09:27.956561 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:27.956562 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:27.956574 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:27.956617 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:27.957022 (+ 405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:27.957578 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:27.958265 (+ 687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:27.958473 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:27.958528 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:27.961045 (+ 2517us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.243.194:40639: BlockingRecv error: recv got EOF from 127.27.243.194:40639 (error 108)
Metrics: {"server-negotiator.queue_time_us":28}
Aug 11 08:09:28 dist-test-slave-7lbf krb5kdc[9971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.243.195@KRBTEST.COM for oryx/127.27.243.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:09:28 dist-test-slave-7lbf krb5kdc[9971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.243.195@KRBTEST.COM for oryx/127.27.243.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:09:28.099104 11752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:28.094451 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:35905 (local address 127.27.243.195:42923)
0811 08:09:28.094626 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:28.094639 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:28.094711 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:28.094838 (+ 127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:28.094839 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:28.095030 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:09:28.095081 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:28.095084 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:28.095742 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:28.095743 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:28.096312 (+ 569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:28.096314 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:28.096665 (+ 351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:28.096666 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:28.096728 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:28.097176 (+ 448us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:09:28.097181 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:09:28.099037 (+ 1856us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.243.254:35905: Server oryx/127.27.243.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":86,"threads_started":1}
W20260811 08:09:28.099193 11746 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:09:28.094548 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.195:42923 (local address 127.27.243.254:35905)
0811 08:09:28.094631 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:28.094633 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:28.094699 (+ 66us) server_negotiation.cc:407] Connection header received
0811 08:09:28.094761 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:28.094762 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:28.094777 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:28.094827 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:28.095156 (+ 329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:28.095667 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:28.096415 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:28.096601 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:28.096658 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:28.099129 (+ 2471us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.243.195:42923: BlockingRecv error: recv got EOF from 127.27.243.195:42923 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
Aug 11 08:09:28 dist-test-slave-7lbf krb5kdc[9971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.243.193@KRBTEST.COM for oryx/127.27.243.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:09:28 dist-test-slave-7lbf krb5kdc[9971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.243.193@KRBTEST.COM for oryx/127.27.243.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:09:28.826386 11756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:28.818269 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:35905 (local address 127.27.243.193:36485)
0811 08:09:28.818417 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:28.818430 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:28.818493 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:28.818624 (+ 131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:28.818625 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:28.818805 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:09:28.818857 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:28.818858 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:28.819477 (+ 619us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:28.819478 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:28.820074 (+ 596us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:28.820077 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:28.820373 (+ 296us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:28.820373 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:28.820409 (+ 36us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:28.824318 (+ 3909us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:09:28.824324 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:09:28.826317 (+ 1993us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.243.254:35905: Server oryx/127.27.243.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":72,"threads_started":1}
W20260811 08:09:28.826496 11758 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:09:28.818337 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.193:36485 (local address 127.27.243.254:35905)
0811 08:09:28.818463 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:28.818465 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:28.818480 (+ 15us) server_negotiation.cc:407] Connection header received
0811 08:09:28.818544 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:28.818544 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:28.818555 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:28.818613 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:28.818905 (+ 292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:28.819411 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:28.820137 (+ 726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:28.820324 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:28.820368 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:28.826420 (+ 6052us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.243.193:36485: BlockingRecv error: recv got EOF from 127.27.243.193:36485 (error 108)
Metrics: {"server-negotiator.queue_time_us":106,"thread_start_us":72,"threads_started":1}
Aug 11 08:09:28 dist-test-slave-7lbf krb5kdc[9971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.243.194@KRBTEST.COM for oryx/127.27.243.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:09:28 dist-test-slave-7lbf krb5kdc[9971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.243.194@KRBTEST.COM for oryx/127.27.243.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:09:28.966125 11759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:28.961545 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:35905 (local address 127.27.243.194:48201)
0811 08:09:28.961702 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:28.961711 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:28.961762 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:28.961928 (+ 166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:28.961928 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:28.962097 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:09:28.962148 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:28.962149 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:28.962814 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:28.962815 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:28.963396 (+ 581us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:28.963399 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:28.963745 (+ 346us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:28.963746 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:28.963810 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:28.964256 (+ 446us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:09:28.964261 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:09:28.966063 (+ 1802us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.243.254:35905: Server oryx/127.27.243.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":91,"threads_started":1}
W20260811 08:09:28.966259 11758 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:09:28.961606 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.194:48201 (local address 127.27.243.254:35905)
0811 08:09:28.961653 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:28.961655 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:28.961747 (+ 92us) server_negotiation.cc:407] Connection header received
0811 08:09:28.961857 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:28.961858 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:28.961870 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:28.961920 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:28.962209 (+ 289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:28.962755 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:28.963466 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:28.963662 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:28.963712 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:28.966188 (+ 2476us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.243.194:48201: BlockingRecv error: recv got EOF from 127.27.243.194:48201 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
Aug 11 08:09:29 dist-test-slave-7lbf krb5kdc[9971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.243.195@KRBTEST.COM for oryx/127.27.243.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:09:29 dist-test-slave-7lbf krb5kdc[9971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.243.195@KRBTEST.COM for oryx/127.27.243.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:09:29.104247 11760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:29.099576 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:35905 (local address 127.27.243.195:54245)
0811 08:09:29.099743 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:29.099757 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:29.099833 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:29.100006 (+ 173us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:29.100007 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:29.100191 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:09:29.100240 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:29.100242 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:29.100899 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:29.100900 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:29.101444 (+ 544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:29.101446 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:29.101800 (+ 354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:29.101801 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:29.101862 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:29.102323 (+ 461us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:09:29.102328 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:09:29.104178 (+ 1850us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.243.254:35905: Server oryx/127.27.243.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":62,"threads_started":1}
W20260811 08:09:29.104338 11758 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:09:29.099712 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.195:54245 (local address 127.27.243.254:35905)
0811 08:09:29.099767 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:29.099769 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:29.099811 (+ 42us) server_negotiation.cc:407] Connection header received
0811 08:09:29.099891 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:29.099892 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:29.099934 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:29.099984 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:29.100313 (+ 329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:29.100817 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:29.101541 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:29.101736 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:29.101792 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:29.104273 (+ 2481us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.243.195:54245: BlockingRecv error: recv got EOF from 127.27.243.195:54245 (error 108)
Metrics: {"server-negotiator.queue_time_us":33}
Aug 11 08:09:29 dist-test-slave-7lbf krb5kdc[9971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.243.193@KRBTEST.COM for oryx/127.27.243.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:09:29 dist-test-slave-7lbf krb5kdc[9971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.243.193@KRBTEST.COM for oryx/127.27.243.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:09:29.831545 11761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:29.826908 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:35905 (local address 127.27.243.193:49755)
0811 08:09:29.827058 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:29.827071 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:29.827132 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:29.827300 (+ 168us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:29.827301 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:29.827492 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:09:29.827546 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:29.827548 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:29.828182 (+ 634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:29.828182 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:29.828730 (+ 548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:29.828732 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:29.829137 (+ 405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:29.829138 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:29.829210 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:29.829697 (+ 487us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:09:29.829703 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:09:29.831474 (+ 1771us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.243.254:35905: Server oryx/127.27.243.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":68,"threads_started":1}
W20260811 08:09:29.831650 11762 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:09:29.826972 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.193:49755 (local address 127.27.243.254:35905)
0811 08:09:29.827102 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:29.827103 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:29.827116 (+ 13us) server_negotiation.cc:407] Connection header received
0811 08:09:29.827202 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:29.827203 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:29.827217 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:29.827281 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:29.827602 (+ 321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:29.828123 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:29.828792 (+ 669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:29.829059 (+ 267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:29.829118 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:29.831574 (+ 2456us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.243.193:49755: BlockingRecv error: recv got EOF from 127.27.243.193:49755 (error 108)
Metrics: {"server-negotiator.queue_time_us":107,"thread_start_us":71,"threads_started":1}
Aug 11 08:09:29 dist-test-slave-7lbf krb5kdc[9971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.243.194@KRBTEST.COM for oryx/127.27.243.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:09:29 dist-test-slave-7lbf krb5kdc[9971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.243.194@KRBTEST.COM for oryx/127.27.243.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:09:29.971227 11763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:29.966615 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:35905 (local address 127.27.243.194:45437)
0811 08:09:29.966771 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:29.966783 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:29.966863 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:29.967021 (+ 158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:29.967022 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:29.967200 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:09:29.967254 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:29.967255 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:29.967941 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:29.967943 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:29.968514 (+ 571us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:29.968517 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:29.968902 (+ 385us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:29.968903 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:29.968961 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:29.969401 (+ 440us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:09:29.969405 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:09:29.971138 (+ 1733us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.243.254:35905: Server oryx/127.27.243.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":75,"threads_started":1}
W20260811 08:09:29.971328 11762 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:09:29.966699 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.194:45437 (local address 127.27.243.254:35905)
0811 08:09:29.966755 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:29.966758 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:29.966870 (+ 112us) server_negotiation.cc:407] Connection header received
0811 08:09:29.966931 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:29.966932 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:29.966945 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:29.967003 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:29.967305 (+ 302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:29.967870 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:29.968605 (+ 735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:29.968833 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:29.968892 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:29.971253 (+ 2361us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.243.194:45437: BlockingRecv error: recv got EOF from 127.27.243.194:45437 (error 108)
Metrics: {"server-negotiator.queue_time_us":27}
Aug 11 08:09:30 dist-test-slave-7lbf krb5kdc[9971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.243.195@KRBTEST.COM for oryx/127.27.243.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:09:30 dist-test-slave-7lbf krb5kdc[9971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.243.195@KRBTEST.COM for oryx/127.27.243.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:09:30.109617 11765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:30.104754 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:35905 (local address 127.27.243.195:45333)
0811 08:09:30.104891 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:30.104901 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:30.104957 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:30.105172 (+ 215us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:30.105173 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:30.105354 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:09:30.105408 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:30.105410 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:30.106155 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:30.106156 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:30.106705 (+ 549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:30.106706 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:30.107106 (+ 400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:30.107108 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:30.107164 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:30.107702 (+ 538us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:09:30.107708 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:09:30.109508 (+ 1800us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.243.254:35905: Server oryx/127.27.243.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":62,"threads_started":1}
W20260811 08:09:30.109676 11762 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:09:30.104918 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.195:45333 (local address 127.27.243.254:35905)
0811 08:09:30.104979 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:30.104981 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:30.104992 (+ 11us) server_negotiation.cc:407] Connection header received
0811 08:09:30.105019 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:30.105020 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:30.105034 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:30.105114 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:30.105495 (+ 381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:30.106074 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:30.106817 (+ 743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:30.107018 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:30.107105 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:30.109625 (+ 2520us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.243.195:45333: BlockingRecv error: recv got EOF from 127.27.243.195:45333 (error 108)
Metrics: {"server-negotiator.queue_time_us":34}
Aug 11 08:09:30 dist-test-slave-7lbf krb5kdc[9971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.243.193@KRBTEST.COM for oryx/127.27.243.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:09:30 dist-test-slave-7lbf krb5kdc[9971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.243.193@KRBTEST.COM for oryx/127.27.243.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:09:30.836628 11767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:30.831996 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:35905 (local address 127.27.243.193:39945)
0811 08:09:30.832131 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:30.832141 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:30.832193 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:30.832332 (+ 139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:30.832333 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:30.832542 (+ 209us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:09:30.832595 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:30.832598 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:30.833361 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:30.833362 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:30.833932 (+ 570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:30.833935 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:30.834274 (+ 339us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:30.834274 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:30.834315 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:30.834776 (+ 461us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:09:30.834781 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:09:30.836549 (+ 1768us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.243.254:35905: Server oryx/127.27.243.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":61,"threads_started":1}
W20260811 08:09:30.836714 11768 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:09:30.832062 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.193:39945 (local address 127.27.243.254:35905)
0811 08:09:30.832182 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:30.832184 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:30.832193 (+ 9us) server_negotiation.cc:407] Connection header received
0811 08:09:30.832253 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:30.832253 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:30.832265 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:30.832321 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:30.832656 (+ 335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:30.833293 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:30.834011 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:30.834216 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:30.834270 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:30.836652 (+ 2382us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.243.193:39945: BlockingRecv error: recv got EOF from 127.27.243.193:39945 (error 108)
Metrics: {"server-negotiator.queue_time_us":99,"thread_start_us":59,"threads_started":1}
Aug 11 08:09:30 dist-test-slave-7lbf krb5kdc[9971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.243.194@KRBTEST.COM for oryx/127.27.243.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:09:30 dist-test-slave-7lbf krb5kdc[9971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.243.194@KRBTEST.COM for oryx/127.27.243.254@KRBTEST.COM, Server not found in Kerberos database
W20260811 08:09:30.976359 11768 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:09:30.971811 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.194:35235 (local address 127.27.243.254:35905)
0811 08:09:30.971865 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:30.971868 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:30.971926 (+ 58us) server_negotiation.cc:407] Connection header received
0811 08:09:30.972001 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:30.972002 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:30.972015 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:30.972082 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:30.972441 (+ 359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:30.973023 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:30.973733 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:30.973938 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:30.973992 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:30.976296 (+ 2304us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.243.194:35235: BlockingRecv error: recv got EOF from 127.27.243.194:35235 (error 108)
Metrics: {"server-negotiator.queue_time_us":32}
I20260811 08:09:30.977104 11769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:30.971718 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:35905 (local address 127.27.243.194:35235)
0811 08:09:30.971862 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:30.971874 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:30.971948 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:30.972103 (+ 155us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:30.972105 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:30.972304 (+ 199us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:09:30.972365 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:30.972367 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:30.973090 (+ 723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:30.973091 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:30.973671 (+ 580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:30.973673 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:30.974028 (+ 355us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:30.974029 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:30.974081 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:30.974500 (+ 419us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:09:30.974505 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:09:30.976177 (+ 1672us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.243.254:35905: Server oryx/127.27.243.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":70,"threads_started":1}
Aug 11 08:09:31 dist-test-slave-7lbf krb5kdc[9971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.243.195@KRBTEST.COM for oryx/127.27.243.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:09:31 dist-test-slave-7lbf krb5kdc[9971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.243.195@KRBTEST.COM for oryx/127.27.243.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:09:31.114827 11770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:31.110070 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:35905 (local address 127.27.243.195:34723)
0811 08:09:31.110220 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:31.110230 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:31.110293 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:31.110431 (+ 138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:31.110431 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:31.110615 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:09:31.110669 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:31.110671 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:31.111377 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:31.111378 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:31.111968 (+ 590us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:31.111971 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:31.112304 (+ 333us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:31.112305 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:31.112342 (+ 37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:31.112764 (+ 422us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:09:31.112769 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:09:31.114727 (+ 1958us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.243.254:35905: Server oryx/127.27.243.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":80,"threads_started":1}
W20260811 08:09:31.114884 11768 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:09:31.110179 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.195:34723 (local address 127.27.243.254:35905)
0811 08:09:31.110232 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:31.110233 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:31.110285 (+ 52us) server_negotiation.cc:407] Connection header received
0811 08:09:31.110360 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:31.110361 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:31.110375 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:31.110418 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:31.110757 (+ 339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:31.111288 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:31.112050 (+ 762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:31.112243 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:31.112302 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:31.114819 (+ 2517us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.243.195:34723: BlockingRecv error: recv got EOF from 127.27.243.195:34723 (error 108)
Metrics: {"server-negotiator.queue_time_us":28}
Aug 11 08:09:31 dist-test-slave-7lbf krb5kdc[9971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.243.193@KRBTEST.COM for oryx/127.27.243.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:09:31 dist-test-slave-7lbf krb5kdc[9971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.243.193@KRBTEST.COM for oryx/127.27.243.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:09:31.842028 11771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:31.837156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:35905 (local address 127.27.243.193:49535)
0811 08:09:31.837320 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:31.837332 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:31.837391 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:31.837535 (+ 144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:31.837535 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:31.837715 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:09:31.837764 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:31.837766 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:31.838629 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:31.838631 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:31.839224 (+ 593us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:31.839226 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:31.839580 (+ 354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:31.839580 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:31.839621 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:31.840098 (+ 477us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:09:31.840103 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:09:31.841951 (+ 1848us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.243.254:35905: Server oryx/127.27.243.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":79,"threads_started":1}
W20260811 08:09:31.842108 11772 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:09:31.837274 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.193:49535 (local address 127.27.243.254:35905)
0811 08:09:31.837398 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:31.837400 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:31.837409 (+ 9us) server_negotiation.cc:407] Connection header received
0811 08:09:31.837433 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:31.837434 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:31.837444 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:31.837504 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:31.837912 (+ 408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:31.838531 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:31.839311 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:31.839519 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:31.839571 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:31.842045 (+ 2474us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.243.193:49535: BlockingRecv error: recv got EOF from 127.27.243.193:49535 (error 108)
Metrics: {"server-negotiator.queue_time_us":102,"thread_start_us":60,"threads_started":1}
Aug 11 08:09:31 dist-test-slave-7lbf krb5kdc[9971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.243.194@KRBTEST.COM for oryx/127.27.243.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:09:31 dist-test-slave-7lbf krb5kdc[9971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.243.194@KRBTEST.COM for oryx/127.27.243.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:09:31.982175 11774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:31.977614 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:35905 (local address 127.27.243.194:50395)
0811 08:09:31.977779 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:31.977790 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:31.977857 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:31.977988 (+ 131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:31.977988 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:31.978162 (+ 174us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:09:31.978214 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:31.978216 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:31.978890 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:31.978892 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:31.979458 (+ 566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:31.979460 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:31.979842 (+ 382us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:31.979842 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:31.979882 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:31.980320 (+ 438us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:09:31.980326 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:09:31.982114 (+ 1788us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.243.254:35905: Server oryx/127.27.243.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":62,"threads_started":1}
W20260811 08:09:31.982271 11772 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:09:31.977776 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.194:50395 (local address 127.27.243.254:35905)
0811 08:09:31.977872 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:31.977874 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:31.977882 (+ 8us) server_negotiation.cc:407] Connection header received
0811 08:09:31.977910 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:31.977911 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:31.977922 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:31.977973 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:31.978266 (+ 293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:31.978771 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:31.979544 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:31.979752 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:31.979841 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:31.982204 (+ 2363us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.243.194:50395: BlockingRecv error: recv got EOF from 127.27.243.194:50395 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
Aug 11 08:09:32 dist-test-slave-7lbf krb5kdc[9971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.243.195@KRBTEST.COM for oryx/127.27.243.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:09:32 dist-test-slave-7lbf krb5kdc[9971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.243.195@KRBTEST.COM for oryx/127.27.243.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:09:32.120004 11775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:32.115362 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:35905 (local address 127.27.243.195:43407)
0811 08:09:32.115514 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:32.115525 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:32.115591 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:32.115746 (+ 155us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:32.115747 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:32.115954 (+ 207us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:09:32.116014 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:32.116021 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:32.116757 (+ 736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:32.116759 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:32.117296 (+ 537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:32.117298 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:32.117643 (+ 345us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:32.117644 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:32.117685 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:32.118148 (+ 463us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:09:32.118152 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:09:32.119946 (+ 1794us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.243.254:35905: Server oryx/127.27.243.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":86,"threads_started":1}
W20260811 08:09:32.120114 11772 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:09:32.115479 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.195:43407 (local address 127.27.243.254:35905)
0811 08:09:32.115546 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:32.115548 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:32.115578 (+ 30us) server_negotiation.cc:407] Connection header received
0811 08:09:32.115646 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:32.115647 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:32.115663 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:32.115728 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:32.116091 (+ 363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:32.116676 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:32.117385 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:32.117597 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:32.117645 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:32.120050 (+ 2405us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.243.195:43407: BlockingRecv error: recv got EOF from 127.27.243.195:43407 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
Aug 11 08:09:32 dist-test-slave-7lbf krb5kdc[9971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.243.193@KRBTEST.COM for oryx/127.27.243.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:09:32 dist-test-slave-7lbf krb5kdc[9971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.243.193@KRBTEST.COM for oryx/127.27.243.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:09:32.847437 11777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:32.842567 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:35905 (local address 127.27.243.193:45193)
0811 08:09:32.842746 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:32.842760 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:32.842829 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:32.843013 (+ 184us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:32.843014 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:32.843244 (+ 230us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:09:32.843318 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:32.843321 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:32.844017 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:32.844018 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:32.844577 (+ 559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:32.844579 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:32.844991 (+ 412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:32.844992 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:32.845055 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:32.845570 (+ 515us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:09:32.845576 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:09:32.847343 (+ 1767us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.243.254:35905: Server oryx/127.27.243.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":70,"threads_started":1}
W20260811 08:09:32.847513 11778 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:09:32.842682 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.193:45193 (local address 127.27.243.254:35905)
0811 08:09:32.842846 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:32.842848 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:32.842856 (+ 8us) server_negotiation.cc:407] Connection header received
0811 08:09:32.842910 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:32.842911 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:32.842924 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:32.842995 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:32.843397 (+ 402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:32.843933 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:32.844665 (+ 732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:32.844891 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:32.844948 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:32.847450 (+ 2502us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.243.193:45193: BlockingRecv error: recv got EOF from 127.27.243.193:45193 (error 108)
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":90,"threads_started":1}
Aug 11 08:09:32 dist-test-slave-7lbf krb5kdc[9971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.243.194@KRBTEST.COM for oryx/127.27.243.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:09:32 dist-test-slave-7lbf krb5kdc[9971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.243.194@KRBTEST.COM for oryx/127.27.243.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:09:32.987582 11780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:32.982636 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:35905 (local address 127.27.243.194:34853)
0811 08:09:32.982758 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:32.982768 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:32.982819 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:32.982954 (+ 135us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:32.982954 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:32.983129 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:09:32.983182 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:32.983183 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:32.984002 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:32.984004 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:32.984603 (+ 599us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:32.984607 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:32.984986 (+ 379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:32.984988 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:32.985038 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:32.985481 (+ 443us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:09:32.985488 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:09:32.987489 (+ 2001us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.243.254:35905: Server oryx/127.27.243.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":59,"threads_started":1}
W20260811 08:09:32.987641 11778 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:09:32.982751 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.194:34853 (local address 127.27.243.254:35905)
0811 08:09:32.982803 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:32.982804 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:32.982815 (+ 11us) server_negotiation.cc:407] Connection header received
0811 08:09:32.982872 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:32.982872 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:32.982885 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:32.982942 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:32.983232 (+ 290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:32.983900 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:32.984706 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:32.984913 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:32.984972 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:32.987588 (+ 2616us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.243.194:34853: BlockingRecv error: recv got EOF from 127.27.243.194:34853 (error 108)
Metrics: {"server-negotiator.queue_time_us":28}
Aug 11 08:09:33 dist-test-slave-7lbf krb5kdc[9971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.243.195@KRBTEST.COM for oryx/127.27.243.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:09:33 dist-test-slave-7lbf krb5kdc[9971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.243.195@KRBTEST.COM for oryx/127.27.243.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:09:33.125305 11784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:33.120542 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:35905 (local address 127.27.243.195:35021)
0811 08:09:33.120688 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:33.120699 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:33.120761 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:33.120921 (+ 160us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:33.120921 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:33.121096 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:09:33.121145 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:33.121147 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:33.121857 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:33.121859 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:33.122482 (+ 623us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:33.122486 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:33.122802 (+ 316us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:33.122803 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:33.122863 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:33.123354 (+ 491us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:09:33.123359 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:09:33.125235 (+ 1876us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.243.254:35905: Server oryx/127.27.243.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":61,"threads_started":1}
W20260811 08:09:33.125402 11778 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:09:33.120615 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.195:35021 (local address 127.27.243.254:35905)
0811 08:09:33.120671 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:33.120673 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:33.120752 (+ 79us) server_negotiation.cc:407] Connection header received
0811 08:09:33.120806 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:33.120806 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:33.120821 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:33.120878 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:33.121197 (+ 319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:33.121754 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:33.122552 (+ 798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:33.122745 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:33.122798 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:33.125335 (+ 2537us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.243.195:35021: BlockingRecv error: recv got EOF from 127.27.243.195:35021 (error 108)
Metrics: {"server-negotiator.queue_time_us":30}
Aug 11 08:09:33 dist-test-slave-7lbf krb5kdc[9971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.243.193@KRBTEST.COM for oryx/127.27.243.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:09:33 dist-test-slave-7lbf krb5kdc[9971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.243.193@KRBTEST.COM for oryx/127.27.243.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:09:33.855296 11785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:33.848007 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:35905 (local address 127.27.243.193:37149)
0811 08:09:33.848148 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:33.848158 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:33.848207 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:33.848334 (+ 127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:33.848335 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:33.848504 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:09:33.848559 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:33.848561 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:33.849240 (+ 679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:33.849241 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:33.849817 (+ 576us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:33.849820 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:33.850147 (+ 327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:33.850147 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:33.850183 (+ 36us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:33.853313 (+ 3130us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:09:33.853318 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:09:33.855216 (+ 1898us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.243.254:35905: Server oryx/127.27.243.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":65,"threads_started":1}
W20260811 08:09:33.855396 11786 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:09:33.848082 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.193:37149 (local address 127.27.243.254:35905)
0811 08:09:33.848198 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:33.848200 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:33.848210 (+ 10us) server_negotiation.cc:407] Connection header received
0811 08:09:33.848248 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:33.848249 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:33.848260 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:33.848321 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:33.848613 (+ 292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:33.849153 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:33.849897 (+ 744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:33.850094 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:33.850144 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:33.855333 (+ 5189us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.243.193:37149: BlockingRecv error: recv got EOF from 127.27.243.193:37149 (error 108)
Metrics: {"server-negotiator.queue_time_us":95,"thread_start_us":55,"threads_started":1}
Aug 11 08:09:33 dist-test-slave-7lbf krb5kdc[9971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.243.194@KRBTEST.COM for oryx/127.27.243.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:09:33 dist-test-slave-7lbf krb5kdc[9971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.243.194@KRBTEST.COM for oryx/127.27.243.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:09:33.992463 11787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:33.988101 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:35905 (local address 127.27.243.194:33059)
0811 08:09:33.988235 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:33.988247 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:33.988311 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:33.988440 (+ 129us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:33.988440 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:33.988599 (+ 159us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:09:33.988649 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:33.988650 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:33.989250 (+ 600us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:33.989251 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:33.989837 (+ 586us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:33.989839 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:33.990181 (+ 342us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:33.990181 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:33.990219 (+ 38us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:33.990700 (+ 481us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:09:33.990704 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:09:33.992403 (+ 1699us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.243.254:35905: Server oryx/127.27.243.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":68,"threads_started":1}
W20260811 08:09:33.992558 11786 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:09:33.988177 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.194:33059 (local address 127.27.243.254:35905)
0811 08:09:33.988238 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:33.988240 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:33.988305 (+ 65us) server_negotiation.cc:407] Connection header received
0811 08:09:33.988379 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:33.988380 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:33.988392 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:33.988427 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:33.988694 (+ 267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:33.989185 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:33.989912 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:33.990113 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:33.990172 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:33.992498 (+ 2326us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.243.194:33059: BlockingRecv error: recv got EOF from 127.27.243.194:33059 (error 108)
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 08:09:34.051451 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 10957
I20260811 08:09:34.073892 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 11228
I20260811 08:09:34.087325 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 11450
I20260811 08:09:34.095844 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 10830
2026-08-11T08:09:34Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (17622 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-11T08:09:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:09:34Z Disabled control of system clock
I20260811 08:09:34.128499 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435717191469-28623-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435717191469-28623-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435717191469-28623-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.243.254:43931
--webserver_interface=127.27.243.254
--webserver_port=0
--builtin_ntp_servers=127.27.243.212:34659
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.243.254:43931
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260811 08:09:34.208902 11796 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:09:34.209106 11796 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:09:34.209125 11796 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:09:34.210249 11796 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:09:34.210285 11796 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:09:34.210297 11796 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:09:34.210309 11796 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:09:34.210319 11796 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:09:34.211598 11796 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:34659
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435717191469-28623-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435717191469-28623-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.243.254:43931
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.243.254:43931
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.243.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11796
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435717191469-28623-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:09:34.211800 11796 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:09:34.212054 11796 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:09:34.217067 11806 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:09:34.217059 11803 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:09:34.217060 11809 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:09:34.217089 11796 server_base.cc:1034] running on GCE node
I20260811 08:09:34.217598 11796 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:09:34.217880 11796 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:09:34.219039 11796 hybrid_clock.cc:648] HybridClock initialized: now 1786435774219023 us; error 34 us; skew 500 ppm
I20260811 08:09:34.220335 11796 webserver.cc:460] Webserver started at http://127.27.243.254:41903/ using document root <none> and password file <none>
I20260811 08:09:34.220557 11796 fs_manager.cc:359] Metadata directory not provided
I20260811 08:09:34.220603 11796 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:09:34.220731 11796 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:09:34.221920 11796 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435717191469-28623-0/minicluster-data/master-0/data/instance:
uuid: "0c717a060d1a4564a805720629209e46"
format_stamp: "Formatted at 2026-08-11 08:09:34 on dist-test-slave-7lbf"
server_key: "740fd9a4f4d518ba73f7a3dca30f97ee"
server_key_iv: "ae70b917df27320ee6b3bd986748c3ac"
server_key_version: "encryptionkey@0"
I20260811 08:09:34.222267 11796 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435717191469-28623-0/minicluster-data/master-0/wal/instance:
uuid: "0c717a060d1a4564a805720629209e46"
format_stamp: "Formatted at 2026-08-11 08:09:34 on dist-test-slave-7lbf"
server_key: "740fd9a4f4d518ba73f7a3dca30f97ee"
server_key_iv: "ae70b917df27320ee6b3bd986748c3ac"
server_key_version: "encryptionkey@0"
I20260811 08:09:34.223555 11796 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:09:34.224243 11820 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:34.224382 11796 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 08:09:34.224465 11796 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435717191469-28623-0/minicluster-data/master-0/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435717191469-28623-0/minicluster-data/master-0/wal
uuid: "0c717a060d1a4564a805720629209e46"
format_stamp: "Formatted at 2026-08-11 08:09:34 on dist-test-slave-7lbf"
server_key: "740fd9a4f4d518ba73f7a3dca30f97ee"
server_key_iv: "ae70b917df27320ee6b3bd986748c3ac"
server_key_version: "encryptionkey@0"
I20260811 08:09:34.224529 11796 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435717191469-28623-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435717191469-28623-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435717191469-28623-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:09:34.234540 11796 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:09:34.234823 11796 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:09:34.234947 11796 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:09:34.238634 11796 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.254:43931
I20260811 08:09:34.238679 11906 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.254:43931 every 8 connection(s)
I20260811 08:09:34.239003 11796 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
I20260811 08:09:34.239707 11907 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:09:34.242499 11907 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0c717a060d1a4564a805720629209e46: Bootstrap starting.
I20260811 08:09:34.242642 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 11796
I20260811 08:09:34.242739 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435717191469-28623-0/minicluster-data/master-0/wal/instance
I20260811 08:09:34.242923 28623 external_mini_cluster.cc:1428] Setting key 5e25f38edeff329059dd89f68925bdc4
I20260811 08:09:34.243221 11907 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0c717a060d1a4564a805720629209e46: Neither blocks nor log segments found. Creating new log.
I20260811 08:09:34.243599 11907 log.cc:824] T 00000000000000000000000000000000 P 0c717a060d1a4564a805720629209e46: Log is configured to *not* fsync() on all Append() calls
I20260811 08:09:34.244405 11907 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0c717a060d1a4564a805720629209e46: No bootstrap required, opened a new log
I20260811 08:09:34.246358 11907 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0c717a060d1a4564a805720629209e46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c717a060d1a4564a805720629209e46" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 43931 } }
I20260811 08:09:34.246500 11907 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0c717a060d1a4564a805720629209e46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:09:34.246524 11907 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0c717a060d1a4564a805720629209e46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c717a060d1a4564a805720629209e46, State: Initialized, Role: FOLLOWER
I20260811 08:09:34.246642 11907 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0c717a060d1a4564a805720629209e46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c717a060d1a4564a805720629209e46" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 43931 } }
I20260811 08:09:34.246737 11907 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0c717a060d1a4564a805720629209e46 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:09:34.246776 11907 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0c717a060d1a4564a805720629209e46 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:09:34.246838 11907 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0c717a060d1a4564a805720629209e46 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:09:34.247720 11907 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0c717a060d1a4564a805720629209e46 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c717a060d1a4564a805720629209e46" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 43931 } }
I20260811 08:09:34.247838 11907 leader_election.cc:302] T 00000000000000000000000000000000 P 0c717a060d1a4564a805720629209e46 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0c717a060d1a4564a805720629209e46; no voters:
I20260811 08:09:34.248045 11907 leader_election.cc:288] T 00000000000000000000000000000000 P 0c717a060d1a4564a805720629209e46 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:09:34.248091 11917 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0c717a060d1a4564a805720629209e46 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:09:34.248251 11917 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0c717a060d1a4564a805720629209e46 [term 1 LEADER]: Becoming Leader. State: Replica: 0c717a060d1a4564a805720629209e46, State: Running, Role: LEADER
I20260811 08:09:34.248346 11907 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0c717a060d1a4564a805720629209e46 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:09:34.248399 11917 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0c717a060d1a4564a805720629209e46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c717a060d1a4564a805720629209e46" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 43931 } }
I20260811 08:09:34.248751 11917 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0c717a060d1a4564a805720629209e46 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0c717a060d1a4564a805720629209e46. Latest consensus state: current_term: 1 leader_uuid: "0c717a060d1a4564a805720629209e46" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c717a060d1a4564a805720629209e46" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 43931 } } }
I20260811 08:09:34.248947 11917 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0c717a060d1a4564a805720629209e46 [sys.catalog]: This master's current role is: LEADER
I20260811 08:09:34.248883 11920 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0c717a060d1a4564a805720629209e46 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0c717a060d1a4564a805720629209e46" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c717a060d1a4564a805720629209e46" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 43931 } } }
I20260811 08:09:34.249069 11920 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0c717a060d1a4564a805720629209e46 [sys.catalog]: This master's current role is: LEADER
I20260811 08:09:34.249123 11913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:34.243437 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60478 (local address 127.27.243.254:43931)
0811 08:09:34.243646 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:34.243655 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:34.243690 (+ 35us) server_negotiation.cc:407] Connection header received
0811 08:09:34.244212 (+ 522us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:34.244222 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:34.244315 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:34.244485 (+ 170us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:34.244692 (+ 207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:34.246049 (+ 1357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:34.246936 (+ 887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:34.247337 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:34.247451 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:34.248193 (+ 742us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:09:34.248197 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:09:34.248197 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:09:34.248424 (+ 227us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:09:34.248471 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:09:34.248485 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:09:34.248757 (+ 272us) server_negotiation.cc:1035] Waiting for connection context
0811 08:09:34.248795 (+ 38us) server_negotiation.cc:299] Negotiation successful
0811 08:09:34.248884 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":128,"thread_start_us":89,"threads_started":1}
I20260811 08:09:34.249876 11931 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:09:34.250365 11931 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:09:34.251919 11931 catalog_manager.cc:1347] Generated new cluster ID: 5235293efe4d47a7886bdba6f2b28b23
I20260811 08:09:34.251973 11931 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:09:34.259801 11931 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:09:34.260442 11931 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:09:34.268692 11931 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0c717a060d1a4564a805720629209e46: Generated new TSK 0
I20260811 08:09:34.268913 11931 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 08:09:34.274086 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435717191469-28623-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435717191469-28623-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435717191469-28623-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435717191469-28623-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.243.193:0
--local_ip_for_outbound_sockets=127.27.243.193
--webserver_interface=127.27.243.193
--webserver_port=0
--tserver_master_addrs=127.27.243.254:43931
--builtin_ntp_servers=127.27.243.212:34659
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260811 08:09:34.365876 11950 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:09:34.366078 11950 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:09:34.366106 11950 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:09:34.367221 11950 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:09:34.367261 11950 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:09:34.367293 11950 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.243.193
I20260811 08:09:34.368636 11950 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:34659
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435717191469-28623-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435717191469-28623-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.243.193:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435717191469-28623-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.243.193
--webserver_port=0
--tserver_master_addrs=127.27.243.254:43931
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11950
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.243.193
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435717191469-28623-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:09:34.368865 11950 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:09:34.369141 11950 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:09:34.374034 11963 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:09:34.374035 11961 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:09:34.374106 11965 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:09:34.374607 11950 server_base.cc:1034] running on GCE node
I20260811 08:09:34.374814 11950 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:09:34.375073 11950 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:09:34.376240 11950 hybrid_clock.cc:648] HybridClock initialized: now 1786435774376220 us; error 32 us; skew 500 ppm
I20260811 08:09:34.377636 11950 webserver.cc:460] Webserver started at http://127.27.243.193:42417/ using document root <none> and password file <none>
I20260811 08:09:34.377893 11950 fs_manager.cc:359] Metadata directory not provided
I20260811 08:09:34.377954 11950 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:09:34.378078 11950 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:09:34.379448 11950 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435717191469-28623-0/minicluster-data/ts-0/data/instance:
uuid: "1c27ff3faf634f8f8d4e1bc7f0f2555f"
format_stamp: "Formatted at 2026-08-11 08:09:34 on dist-test-slave-7lbf"
server_key: "ad0f8c38fe3832bc58d6e22269333492"
server_key_iv: "aeab5287985d06eb569e2261713f9d81"
server_key_version: "encryptionkey@0"
I20260811 08:09:34.379878 11950 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435717191469-28623-0/minicluster-data/ts-0/wal/instance:
uuid: "1c27ff3faf634f8f8d4e1bc7f0f2555f"
format_stamp: "Formatted at 2026-08-11 08:09:34 on dist-test-slave-7lbf"
server_key: "ad0f8c38fe3832bc58d6e22269333492"
server_key_iv: "aeab5287985d06eb569e2261713f9d81"
server_key_version: "encryptionkey@0"
I20260811 08:09:34.381495 11950 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.004s
I20260811 08:09:34.382447 11975 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:34.382638 11950 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 08:09:34.382731 11950 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435717191469-28623-0/minicluster-data/ts-0/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435717191469-28623-0/minicluster-data/ts-0/wal
uuid: "1c27ff3faf634f8f8d4e1bc7f0f2555f"
format_stamp: "Formatted at 2026-08-11 08:09:34 on dist-test-slave-7lbf"
server_key: "ad0f8c38fe3832bc58d6e22269333492"
server_key_iv: "aeab5287985d06eb569e2261713f9d81"
server_key_version: "encryptionkey@0"
I20260811 08:09:34.382807 11950 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435717191469-28623-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435717191469-28623-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435717191469-28623-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:09:34.409556 11950 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:09:34.409890 11950 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:09:34.410019 11950 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:09:34.410274 11950 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:09:34.410661 11950 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:09:34.410697 11950 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:34.410720 11950 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:09:34.410732 11950 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:34.416383 11950 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.193:43193
I20260811 08:09:34.416457 12154 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.193:43193 every 8 connection(s)
I20260811 08:09:34.416759 11950 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435717191469-28623-0/minicluster-data/ts-0/data/info.pb
I20260811 08:09:34.420532 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 11950
I20260811 08:09:34.420619 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435717191469-28623-0/minicluster-data/ts-0/wal/instance
I20260811 08:09:34.420806 28623 external_mini_cluster.cc:1428] Setting key 8725a612d412189672fcc80843191eb8
I20260811 08:09:34.421851 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435717191469-28623-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435717191469-28623-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435717191469-28623-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435717191469-28623-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.243.194:0
--local_ip_for_outbound_sockets=127.27.243.194
--webserver_interface=127.27.243.194
--webserver_port=0
--tserver_master_addrs=127.27.243.254:43931
--builtin_ntp_servers=127.27.243.212:34659
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260811 08:09:34.422209 11913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:34.417559 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.193:40061 (local address 127.27.243.254:43931)
0811 08:09:34.417617 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:34.417619 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:34.417831 (+ 212us) server_negotiation.cc:407] Connection header received
0811 08:09:34.418394 (+ 563us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:34.418395 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:34.418406 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:34.418464 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:34.419102 (+ 638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:34.419600 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:34.420612 (+ 1012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:34.420890 (+ 278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:34.420962 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:34.421913 (+ 951us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:09:34.421914 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:09:34.421915 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:09:34.421920 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:09:34.421937 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:09:34.421942 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:09:34.421996 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 08:09:34.422124 (+ 128us) server_negotiation.cc:299] Negotiation successful
0811 08:09:34.422147 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 08:09:34.422430 12158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:34.417469 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:43931 (local address 127.27.243.193:40061)
0811 08:09:34.417702 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:34.417739 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:34.418269 (+ 530us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:34.418535 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:34.418538 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:34.418546 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:09:34.419030 (+ 484us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:34.419034 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:34.419684 (+ 650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:34.419685 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:34.420513 (+ 828us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:34.420516 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:34.420979 (+ 463us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:34.420981 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:34.421150 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:34.421744 (+ 594us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 08:09:34.421744 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:09:34.421774 (+ 30us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 08:09:34.421797 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:09:34.422028 (+ 231us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:09:34.422037 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:09:34.422040 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 08:09:34.422102 (+ 62us) client_negotiation.cc:240] Negotiation successful
0811 08:09:34.422208 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":104,"threads_started":1}
I20260811 08:09:34.423025 12155 heartbeater.cc:347] Connected to a master server at 127.27.243.254:43931
I20260811 08:09:34.423118 12155 heartbeater.cc:464] Registering TS with master...
I20260811 08:09:34.423311 12155 heartbeater.cc:511] Master 127.27.243.254:43931 requested a full tablet report, sending...
I20260811 08:09:34.423846 11853 ts_manager.cc:194] Registered new tserver with Master: 1c27ff3faf634f8f8d4e1bc7f0f2555f (127.27.243.193:43193)
I20260811 08:09:34.424446 11853 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.27.243.193:40061
W20260811 08:09:34.505601 12159 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:09:34.505802 12159 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:09:34.505857 12159 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:09:34.506969 12159 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:09:34.507001 12159 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:09:34.507025 12159 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.243.194
I20260811 08:09:34.508280 12159 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:34659
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435717191469-28623-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435717191469-28623-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.243.194:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435717191469-28623-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.243.194
--webserver_port=0
--tserver_master_addrs=127.27.243.254:43931
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12159
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.243.194
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435717191469-28623-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:09:34.508460 12159 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:09:34.508695 12159 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:09:34.513542 12173 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:09:34.513626 12168 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:09:34.513610 12159 server_base.cc:1034] running on GCE node
W20260811 08:09:34.513592 12170 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:09:34.513942 12159 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:09:34.514139 12159 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:09:34.515285 12159 hybrid_clock.cc:648] HybridClock initialized: now 1786435774515268 us; error 33 us; skew 500 ppm
I20260811 08:09:34.516445 12159 webserver.cc:460] Webserver started at http://127.27.243.194:38413/ using document root <none> and password file <none>
I20260811 08:09:34.516651 12159 fs_manager.cc:359] Metadata directory not provided
I20260811 08:09:34.516695 12159 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:09:34.516815 12159 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:09:34.517938 12159 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435717191469-28623-0/minicluster-data/ts-1/data/instance:
uuid: "650dcc3768ee4480845e59be8b2b0be5"
format_stamp: "Formatted at 2026-08-11 08:09:34 on dist-test-slave-7lbf"
server_key: "d0a2edad116d2a93766d8fb5871f6a82"
server_key_iv: "a37c677a2682e5e614a40f7891d52a22"
server_key_version: "encryptionkey@0"
I20260811 08:09:34.518263 12159 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435717191469-28623-0/minicluster-data/ts-1/wal/instance:
uuid: "650dcc3768ee4480845e59be8b2b0be5"
format_stamp: "Formatted at 2026-08-11 08:09:34 on dist-test-slave-7lbf"
server_key: "d0a2edad116d2a93766d8fb5871f6a82"
server_key_iv: "a37c677a2682e5e614a40f7891d52a22"
server_key_version: "encryptionkey@0"
I20260811 08:09:34.519444 12159 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 08:09:34.520099 12185 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:34.520237 12159 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 08:09:34.520323 12159 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435717191469-28623-0/minicluster-data/ts-1/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435717191469-28623-0/minicluster-data/ts-1/wal
uuid: "650dcc3768ee4480845e59be8b2b0be5"
format_stamp: "Formatted at 2026-08-11 08:09:34 on dist-test-slave-7lbf"
server_key: "d0a2edad116d2a93766d8fb5871f6a82"
server_key_iv: "a37c677a2682e5e614a40f7891d52a22"
server_key_version: "encryptionkey@0"
I20260811 08:09:34.520494 12159 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435717191469-28623-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435717191469-28623-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435717191469-28623-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:09:34.530098 12159 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:09:34.530373 12159 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:09:34.530505 12159 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:09:34.530741 12159 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:09:34.531072 12159 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:09:34.531111 12159 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:34.531136 12159 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:09:34.531149 12159 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:34.537312 12159 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.194:46473
I20260811 08:09:34.537348 12369 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.194:46473 every 8 connection(s)
I20260811 08:09:34.537751 12159 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435717191469-28623-0/minicluster-data/ts-1/data/info.pb
I20260811 08:09:34.542583 11913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:34.538458 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.194:57667 (local address 127.27.243.254:43931)
0811 08:09:34.538508 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:34.538510 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:34.538785 (+ 275us) server_negotiation.cc:407] Connection header received
0811 08:09:34.539330 (+ 545us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:34.539331 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:34.539341 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:34.539387 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:34.540010 (+ 623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:34.540488 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:34.541411 (+ 923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:34.541611 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:34.541655 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:34.542379 (+ 724us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:09:34.542381 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:09:34.542381 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:09:34.542385 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:09:34.542401 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:09:34.542405 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:09:34.542443 (+ 38us) server_negotiation.cc:1035] Waiting for connection context
0811 08:09:34.542503 (+ 60us) server_negotiation.cc:299] Negotiation successful
0811 08:09:34.542525 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 08:09:34.542783 12376 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:34.538460 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:43931 (local address 127.27.243.194:57667)
0811 08:09:34.538664 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:34.538698 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:34.539218 (+ 520us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:34.539453 (+ 235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:34.539456 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:34.539464 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:09:34.539940 (+ 476us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:34.539945 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:34.540552 (+ 607us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:34.540553 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:34.541344 (+ 791us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:34.541347 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:34.541665 (+ 318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:34.541666 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:34.541780 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:34.542236 (+ 456us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 08:09:34.542236 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:09:34.542263 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 08:09:34.542301 (+ 38us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:09:34.542445 (+ 144us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:09:34.542448 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:09:34.542450 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 08:09:34.542500 (+ 50us) client_negotiation.cc:240] Negotiation successful
0811 08:09:34.542580 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":101,"threads_started":1}
I20260811 08:09:34.543241 12373 heartbeater.cc:347] Connected to a master server at 127.27.243.254:43931
I20260811 08:09:34.543332 12373 heartbeater.cc:464] Registering TS with master...
I20260811 08:09:34.543511 12373 heartbeater.cc:511] Master 127.27.243.254:43931 requested a full tablet report, sending...
I20260811 08:09:34.543910 11853 ts_manager.cc:194] Registered new tserver with Master: 650dcc3768ee4480845e59be8b2b0be5 (127.27.243.194:46473)
I20260811 08:09:34.544256 11853 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.27.243.194:57667
I20260811 08:09:34.547906 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 12159
I20260811 08:09:34.547981 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435717191469-28623-0/minicluster-data/ts-1/wal/instance
I20260811 08:09:34.548141 28623 external_mini_cluster.cc:1428] Setting key fa88c7873b4700b95c47a59fad3540a8
I20260811 08:09:34.549037 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435717191469-28623-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435717191469-28623-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435717191469-28623-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435717191469-28623-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.243.195:0
--local_ip_for_outbound_sockets=127.27.243.195
--webserver_interface=127.27.243.195
--webserver_port=0
--tserver_master_addrs=127.27.243.254:43931
--builtin_ntp_servers=127.27.243.212:34659
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260811 08:09:34.631178 12378 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:09:34.631378 12378 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:09:34.631398 12378 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:09:34.632490 12378 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:09:34.632525 12378 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:09:34.632548 12378 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.243.195
I20260811 08:09:34.633839 12378 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:34659
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435717191469-28623-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435717191469-28623-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.243.195:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435717191469-28623-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.243.195
--webserver_port=0
--tserver_master_addrs=127.27.243.254:43931
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12378
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.243.195
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435717191469-28623-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:09:34.634044 12378 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:09:34.634284 12378 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 08:09:34.639183 12378 server_base.cc:1034] running on GCE node
W20260811 08:09:34.639107 12390 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:09:34.639125 12388 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:09:34.639147 12393 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:09:34.639504 12378 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:09:34.639703 12378 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:09:34.640833 12378 hybrid_clock.cc:648] HybridClock initialized: now 1786435774640816 us; error 33 us; skew 500 ppm
I20260811 08:09:34.642012 12378 webserver.cc:460] Webserver started at http://127.27.243.195:36355/ using document root <none> and password file <none>
I20260811 08:09:34.642215 12378 fs_manager.cc:359] Metadata directory not provided
I20260811 08:09:34.642257 12378 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:09:34.642377 12378 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:09:34.643471 12378 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435717191469-28623-0/minicluster-data/ts-2/data/instance:
uuid: "a8441bee73954a86952f2e3f2ce6e6ee"
format_stamp: "Formatted at 2026-08-11 08:09:34 on dist-test-slave-7lbf"
server_key: "928b38e96b99c1d73e6fddbb87de868a"
server_key_iv: "5fc05ce17eb544c2c932824b8bfde4b0"
server_key_version: "encryptionkey@0"
I20260811 08:09:34.643798 12378 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435717191469-28623-0/minicluster-data/ts-2/wal/instance:
uuid: "a8441bee73954a86952f2e3f2ce6e6ee"
format_stamp: "Formatted at 2026-08-11 08:09:34 on dist-test-slave-7lbf"
server_key: "928b38e96b99c1d73e6fddbb87de868a"
server_key_iv: "5fc05ce17eb544c2c932824b8bfde4b0"
server_key_version: "encryptionkey@0"
I20260811 08:09:34.645134 12378 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 08:09:34.645900 12406 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:34.646044 12378 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:34.646126 12378 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435717191469-28623-0/minicluster-data/ts-2/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435717191469-28623-0/minicluster-data/ts-2/wal
uuid: "a8441bee73954a86952f2e3f2ce6e6ee"
format_stamp: "Formatted at 2026-08-11 08:09:34 on dist-test-slave-7lbf"
server_key: "928b38e96b99c1d73e6fddbb87de868a"
server_key_iv: "5fc05ce17eb544c2c932824b8bfde4b0"
server_key_version: "encryptionkey@0"
I20260811 08:09:34.646195 12378 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435717191469-28623-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435717191469-28623-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435717191469-28623-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:09:34.664376 12378 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:09:34.664713 12378 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:09:34.664847 12378 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:09:34.665091 12378 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:09:34.665426 12378 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:09:34.665468 12378 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:34.665493 12378 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:09:34.665534 12378 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:34.671135 12378 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.195:42573
I20260811 08:09:34.671190 12584 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.195:42573 every 8 connection(s)
I20260811 08:09:34.671538 12378 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435717191469-28623-0/minicluster-data/ts-2/data/info.pb
I20260811 08:09:34.674647 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 12378
I20260811 08:09:34.674722 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435717191469-28623-0/minicluster-data/ts-2/wal/instance
I20260811 08:09:34.674898 28623 external_mini_cluster.cc:1428] Setting key b8a112c341b3ebfd1445f791adf4aca0
I20260811 08:09:34.679553 11913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:34.672229 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.195:40027 (local address 127.27.243.254:43931)
0811 08:09:34.672271 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:34.672273 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:34.672500 (+ 227us) server_negotiation.cc:407] Connection header received
0811 08:09:34.673036 (+ 536us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:34.673038 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:34.673051 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:34.673101 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:34.673825 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:34.674319 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:34.675516 (+ 1197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:34.675768 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:34.675836 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:34.679344 (+ 3508us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:09:34.679345 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:09:34.679345 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:09:34.679350 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:09:34.679364 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:09:34.679367 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:09:34.679403 (+ 36us) server_negotiation.cc:1035] Waiting for connection context
0811 08:09:34.679470 (+ 67us) server_negotiation.cc:299] Negotiation successful
0811 08:09:34.679493 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260811 08:09:34.679776 12589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:34.672207 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:43931 (local address 127.27.243.195:40027)
0811 08:09:34.672381 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:34.672414 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:34.672934 (+ 520us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:34.673186 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:34.673190 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:34.673201 (+ 11us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:09:34.673738 (+ 537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:34.673743 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:34.674418 (+ 675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:34.674419 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:34.675429 (+ 1010us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:34.675432 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:34.675862 (+ 430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:34.675863 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:34.675979 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:34.679185 (+ 3206us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 08:09:34.679186 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:09:34.679224 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 08:09:34.679249 (+ 25us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:09:34.679413 (+ 164us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:09:34.679416 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:09:34.679419 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 08:09:34.679468 (+ 49us) client_negotiation.cc:240] Negotiation successful
0811 08:09:34.679557 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":70,"threads_started":1}
I20260811 08:09:34.680229 12586 heartbeater.cc:347] Connected to a master server at 127.27.243.254:43931
I20260811 08:09:34.680316 12586 heartbeater.cc:464] Registering TS with master...
I20260811 08:09:34.680492 12586 heartbeater.cc:511] Master 127.27.243.254:43931 requested a full tablet report, sending...
I20260811 08:09:34.680824 11853 ts_manager.cc:194] Registered new tserver with Master: a8441bee73954a86952f2e3f2ce6e6ee (127.27.243.195:42573)
I20260811 08:09:34.681172 11853 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.27.243.195:40027
I20260811 08:09:34.686396 28623 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260811 08:09:34.688143 11913 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:09:34.687683 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60490 (local address 127.27.243.254:43931)
0811 08:09:34.687769 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:34.687771 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:34.687873 (+ 102us) server_negotiation.cc:407] Connection header received
0811 08:09:34.687897 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:34.687898 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:34.687908 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:34.687970 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:34.688088 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60490: BlockingRecv error: recv got EOF from 127.0.0.1:60490 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
I20260811 08:09:34.688190 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 11950
I20260811 08:09:34.713196 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 12159
I20260811 08:09:34.719193 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 12378
I20260811 08:09:34.732395 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 11796
2026-08-11T08:09:34Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (635 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-11T08:09:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:09:34Z Disabled control of system clock
I20260811 08:09:34.764075 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435717191469-28623-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435717191469-28623-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435717191469-28623-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.243.254:45963
--webserver_interface=127.27.243.254
--webserver_port=0
--builtin_ntp_servers=127.27.243.212:43477
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.243.254:45963
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260811 08:09:34.852936 12609 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:09:34.853204 12609 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:09:34.853235 12609 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:09:34.854506 12609 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:09:34.854552 12609 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:09:34.854569 12609 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:09:34.854584 12609 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:09:34.854599 12609 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:09:34.856560 12609 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:43477
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435717191469-28623-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435717191469-28623-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.243.254:45963
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.243.254:45963
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.243.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12609
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435717191469-28623-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:09:34.856841 12609 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:09:34.857180 12609 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:09:34.863592 12619 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:09:34.863590 12617 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:09:34.863588 12624 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:09:34.863842 12609 server_base.cc:1034] running on GCE node
I20260811 08:09:34.864105 12609 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:09:34.864459 12609 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:09:34.865671 12609 hybrid_clock.cc:648] HybridClock initialized: now 1786435774865644 us; error 42 us; skew 500 ppm
I20260811 08:09:34.867209 12609 webserver.cc:460] Webserver started at http://127.27.243.254:34347/ using document root <none> and password file <none>
I20260811 08:09:34.867502 12609 fs_manager.cc:359] Metadata directory not provided
I20260811 08:09:34.867573 12609 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:09:34.867722 12609 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:09:34.869175 12609 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435717191469-28623-0/minicluster-data/master-0/data/instance:
uuid: "a27470190ac74971b12820d67ca4c835"
format_stamp: "Formatted at 2026-08-11 08:09:34 on dist-test-slave-7lbf"
server_key: "7c7fe2b334fb807fe02a5bf7c433ee20"
server_key_iv: "125c653bdfe7690deae2546f1ae00c01"
server_key_version: "encryptionkey@0"
I20260811 08:09:34.869612 12609 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435717191469-28623-0/minicluster-data/master-0/wal/instance:
uuid: "a27470190ac74971b12820d67ca4c835"
format_stamp: "Formatted at 2026-08-11 08:09:34 on dist-test-slave-7lbf"
server_key: "7c7fe2b334fb807fe02a5bf7c433ee20"
server_key_iv: "125c653bdfe7690deae2546f1ae00c01"
server_key_version: "encryptionkey@0"
I20260811 08:09:34.871209 12609 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:09:34.872100 12630 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:34.872256 12609 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:09:34.872345 12609 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435717191469-28623-0/minicluster-data/master-0/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435717191469-28623-0/minicluster-data/master-0/wal
uuid: "a27470190ac74971b12820d67ca4c835"
format_stamp: "Formatted at 2026-08-11 08:09:34 on dist-test-slave-7lbf"
server_key: "7c7fe2b334fb807fe02a5bf7c433ee20"
server_key_iv: "125c653bdfe7690deae2546f1ae00c01"
server_key_version: "encryptionkey@0"
I20260811 08:09:34.872416 12609 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435717191469-28623-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435717191469-28623-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435717191469-28623-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:09:34.877233 12609 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:09:34.877604 12609 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:09:34.877746 12609 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:09:34.882932 12609 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.254:45963
I20260811 08:09:34.882982 12726 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.254:45963 every 8 connection(s)
I20260811 08:09:34.883388 12609 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
I20260811 08:09:34.884107 12728 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:09:34.887916 12728 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a27470190ac74971b12820d67ca4c835: Bootstrap starting.
I20260811 08:09:34.888684 12728 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a27470190ac74971b12820d67ca4c835: Neither blocks nor log segments found. Creating new log.
I20260811 08:09:34.889015 12728 log.cc:824] T 00000000000000000000000000000000 P a27470190ac74971b12820d67ca4c835: Log is configured to *not* fsync() on all Append() calls
I20260811 08:09:34.889869 12728 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a27470190ac74971b12820d67ca4c835: No bootstrap required, opened a new log
I20260811 08:09:34.889864 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 12609
I20260811 08:09:34.889953 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435717191469-28623-0/minicluster-data/master-0/wal/instance
I20260811 08:09:34.890138 28623 external_mini_cluster.cc:1428] Setting key 5655c8991ed1aa55ca0071ddee19c40a
I20260811 08:09:34.891945 12728 raft_consensus.cc:348] T 00000000000000000000000000000000 P a27470190ac74971b12820d67ca4c835 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a27470190ac74971b12820d67ca4c835" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 45963 } }
I20260811 08:09:34.892194 12728 raft_consensus.cc:374] T 00000000000000000000000000000000 P a27470190ac74971b12820d67ca4c835 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:09:34.892336 12728 raft_consensus.cc:729] T 00000000000000000000000000000000 P a27470190ac74971b12820d67ca4c835 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a27470190ac74971b12820d67ca4c835, State: Initialized, Role: FOLLOWER
I20260811 08:09:34.892524 12728 consensus_queue.cc:260] T 00000000000000000000000000000000 P a27470190ac74971b12820d67ca4c835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a27470190ac74971b12820d67ca4c835" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 45963 } }
I20260811 08:09:34.892606 12728 raft_consensus.cc:388] T 00000000000000000000000000000000 P a27470190ac74971b12820d67ca4c835 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:09:34.892639 12728 raft_consensus.cc:482] T 00000000000000000000000000000000 P a27470190ac74971b12820d67ca4c835 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:09:34.892684 12728 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a27470190ac74971b12820d67ca4c835 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:09:34.893178 12728 raft_consensus.cc:504] T 00000000000000000000000000000000 P a27470190ac74971b12820d67ca4c835 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a27470190ac74971b12820d67ca4c835" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 45963 } }
I20260811 08:09:34.893273 12728 leader_election.cc:302] T 00000000000000000000000000000000 P a27470190ac74971b12820d67ca4c835 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a27470190ac74971b12820d67ca4c835; no voters:
I20260811 08:09:34.893425 12728 leader_election.cc:288] T 00000000000000000000000000000000 P a27470190ac74971b12820d67ca4c835 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:09:34.893504 12738 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a27470190ac74971b12820d67ca4c835 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:09:34.893685 12728 sys_catalog.cc:564] T 00000000000000000000000000000000 P a27470190ac74971b12820d67ca4c835 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:09:34.893700 12738 raft_consensus.cc:686] T 00000000000000000000000000000000 P a27470190ac74971b12820d67ca4c835 [term 1 LEADER]: Becoming Leader. State: Replica: a27470190ac74971b12820d67ca4c835, State: Running, Role: LEADER
I20260811 08:09:34.893924 12738 consensus_queue.cc:237] T 00000000000000000000000000000000 P a27470190ac74971b12820d67ca4c835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a27470190ac74971b12820d67ca4c835" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 45963 } }
I20260811 08:09:34.894407 12741 sys_catalog.cc:455] T 00000000000000000000000000000000 P a27470190ac74971b12820d67ca4c835 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a27470190ac74971b12820d67ca4c835. Latest consensus state: current_term: 1 leader_uuid: "a27470190ac74971b12820d67ca4c835" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a27470190ac74971b12820d67ca4c835" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 45963 } } }
I20260811 08:09:34.894824 12741 sys_catalog.cc:458] T 00000000000000000000000000000000 P a27470190ac74971b12820d67ca4c835 [sys.catalog]: This master's current role is: LEADER
I20260811 08:09:34.894735 12739 sys_catalog.cc:455] T 00000000000000000000000000000000 P a27470190ac74971b12820d67ca4c835 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a27470190ac74971b12820d67ca4c835" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a27470190ac74971b12820d67ca4c835" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 45963 } } }
I20260811 08:09:34.894897 12735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:34.890839 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48992 (local address 127.27.243.254:45963)
0811 08:09:34.891049 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:34.891058 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:34.891089 (+ 31us) server_negotiation.cc:407] Connection header received
0811 08:09:34.891905 (+ 816us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:34.891915 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:34.891966 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:34.892112 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:34.894210 (+ 2098us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:09:34.894213 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:09:34.894214 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:09:34.894218 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:09:34.894264 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:09:34.894280 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:09:34.894565 (+ 285us) server_negotiation.cc:1035] Waiting for connection context
0811 08:09:34.894599 (+ 34us) server_negotiation.cc:299] Negotiation successful
0811 08:09:34.894656 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130,"thread_start_us":80,"threads_started":1}
I20260811 08:09:34.895088 12739 sys_catalog.cc:458] T 00000000000000000000000000000000 P a27470190ac74971b12820d67ca4c835 [sys.catalog]: This master's current role is: LEADER
I20260811 08:09:34.895124 12754 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:09:34.895752 12754 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:09:34.897221 12754 catalog_manager.cc:1347] Generated new cluster ID: 4c098fe9159a40cc88c849f34b3838c0
I20260811 08:09:34.897274 12754 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:09:34.909583 12754 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:09:34.909763 12754 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:09:34.919579 12754 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a27470190ac74971b12820d67ca4c835: Generated new TSK 0
I20260811 08:09:34.919765 12754 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 08:09:34.925199 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435717191469-28623-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435717191469-28623-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435717191469-28623-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435717191469-28623-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.243.193:0
--local_ip_for_outbound_sockets=127.27.243.193
--webserver_interface=127.27.243.193
--webserver_port=0
--tserver_master_addrs=127.27.243.254:45963
--builtin_ntp_servers=127.27.243.212:43477
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260811 08:09:35.032917 12770 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:09:35.033120 12770 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:09:35.033141 12770 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:09:35.034343 12770 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:09:35.034386 12770 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:09:35.034409 12770 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.243.193
I20260811 08:09:35.035715 12770 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:43477
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435717191469-28623-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435717191469-28623-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.243.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435717191469-28623-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.243.193
--webserver_port=0
--tserver_master_addrs=127.27.243.254:45963
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12770
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.243.193
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435717191469-28623-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:09:35.035993 12770 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:09:35.036278 12770 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:09:35.041079 12783 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:09:35.041155 12787 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:09:35.041139 12789 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:09:35.041424 12770 server_base.cc:1034] running on GCE node
I20260811 08:09:35.041638 12770 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:09:35.041862 12770 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:09:35.043040 12770 hybrid_clock.cc:648] HybridClock initialized: now 1786435775043026 us; error 32 us; skew 500 ppm
I20260811 08:09:35.044248 12770 webserver.cc:460] Webserver started at http://127.27.243.193:41285/ using document root <none> and password file <none>
I20260811 08:09:35.044467 12770 fs_manager.cc:359] Metadata directory not provided
I20260811 08:09:35.044518 12770 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:09:35.044641 12770 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:09:35.045773 12770 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435717191469-28623-0/minicluster-data/ts-0/data/instance:
uuid: "1287dc23d0844be6afe8489f676b286d"
format_stamp: "Formatted at 2026-08-11 08:09:35 on dist-test-slave-7lbf"
server_key: "80e738cd7a5038645500df283989ebe3"
server_key_iv: "00144b92fbd7f5b302e0a32d28b14e37"
server_key_version: "encryptionkey@0"
I20260811 08:09:35.046120 12770 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435717191469-28623-0/minicluster-data/ts-0/wal/instance:
uuid: "1287dc23d0844be6afe8489f676b286d"
format_stamp: "Formatted at 2026-08-11 08:09:35 on dist-test-slave-7lbf"
server_key: "80e738cd7a5038645500df283989ebe3"
server_key_iv: "00144b92fbd7f5b302e0a32d28b14e37"
server_key_version: "encryptionkey@0"
I20260811 08:09:35.047369 12770 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:09:35.048061 12796 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:35.048235 12770 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 08:09:35.048319 12770 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435717191469-28623-0/minicluster-data/ts-0/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435717191469-28623-0/minicluster-data/ts-0/wal
uuid: "1287dc23d0844be6afe8489f676b286d"
format_stamp: "Formatted at 2026-08-11 08:09:35 on dist-test-slave-7lbf"
server_key: "80e738cd7a5038645500df283989ebe3"
server_key_iv: "00144b92fbd7f5b302e0a32d28b14e37"
server_key_version: "encryptionkey@0"
I20260811 08:09:35.048385 12770 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435717191469-28623-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435717191469-28623-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435717191469-28623-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:09:35.051693 12770 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:09:35.051945 12770 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:09:35.052063 12770 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:09:35.052248 12770 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:09:35.052543 12770 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:09:35.052577 12770 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:35.052603 12770 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:09:35.052628 12770 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:35.058033 12770 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.193:41079
I20260811 08:09:35.058094 12994 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.193:41079 every 8 connection(s)
I20260811 08:09:35.058364 12770 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435717191469-28623-0/minicluster-data/ts-0/data/info.pb
I20260811 08:09:35.061143 12735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:35.059044 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.193:41789 (local address 127.27.243.254:45963)
0811 08:09:35.059104 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:35.059105 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:35.059303 (+ 198us) server_negotiation.cc:407] Connection header received
0811 08:09:35.059787 (+ 484us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:35.059788 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:35.059794 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:35.059832 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:35.060954 (+ 1122us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:09:35.060955 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:09:35.060955 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:09:35.060960 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:09:35.060977 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:09:35.060981 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:09:35.061031 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0811 08:09:35.061077 (+ 46us) server_negotiation.cc:299] Negotiation successful
0811 08:09:35.061090 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260811 08:09:35.061333 12999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:35.059012 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:45963 (local address 127.27.243.193:41789)
0811 08:09:35.059185 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:35.059232 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:35.059692 (+ 460us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:35.059900 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:35.059903 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:35.059911 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:09:35.060794 (+ 883us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 08:09:35.060795 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:09:35.060823 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 08:09:35.060860 (+ 37us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:09:35.061031 (+ 171us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:09:35.061033 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:09:35.061035 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 08:09:35.061083 (+ 48us) client_negotiation.cc:240] Negotiation successful
0811 08:09:35.061130 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":77,"threads_started":1}
I20260811 08:09:35.061540 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 12770
I20260811 08:09:35.061633 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435717191469-28623-0/minicluster-data/ts-0/wal/instance
I20260811 08:09:35.061836 28623 external_mini_cluster.cc:1428] Setting key aacd12e7507a124e7f2af50213a3c1c9
I20260811 08:09:35.061975 12995 heartbeater.cc:347] Connected to a master server at 127.27.243.254:45963
I20260811 08:09:35.062075 12995 heartbeater.cc:464] Registering TS with master...
I20260811 08:09:35.062225 12995 heartbeater.cc:511] Master 127.27.243.254:45963 requested a full tablet report, sending...
I20260811 08:09:35.062773 12663 ts_manager.cc:194] Registered new tserver with Master: 1287dc23d0844be6afe8489f676b286d (127.27.243.193:41079)
I20260811 08:09:35.062937 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435717191469-28623-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435717191469-28623-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435717191469-28623-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435717191469-28623-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.243.194:0
--local_ip_for_outbound_sockets=127.27.243.194
--webserver_interface=127.27.243.194
--webserver_port=0
--tserver_master_addrs=127.27.243.254:45963
--builtin_ntp_servers=127.27.243.212:43477
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260811 08:09:35.145488 13000 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:09:35.145723 13000 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:09:35.145754 13000 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:09:35.146880 13000 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:09:35.146920 13000 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:09:35.146953 13000 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.243.194
I20260811 08:09:35.148272 13000 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:43477
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435717191469-28623-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435717191469-28623-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.243.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435717191469-28623-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.243.194
--webserver_port=0
--tserver_master_addrs=127.27.243.254:45963
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13000
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.243.194
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435717191469-28623-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:09:35.148517 13000 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:09:35.148782 13000 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:09:35.153725 13007 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:09:35.153820 13000 server_base.cc:1034] running on GCE node
W20260811 08:09:35.153721 13008 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:09:35.153757 13011 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:09:35.154155 13000 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:09:35.154399 13000 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:09:35.155539 13000 hybrid_clock.cc:648] HybridClock initialized: now 1786435775155524 us; error 34 us; skew 500 ppm
I20260811 08:09:35.156791 13000 webserver.cc:460] Webserver started at http://127.27.243.194:44127/ using document root <none> and password file <none>
I20260811 08:09:35.157042 13000 fs_manager.cc:359] Metadata directory not provided
I20260811 08:09:35.157094 13000 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:09:35.157225 13000 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:09:35.158346 13000 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435717191469-28623-0/minicluster-data/ts-1/data/instance:
uuid: "116f64a38aaf4ff19f6eb7358c9ca42f"
format_stamp: "Formatted at 2026-08-11 08:09:35 on dist-test-slave-7lbf"
server_key: "711814e062a973605a8b3cffe2fa4cad"
server_key_iv: "02f7910a2b68af4815180fcf72496ea7"
server_key_version: "encryptionkey@0"
I20260811 08:09:35.158684 13000 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435717191469-28623-0/minicluster-data/ts-1/wal/instance:
uuid: "116f64a38aaf4ff19f6eb7358c9ca42f"
format_stamp: "Formatted at 2026-08-11 08:09:35 on dist-test-slave-7lbf"
server_key: "711814e062a973605a8b3cffe2fa4cad"
server_key_iv: "02f7910a2b68af4815180fcf72496ea7"
server_key_version: "encryptionkey@0"
I20260811 08:09:35.159976 13000 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 08:09:35.160648 13019 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:35.160797 13000 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 08:09:35.160898 13000 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435717191469-28623-0/minicluster-data/ts-1/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435717191469-28623-0/minicluster-data/ts-1/wal
uuid: "116f64a38aaf4ff19f6eb7358c9ca42f"
format_stamp: "Formatted at 2026-08-11 08:09:35 on dist-test-slave-7lbf"
server_key: "711814e062a973605a8b3cffe2fa4cad"
server_key_iv: "02f7910a2b68af4815180fcf72496ea7"
server_key_version: "encryptionkey@0"
I20260811 08:09:35.160965 13000 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435717191469-28623-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435717191469-28623-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435717191469-28623-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:09:35.164340 13000 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:09:35.164578 13000 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:09:35.164698 13000 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:09:35.164889 13000 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:09:35.165175 13000 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:09:35.165208 13000 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:35.165233 13000 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:09:35.165256 13000 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:35.170928 13000 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.194:35967
I20260811 08:09:35.170962 13206 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.194:35967 every 8 connection(s)
I20260811 08:09:35.171245 13000 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435717191469-28623-0/minicluster-data/ts-1/data/info.pb
I20260811 08:09:35.173889 12735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:35.171889 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.194:39525 (local address 127.27.243.254:45963)
0811 08:09:35.171966 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:35.171968 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:35.172157 (+ 189us) server_negotiation.cc:407] Connection header received
0811 08:09:35.172592 (+ 435us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:35.172593 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:35.172598 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:35.172645 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:35.173684 (+ 1039us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:09:35.173685 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:09:35.173686 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:09:35.173690 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:09:35.173705 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:09:35.173709 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:09:35.173756 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0811 08:09:35.173811 (+ 55us) server_negotiation.cc:299] Negotiation successful
0811 08:09:35.173822 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260811 08:09:35.174047 13212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:35.171868 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:45963 (local address 127.27.243.194:39525)
0811 08:09:35.172047 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:35.172078 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:35.172516 (+ 438us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:35.172704 (+ 188us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:35.172707 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:35.172715 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:09:35.173539 (+ 824us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 08:09:35.173539 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:09:35.173576 (+ 37us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 08:09:35.173609 (+ 33us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:09:35.173759 (+ 150us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:09:35.173762 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:09:35.173764 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 08:09:35.173813 (+ 49us) client_negotiation.cc:240] Negotiation successful
0811 08:09:35.173861 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":85,"threads_started":1}
I20260811 08:09:35.174505 13207 heartbeater.cc:347] Connected to a master server at 127.27.243.254:45963
I20260811 08:09:35.174588 13207 heartbeater.cc:464] Registering TS with master...
I20260811 08:09:35.174727 13207 heartbeater.cc:511] Master 127.27.243.254:45963 requested a full tablet report, sending...
I20260811 08:09:35.175077 12663 ts_manager.cc:194] Registered new tserver with Master: 116f64a38aaf4ff19f6eb7358c9ca42f (127.27.243.194:35967)
I20260811 08:09:35.178351 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 13000
I20260811 08:09:35.178431 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435717191469-28623-0/minicluster-data/ts-1/wal/instance
I20260811 08:09:35.178573 28623 external_mini_cluster.cc:1428] Setting key 5b323eca4883594a70a116d5c8d06687
I20260811 08:09:35.179427 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435717191469-28623-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435717191469-28623-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435717191469-28623-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435717191469-28623-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.243.195:0
--local_ip_for_outbound_sockets=127.27.243.195
--webserver_interface=127.27.243.195
--webserver_port=0
--tserver_master_addrs=127.27.243.254:45963
--builtin_ntp_servers=127.27.243.212:43477
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260811 08:09:35.262197 13213 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:09:35.262399 13213 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:09:35.262421 13213 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:09:35.263556 13213 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:09:35.263597 13213 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:09:35.263620 13213 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.243.195
I20260811 08:09:35.264974 13213 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:43477
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435717191469-28623-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435717191469-28623-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.243.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435717191469-28623-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.243.195
--webserver_port=0
--tserver_master_addrs=127.27.243.254:45963
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13213
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.243.195
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435717191469-28623-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:09:35.265156 13213 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:09:35.265407 13213 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:09:35.270150 13221 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:09:35.270162 13220 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:09:35.270243 13223 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:09:35.270272 13213 server_base.cc:1034] running on GCE node
I20260811 08:09:35.270572 13213 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:09:35.270788 13213 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:09:35.271953 13213 hybrid_clock.cc:648] HybridClock initialized: now 1786435775271938 us; error 34 us; skew 500 ppm
I20260811 08:09:35.273154 13213 webserver.cc:460] Webserver started at http://127.27.243.195:37835/ using document root <none> and password file <none>
I20260811 08:09:35.273380 13213 fs_manager.cc:359] Metadata directory not provided
I20260811 08:09:35.273430 13213 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:09:35.273587 13213 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:09:35.274684 13213 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435717191469-28623-0/minicluster-data/ts-2/data/instance:
uuid: "b1f363effabe4cdaad001f641d95ec72"
format_stamp: "Formatted at 2026-08-11 08:09:35 on dist-test-slave-7lbf"
server_key: "1b26954f8cc38fb6ee3ab0edee228f67"
server_key_iv: "e0fd87c7a54c24109b94c46e35bdc2f6"
server_key_version: "encryptionkey@0"
I20260811 08:09:35.275014 13213 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435717191469-28623-0/minicluster-data/ts-2/wal/instance:
uuid: "b1f363effabe4cdaad001f641d95ec72"
format_stamp: "Formatted at 2026-08-11 08:09:35 on dist-test-slave-7lbf"
server_key: "1b26954f8cc38fb6ee3ab0edee228f67"
server_key_iv: "e0fd87c7a54c24109b94c46e35bdc2f6"
server_key_version: "encryptionkey@0"
I20260811 08:09:35.276352 13213 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 08:09:35.277077 13230 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:35.277232 13213 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 08:09:35.277321 13213 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435717191469-28623-0/minicluster-data/ts-2/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435717191469-28623-0/minicluster-data/ts-2/wal
uuid: "b1f363effabe4cdaad001f641d95ec72"
format_stamp: "Formatted at 2026-08-11 08:09:35 on dist-test-slave-7lbf"
server_key: "1b26954f8cc38fb6ee3ab0edee228f67"
server_key_iv: "e0fd87c7a54c24109b94c46e35bdc2f6"
server_key_version: "encryptionkey@0"
I20260811 08:09:35.277391 13213 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435717191469-28623-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435717191469-28623-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435717191469-28623-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:09:35.280727 13213 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:09:35.280967 13213 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:09:35.281086 13213 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:09:35.281281 13213 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:09:35.281617 13213 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:09:35.281653 13213 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:35.281680 13213 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:09:35.281704 13213 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:35.287392 13213 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.195:38087
I20260811 08:09:35.287429 13417 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.195:38087 every 8 connection(s)
I20260811 08:09:35.287734 13213 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435717191469-28623-0/minicluster-data/ts-2/data/info.pb
I20260811 08:09:35.290640 12735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:35.288427 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.195:36001 (local address 127.27.243.254:45963)
0811 08:09:35.288472 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:35.288474 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:35.288727 (+ 253us) server_negotiation.cc:407] Connection header received
0811 08:09:35.289189 (+ 462us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:35.289190 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:35.289197 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:35.289252 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:35.290397 (+ 1145us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:09:35.290398 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:09:35.290399 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:09:35.290403 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:09:35.290418 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:09:35.290423 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:09:35.290468 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0811 08:09:35.290569 (+ 101us) server_negotiation.cc:299] Negotiation successful
0811 08:09:35.290586 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 08:09:35.290743 13423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:35.288403 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:45963 (local address 127.27.243.195:36001)
0811 08:09:35.288578 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:35.288612 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:35.289078 (+ 466us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:35.289316 (+ 238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:35.289319 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:35.289326 (+ 7us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:09:35.290254 (+ 928us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 08:09:35.290254 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:09:35.290283 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 08:09:35.290313 (+ 30us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:09:35.290467 (+ 154us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:09:35.290469 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:09:35.290472 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 08:09:35.290521 (+ 49us) client_negotiation.cc:240] Negotiation successful
0811 08:09:35.290582 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":87,"threads_started":1}
I20260811 08:09:35.291175 13418 heartbeater.cc:347] Connected to a master server at 127.27.243.254:45963
I20260811 08:09:35.291263 13418 heartbeater.cc:464] Registering TS with master...
I20260811 08:09:35.291406 13418 heartbeater.cc:511] Master 127.27.243.254:45963 requested a full tablet report, sending...
I20260811 08:09:35.291729 12663 ts_manager.cc:194] Registered new tserver with Master: b1f363effabe4cdaad001f641d95ec72 (127.27.243.195:38087)
I20260811 08:09:35.294947 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 13213
I20260811 08:09:35.295033 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435717191469-28623-0/minicluster-data/ts-2/wal/instance
I20260811 08:09:35.295243 28623 external_mini_cluster.cc:1428] Setting key 310cbf65a6e9a59cc4109ac7c408a54d
I20260811 08:09:35.296080 28623 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260811 08:09:35.297842 12735 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:09:35.297394 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49004 (local address 127.27.243.254:45963)
0811 08:09:35.297454 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:35.297456 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:35.297554 (+ 98us) server_negotiation.cc:407] Connection header received
0811 08:09:35.297616 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:35.297617 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:35.297622 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:35.297667 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:35.297780 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49004: BlockingRecv error: recv got EOF from 127.0.0.1:49004 (error 108)
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 08:09:35.297919 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 12770
I20260811 08:09:35.312089 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 13000
I20260811 08:09:35.325305 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 13213
I20260811 08:09:35.334091 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 12609
2026-08-11T08:09:35Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (603 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435717191469-28623-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:09:35 dist-test-slave-7lbf krb5kdc[13434](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:09:35 dist-test-slave-7lbf krb5kdc[13434](info): set up 2 sockets
Aug 11 08:09:35 dist-test-slave-7lbf krb5kdc[13434](info): commencing operation
krb5kdc: starting...
W20260811 08:09:36.493084 28623 mini_kdc.cc:121] Time spent starting KDC: real 1.133s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435717191469-28623-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435717191469-28623-0/krb5kdc/test-user.keytab.
Aug 11 08:09:36 dist-test-slave-7lbf krb5kdc[13434](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435776, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:09:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:09:36Z Disabled control of system clock
WARNING: no policy specified for kudu/127.27.243.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.243.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.243.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab.
Entry for principal kudu/127.27.243.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab.
I20260811 08:09:36.611835 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435717191469-28623-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435717191469-28623-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435717191469-28623-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.243.254:35843
--webserver_interface=127.27.243.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab
--principal=kudu/127.27.243.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:42285
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.243.254:35843
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:09:36.693960 13450 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:09:36.694151 13450 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:09:36.694173 13450 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:09:36.695298 13450 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:09:36.695341 13450 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:09:36.695355 13450 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:09:36.695365 13450 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:09:36.695375 13450 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:09:36.696817 13450 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:42285
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435717191469-28623-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435717191469-28623-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.243.254:35843
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab
--principal=kudu/127.27.243.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.243.254:35843
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.243.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13450
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435717191469-28623-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:09:36.697052 13450 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:09:36.697244 13450 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:09:36.701756 13457 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:09:36.701772 13461 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:09:36.701761 13456 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:09:36.701848 13450 server_base.cc:1034] running on GCE node
I20260811 08:09:36.702152 13450 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:09:36.702458 13450 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:09:36.703605 13450 hybrid_clock.cc:648] HybridClock initialized: now 1786435776703588 us; error 30 us; skew 500 ppm
Aug 11 08:09:36 dist-test-slave-7lbf krb5kdc[13434](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435776, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:09:36.705964 13450 init.cc:377] Logged in from keytab as kudu/127.27.243.254@KRBTEST.COM (short username kudu)
I20260811 08:09:36.706386 13450 webserver.cc:460] Webserver started at http://127.27.243.254:44663/ using document root <none> and password file <none>
I20260811 08:09:36.706610 13450 fs_manager.cc:359] Metadata directory not provided
I20260811 08:09:36.706655 13450 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:09:36.706780 13450 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:09:36.707798 13450 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435717191469-28623-0/minicluster-data/master-0/data/instance:
uuid: "c3e05004e23d478994ab2b93864784fd"
format_stamp: "Formatted at 2026-08-11 08:09:36 on dist-test-slave-7lbf"
server_key: "3255cc22f4b4ae7b7823917fb489d469"
server_key_iv: "1a9c68357fc57bb2b46c917e7d7210aa"
server_key_version: "encryptionkey@0"
I20260811 08:09:36.708130 13450 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435717191469-28623-0/minicluster-data/master-0/wal/instance:
uuid: "c3e05004e23d478994ab2b93864784fd"
format_stamp: "Formatted at 2026-08-11 08:09:36 on dist-test-slave-7lbf"
server_key: "3255cc22f4b4ae7b7823917fb489d469"
server_key_iv: "1a9c68357fc57bb2b46c917e7d7210aa"
server_key_version: "encryptionkey@0"
I20260811 08:09:36.709336 13450 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 08:09:36.710033 13470 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:36.710191 13450 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:36.710278 13450 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435717191469-28623-0/minicluster-data/master-0/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435717191469-28623-0/minicluster-data/master-0/wal
uuid: "c3e05004e23d478994ab2b93864784fd"
format_stamp: "Formatted at 2026-08-11 08:09:36 on dist-test-slave-7lbf"
server_key: "3255cc22f4b4ae7b7823917fb489d469"
server_key_iv: "1a9c68357fc57bb2b46c917e7d7210aa"
server_key_version: "encryptionkey@0"
I20260811 08:09:36.710354 13450 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435717191469-28623-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435717191469-28623-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435717191469-28623-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:09:36.730134 13450 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:09:36.731835 13450 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:09:36.731971 13450 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:09:36.735790 13450 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.254:35843
I20260811 08:09:36.735837 13560 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.254:35843 every 8 connection(s)
I20260811 08:09:36.736148 13450 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
I20260811 08:09:36.736869 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 13450
I20260811 08:09:36.736967 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435717191469-28623-0/minicluster-data/master-0/wal/instance
I20260811 08:09:36.737128 13564 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:09:36.737145 28623 external_mini_cluster.cc:1428] Setting key 187fe608de9e84515209bb559ea3fe43
I20260811 08:09:36.740411 13564 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c3e05004e23d478994ab2b93864784fd: Bootstrap starting.
I20260811 08:09:36.741012 13564 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c3e05004e23d478994ab2b93864784fd: Neither blocks nor log segments found. Creating new log.
I20260811 08:09:36.741266 13564 log.cc:824] T 00000000000000000000000000000000 P c3e05004e23d478994ab2b93864784fd: Log is configured to *not* fsync() on all Append() calls
I20260811 08:09:36.741936 13564 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c3e05004e23d478994ab2b93864784fd: No bootstrap required, opened a new log
Aug 11 08:09:36 dist-test-slave-7lbf krb5kdc[13434](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435776, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.243.254@KRBTEST.COM
I20260811 08:09:36.743708 13564 raft_consensus.cc:348] T 00000000000000000000000000000000 P c3e05004e23d478994ab2b93864784fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3e05004e23d478994ab2b93864784fd" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 35843 } }
I20260811 08:09:36.743840 13564 raft_consensus.cc:374] T 00000000000000000000000000000000 P c3e05004e23d478994ab2b93864784fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:09:36.743873 13564 raft_consensus.cc:729] T 00000000000000000000000000000000 P c3e05004e23d478994ab2b93864784fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3e05004e23d478994ab2b93864784fd, State: Initialized, Role: FOLLOWER
I20260811 08:09:36.744035 13564 consensus_queue.cc:260] T 00000000000000000000000000000000 P c3e05004e23d478994ab2b93864784fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3e05004e23d478994ab2b93864784fd" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 35843 } }
I20260811 08:09:36.744140 13564 raft_consensus.cc:388] T 00000000000000000000000000000000 P c3e05004e23d478994ab2b93864784fd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:09:36.744184 13564 raft_consensus.cc:482] T 00000000000000000000000000000000 P c3e05004e23d478994ab2b93864784fd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:09:36.744231 13564 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c3e05004e23d478994ab2b93864784fd [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:09:36.744833 13564 raft_consensus.cc:504] T 00000000000000000000000000000000 P c3e05004e23d478994ab2b93864784fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3e05004e23d478994ab2b93864784fd" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 35843 } }
I20260811 08:09:36.744946 13564 leader_election.cc:302] T 00000000000000000000000000000000 P c3e05004e23d478994ab2b93864784fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c3e05004e23d478994ab2b93864784fd; no voters:
I20260811 08:09:36.745141 13564 leader_election.cc:288] T 00000000000000000000000000000000 P c3e05004e23d478994ab2b93864784fd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:09:36.745186 13571 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c3e05004e23d478994ab2b93864784fd [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:09:36.745378 13571 raft_consensus.cc:686] T 00000000000000000000000000000000 P c3e05004e23d478994ab2b93864784fd [term 1 LEADER]: Becoming Leader. State: Replica: c3e05004e23d478994ab2b93864784fd, State: Running, Role: LEADER
I20260811 08:09:36.745435 13564 sys_catalog.cc:564] T 00000000000000000000000000000000 P c3e05004e23d478994ab2b93864784fd [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:09:36.745536 13571 consensus_queue.cc:237] T 00000000000000000000000000000000 P c3e05004e23d478994ab2b93864784fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3e05004e23d478994ab2b93864784fd" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 35843 } }
I20260811 08:09:36.745965 13571 sys_catalog.cc:455] T 00000000000000000000000000000000 P c3e05004e23d478994ab2b93864784fd [sys.catalog]: SysCatalogTable state changed. Reason: New leader c3e05004e23d478994ab2b93864784fd. Latest consensus state: current_term: 1 leader_uuid: "c3e05004e23d478994ab2b93864784fd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3e05004e23d478994ab2b93864784fd" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 35843 } } }
I20260811 08:09:36.746213 13571 sys_catalog.cc:458] T 00000000000000000000000000000000 P c3e05004e23d478994ab2b93864784fd [sys.catalog]: This master's current role is: LEADER
I20260811 08:09:36.746138 13575 sys_catalog.cc:455] T 00000000000000000000000000000000 P c3e05004e23d478994ab2b93864784fd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c3e05004e23d478994ab2b93864784fd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3e05004e23d478994ab2b93864784fd" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 35843 } } }
I20260811 08:09:36.746469 13575 sys_catalog.cc:458] T 00000000000000000000000000000000 P c3e05004e23d478994ab2b93864784fd [sys.catalog]: This master's current role is: LEADER
I20260811 08:09:36.746865 13590 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:09:36.747319 13590 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:09:36.747882 13568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:36.737623 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35608 (local address 127.27.243.254:35843)
0811 08:09:36.737823 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:36.737833 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:36.737868 (+ 35us) server_negotiation.cc:407] Connection header received
0811 08:09:36.738307 (+ 439us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:36.738316 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:36.738379 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:36.738543 (+ 164us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:36.739116 (+ 573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:36.740432 (+ 1316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:36.741208 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:36.741680 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:36.741818 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:36.743954 (+ 2136us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:09:36.743958 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:09:36.743958 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:09:36.743969 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:09:36.745968 (+ 1999us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:36.746376 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:36.746380 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:36.746381 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:36.746502 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:36.746716 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:36.746717 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:36.746718 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:36.746991 (+ 273us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:09:36.747137 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0811 08:09:36.747559 (+ 422us) server_negotiation.cc:299] Negotiation successful
0811 08:09:36.747693 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":138,"thread_start_us":88,"threads_started":1}
I20260811 08:09:36.748924 13590 catalog_manager.cc:1347] Generated new cluster ID: d8b6f953756f467a8b41a421fb46d52b
I20260811 08:09:36.748973 13590 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:09:36.753358 13590 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:09:36.754011 13590 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:09:36.761924 13590 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c3e05004e23d478994ab2b93864784fd: Generated new TSK 0
I20260811 08:09:36.762094 13590 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.27.243.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.243.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.243.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.193.keytab.
Entry for principal kudu/127.27.243.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.193.keytab.
I20260811 08:09:36.796367 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435717191469-28623-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435717191469-28623-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435717191469-28623-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435717191469-28623-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.243.193:0
--local_ip_for_outbound_sockets=127.27.243.193
--webserver_interface=127.27.243.193
--webserver_port=0
--tserver_master_addrs=127.27.243.254:35843
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.193.keytab
--principal=kudu/127.27.243.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:42285
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:09:36.899963 13612 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:09:36.900168 13612 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:09:36.900202 13612 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:09:36.901350 13612 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:09:36.901394 13612 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:09:36.901429 13612 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.243.193
I20260811 08:09:36.903029 13612 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:42285
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435717191469-28623-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435717191469-28623-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.193.keytab
--principal=kudu/127.27.243.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.243.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435717191469-28623-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.243.193
--webserver_port=0
--tserver_master_addrs=127.27.243.254:35843
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13612
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.243.193
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435717191469-28623-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:09:36.903359 13612 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:09:36.903615 13612 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:09:36.908654 13621 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:09:36.908654 13623 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:09:36.908658 13620 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:09:36.908908 13612 server_base.cc:1034] running on GCE node
I20260811 08:09:36.909083 13612 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:09:36.909279 13612 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:09:36.910413 13612 hybrid_clock.cc:648] HybridClock initialized: now 1786435776910400 us; error 30 us; skew 500 ppm
Aug 11 08:09:36 dist-test-slave-7lbf krb5kdc[13434](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435776, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:09:36.912954 13612 init.cc:377] Logged in from keytab as kudu/127.27.243.193@KRBTEST.COM (short username kudu)
I20260811 08:09:36.913337 13612 webserver.cc:460] Webserver started at http://127.27.243.193:35025/ using document root <none> and password file <none>
I20260811 08:09:36.913585 13612 fs_manager.cc:359] Metadata directory not provided
I20260811 08:09:36.913635 13612 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:09:36.913730 13612 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:09:36.914724 13612 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435717191469-28623-0/minicluster-data/ts-0/data/instance:
uuid: "11361e0b0b5c43939a53524504de4c0f"
format_stamp: "Formatted at 2026-08-11 08:09:36 on dist-test-slave-7lbf"
server_key: "0ca7cfa3f298603cae6714803b849b2b"
server_key_iv: "5d170322b0a2ba32f62f0e51561c293a"
server_key_version: "encryptionkey@0"
I20260811 08:09:36.915023 13612 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435717191469-28623-0/minicluster-data/ts-0/wal/instance:
uuid: "11361e0b0b5c43939a53524504de4c0f"
format_stamp: "Formatted at 2026-08-11 08:09:36 on dist-test-slave-7lbf"
server_key: "0ca7cfa3f298603cae6714803b849b2b"
server_key_iv: "5d170322b0a2ba32f62f0e51561c293a"
server_key_version: "encryptionkey@0"
I20260811 08:09:36.916219 13612 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 08:09:36.916910 13642 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:36.917057 13612 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 08:09:36.917142 13612 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435717191469-28623-0/minicluster-data/ts-0/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435717191469-28623-0/minicluster-data/ts-0/wal
uuid: "11361e0b0b5c43939a53524504de4c0f"
format_stamp: "Formatted at 2026-08-11 08:09:36 on dist-test-slave-7lbf"
server_key: "0ca7cfa3f298603cae6714803b849b2b"
server_key_iv: "5d170322b0a2ba32f62f0e51561c293a"
server_key_version: "encryptionkey@0"
I20260811 08:09:36.917203 13612 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435717191469-28623-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435717191469-28623-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435717191469-28623-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:09:36.939565 13612 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:09:36.941742 13612 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:09:36.941893 13612 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:09:36.942122 13612 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:09:36.942438 13612 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:09:36.942473 13612 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:36.942502 13612 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:09:36.942519 13612 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:36.948105 13612 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.193:36797
I20260811 08:09:36.948174 13829 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.193:36797 every 8 connection(s)
I20260811 08:09:36.948453 13612 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435717191469-28623-0/minicluster-data/ts-0/data/info.pb
I20260811 08:09:36.952752 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 13612
I20260811 08:09:36.952853 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435717191469-28623-0/minicluster-data/ts-0/wal/instance
I20260811 08:09:36.953069 28623 external_mini_cluster.cc:1428] Setting key 268de589d8b24a16844d3eaa11aeb101
Aug 11 08:09:36 dist-test-slave-7lbf krb5kdc[13434](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435776, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.193@KRBTEST.COM for kudu/127.27.243.254@KRBTEST.COM
I20260811 08:09:36.957264 13568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:36.949099 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.193:41439 (local address 127.27.243.254:35843)
0811 08:09:36.949174 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:36.949177 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:36.949321 (+ 144us) server_negotiation.cc:407] Connection header received
0811 08:09:36.949846 (+ 525us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:36.949848 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:36.949859 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:36.949913 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:36.950781 (+ 868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:36.951272 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:36.952167 (+ 895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:36.952364 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:36.952406 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:36.954704 (+ 2298us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:09:36.954705 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:09:36.954705 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:09:36.954711 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:09:36.955924 (+ 1213us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:36.956369 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:36.956370 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:36.956370 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:36.956418 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:36.956660 (+ 242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:36.956660 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:36.956661 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:36.956754 (+ 93us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:09:36.956807 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 08:09:36.957088 (+ 281us) server_negotiation.cc:299] Negotiation successful
0811 08:09:36.957174 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260811 08:09:36.957438 13832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:36.949072 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:35843 (local address 127.27.243.193:41439)
0811 08:09:36.949209 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:36.949244 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:36.949767 (+ 523us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:36.949968 (+ 201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:36.949971 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:36.950511 (+ 540us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:09:36.950711 (+ 200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:36.950716 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:36.951341 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:36.951341 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:36.952110 (+ 769us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:36.952112 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:36.952415 (+ 303us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:36.952415 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:36.952505 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:36.953016 (+ 511us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:09:36.953026 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:09:36.954620 (+ 1594us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:09:36.956001 (+ 1381us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:09:36.956008 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:09:36.956010 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:09:36.956285 (+ 275us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:09:36.956471 (+ 186us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:09:36.956471 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:09:36.956472 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:09:36.956603 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:09:36.956821 (+ 218us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:09:36.956829 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:09:36.956966 (+ 137us) client_negotiation.cc:769] Sending connection context
0811 08:09:36.957057 (+ 91us) client_negotiation.cc:240] Negotiation successful
0811 08:09:36.957208 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":71,"threads_started":1}
I20260811 08:09:36.957980 13830 heartbeater.cc:347] Connected to a master server at 127.27.243.254:35843
I20260811 08:09:36.958087 13830 heartbeater.cc:464] Registering TS with master...
I20260811 08:09:36.958273 13830 heartbeater.cc:511] Master 127.27.243.254:35843 requested a full tablet report, sending...
I20260811 08:09:36.958778 13502 ts_manager.cc:194] Registered new tserver with Master: 11361e0b0b5c43939a53524504de4c0f (127.27.243.193:36797)
I20260811 08:09:36.959394 13502 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.243.193@KRBTEST.COM'} at 127.27.243.193:41439
WARNING: no policy specified for kudu/127.27.243.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.243.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.243.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.194.keytab.
Entry for principal kudu/127.27.243.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.194.keytab.
I20260811 08:09:36.978266 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435717191469-28623-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435717191469-28623-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435717191469-28623-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435717191469-28623-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.243.194:0
--local_ip_for_outbound_sockets=127.27.243.194
--webserver_interface=127.27.243.194
--webserver_port=0
--tserver_master_addrs=127.27.243.254:35843
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.194.keytab
--principal=kudu/127.27.243.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:42285
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:09:37.059305 13835 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:09:37.059515 13835 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:09:37.059549 13835 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:09:37.060667 13835 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:09:37.060708 13835 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:09:37.060742 13835 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.243.194
I20260811 08:09:37.062182 13835 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:42285
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435717191469-28623-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435717191469-28623-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.194.keytab
--principal=kudu/127.27.243.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.243.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435717191469-28623-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.243.194
--webserver_port=0
--tserver_master_addrs=127.27.243.254:35843
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13835
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.243.194
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435717191469-28623-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:09:37.062412 13835 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:09:37.062624 13835 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:09:37.067476 13845 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:09:37.067498 13849 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:09:37.067524 13847 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:09:37.067651 13835 server_base.cc:1034] running on GCE node
I20260811 08:09:37.067921 13835 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:09:37.068136 13835 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:09:37.069279 13835 hybrid_clock.cc:648] HybridClock initialized: now 1786435777069267 us; error 26 us; skew 500 ppm
Aug 11 08:09:37 dist-test-slave-7lbf krb5kdc[13434](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435777, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:09:37.071772 13835 init.cc:377] Logged in from keytab as kudu/127.27.243.194@KRBTEST.COM (short username kudu)
I20260811 08:09:37.072183 13835 webserver.cc:460] Webserver started at http://127.27.243.194:42899/ using document root <none> and password file <none>
I20260811 08:09:37.072389 13835 fs_manager.cc:359] Metadata directory not provided
I20260811 08:09:37.072434 13835 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:09:37.072556 13835 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:09:37.073604 13835 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435717191469-28623-0/minicluster-data/ts-1/data/instance:
uuid: "893131f3f6a04ad38c7195af2c9faea3"
format_stamp: "Formatted at 2026-08-11 08:09:37 on dist-test-slave-7lbf"
server_key: "2d0105edce2426f6acc3119a20d2c506"
server_key_iv: "3e6dfe1a8c3fca4810b7188e913ce5c9"
server_key_version: "encryptionkey@0"
I20260811 08:09:37.073930 13835 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435717191469-28623-0/minicluster-data/ts-1/wal/instance:
uuid: "893131f3f6a04ad38c7195af2c9faea3"
format_stamp: "Formatted at 2026-08-11 08:09:37 on dist-test-slave-7lbf"
server_key: "2d0105edce2426f6acc3119a20d2c506"
server_key_iv: "3e6dfe1a8c3fca4810b7188e913ce5c9"
server_key_version: "encryptionkey@0"
I20260811 08:09:37.075134 13835 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:09:37.075809 13858 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:37.075951 13835 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:37.076026 13835 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435717191469-28623-0/minicluster-data/ts-1/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435717191469-28623-0/minicluster-data/ts-1/wal
uuid: "893131f3f6a04ad38c7195af2c9faea3"
format_stamp: "Formatted at 2026-08-11 08:09:37 on dist-test-slave-7lbf"
server_key: "2d0105edce2426f6acc3119a20d2c506"
server_key_iv: "3e6dfe1a8c3fca4810b7188e913ce5c9"
server_key_version: "encryptionkey@0"
I20260811 08:09:37.076089 13835 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435717191469-28623-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435717191469-28623-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435717191469-28623-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:09:37.091925 13835 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:09:37.093842 13835 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:09:37.093961 13835 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:09:37.094178 13835 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:09:37.094480 13835 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:09:37.094514 13835 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:37.094535 13835 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:09:37.094554 13835 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:37.100319 13835 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.194:37505
I20260811 08:09:37.100375 14051 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.194:37505 every 8 connection(s)
I20260811 08:09:37.100675 13835 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435717191469-28623-0/minicluster-data/ts-1/data/info.pb
I20260811 08:09:37.103184 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 13835
I20260811 08:09:37.103279 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435717191469-28623-0/minicluster-data/ts-1/wal/instance
I20260811 08:09:37.103461 28623 external_mini_cluster.cc:1428] Setting key 072b2fc7e40e0cdc86e93bb00af8ef2c
Aug 11 08:09:37 dist-test-slave-7lbf krb5kdc[13434](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435777, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.194@KRBTEST.COM for kudu/127.27.243.254@KRBTEST.COM
I20260811 08:09:37.110342 13568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:37.101345 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.194:38047 (local address 127.27.243.254:35843)
0811 08:09:37.101396 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:37.101398 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:37.101585 (+ 187us) server_negotiation.cc:407] Connection header received
0811 08:09:37.102126 (+ 541us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:37.102127 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:37.102140 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:37.102193 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:37.103172 (+ 979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:37.103750 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:37.105046 (+ 1296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:37.105266 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:37.105322 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:37.107473 (+ 2151us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:09:37.107475 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:09:37.107475 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:09:37.107483 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:09:37.109005 (+ 1522us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:37.109377 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:37.109378 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:37.109379 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:37.109444 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:37.109705 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:37.109706 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:37.109706 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:37.109845 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:09:37.109924 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 08:09:37.110151 (+ 227us) server_negotiation.cc:299] Negotiation successful
0811 08:09:37.110248 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 08:09:37.110376 14057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:37.101298 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:35843 (local address 127.27.243.194:38047)
0811 08:09:37.101459 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:37.101494 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:37.102012 (+ 518us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:37.102266 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:37.102270 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:37.102866 (+ 596us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:09:37.103079 (+ 213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:37.103085 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:37.103842 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:37.103843 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:37.104939 (+ 1096us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:37.104943 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:37.105344 (+ 401us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:37.105345 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:37.105480 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:37.105975 (+ 495us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:09:37.105985 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:09:37.107384 (+ 1399us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:09:37.109083 (+ 1699us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:09:37.109090 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:09:37.109092 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:09:37.109302 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:09:37.109505 (+ 203us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:09:37.109505 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:09:37.109506 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:09:37.109645 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:09:37.109912 (+ 267us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:09:37.109915 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:09:37.110024 (+ 109us) client_negotiation.cc:769] Sending connection context
0811 08:09:37.110097 (+ 73us) client_negotiation.cc:240] Negotiation successful
0811 08:09:37.110215 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":78,"threads_started":1}
I20260811 08:09:37.110846 14052 heartbeater.cc:347] Connected to a master server at 127.27.243.254:35843
I20260811 08:09:37.110961 14052 heartbeater.cc:464] Registering TS with master...
I20260811 08:09:37.111160 14052 heartbeater.cc:511] Master 127.27.243.254:35843 requested a full tablet report, sending...
I20260811 08:09:37.111533 13502 ts_manager.cc:194] Registered new tserver with Master: 893131f3f6a04ad38c7195af2c9faea3 (127.27.243.194:37505)
I20260811 08:09:37.111929 13502 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.243.194@KRBTEST.COM'} at 127.27.243.194:38047
WARNING: no policy specified for kudu/127.27.243.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.243.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.243.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.195.keytab.
Entry for principal kudu/127.27.243.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.195.keytab.
I20260811 08:09:37.129865 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435717191469-28623-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435717191469-28623-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435717191469-28623-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435717191469-28623-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.243.195:0
--local_ip_for_outbound_sockets=127.27.243.195
--webserver_interface=127.27.243.195
--webserver_port=0
--tserver_master_addrs=127.27.243.254:35843
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.195.keytab
--principal=kudu/127.27.243.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:42285
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:09:37.210669 14061 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:09:37.210872 14061 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:09:37.210894 14061 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:09:37.212016 14061 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:09:37.212057 14061 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:09:37.212083 14061 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.243.195
I20260811 08:09:37.213587 14061 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:42285
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435717191469-28623-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435717191469-28623-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.195.keytab
--principal=kudu/127.27.243.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.243.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435717191469-28623-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.243.195
--webserver_port=0
--tserver_master_addrs=127.27.243.254:35843
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14061
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.243.195
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435717191469-28623-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:09:37.213819 14061 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:09:37.214033 14061 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:09:37.218870 14069 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:09:37.218911 14068 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:09:37.218907 14071 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:09:37.218961 14061 server_base.cc:1034] running on GCE node
I20260811 08:09:37.219246 14061 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:09:37.219478 14061 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:09:37.220628 14061 hybrid_clock.cc:648] HybridClock initialized: now 1786435777220615 us; error 29 us; skew 500 ppm
Aug 11 08:09:37 dist-test-slave-7lbf krb5kdc[13434](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435777, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:09:37.223083 14061 init.cc:377] Logged in from keytab as kudu/127.27.243.195@KRBTEST.COM (short username kudu)
I20260811 08:09:37.223511 14061 webserver.cc:460] Webserver started at http://127.27.243.195:43209/ using document root <none> and password file <none>
I20260811 08:09:37.223727 14061 fs_manager.cc:359] Metadata directory not provided
I20260811 08:09:37.223771 14061 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:09:37.223896 14061 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:09:37.224929 14061 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435717191469-28623-0/minicluster-data/ts-2/data/instance:
uuid: "065a105988a942f491122edf3c077f78"
format_stamp: "Formatted at 2026-08-11 08:09:37 on dist-test-slave-7lbf"
server_key: "f6f8e9c992dee483142afeace7c17909"
server_key_iv: "bf87e4d9e2bff8ca874efd8f3aa6b08e"
server_key_version: "encryptionkey@0"
I20260811 08:09:37.225256 14061 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435717191469-28623-0/minicluster-data/ts-2/wal/instance:
uuid: "065a105988a942f491122edf3c077f78"
format_stamp: "Formatted at 2026-08-11 08:09:37 on dist-test-slave-7lbf"
server_key: "f6f8e9c992dee483142afeace7c17909"
server_key_iv: "bf87e4d9e2bff8ca874efd8f3aa6b08e"
server_key_version: "encryptionkey@0"
I20260811 08:09:37.226572 14061 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 08:09:37.227332 14080 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:37.227487 14061 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 08:09:37.227572 14061 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435717191469-28623-0/minicluster-data/ts-2/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435717191469-28623-0/minicluster-data/ts-2/wal
uuid: "065a105988a942f491122edf3c077f78"
format_stamp: "Formatted at 2026-08-11 08:09:37 on dist-test-slave-7lbf"
server_key: "f6f8e9c992dee483142afeace7c17909"
server_key_iv: "bf87e4d9e2bff8ca874efd8f3aa6b08e"
server_key_version: "encryptionkey@0"
I20260811 08:09:37.227638 14061 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435717191469-28623-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435717191469-28623-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435717191469-28623-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:09:37.254354 14061 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:09:37.256237 14061 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:09:37.256371 14061 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:09:37.256590 14061 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:09:37.256927 14061 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:09:37.256964 14061 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:37.256994 14061 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:09:37.257020 14061 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:09:37.262874 14061 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.195:43027
I20260811 08:09:37.262944 14277 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.195:43027 every 8 connection(s)
I20260811 08:09:37.263240 14061 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435717191469-28623-0/minicluster-data/ts-2/data/info.pb
I20260811 08:09:37.264911 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 14061
I20260811 08:09:37.264991 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435717191469-28623-0/minicluster-data/ts-2/wal/instance
I20260811 08:09:37.265153 28623 external_mini_cluster.cc:1428] Setting key dcd2c3e3b8f4cea93e00d486cdeb5323
Aug 11 08:09:37 dist-test-slave-7lbf krb5kdc[13434](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435777, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.195@KRBTEST.COM for kudu/127.27.243.254@KRBTEST.COM
I20260811 08:09:37.272014 13568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:37.263935 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.195:49207 (local address 127.27.243.254:35843)
0811 08:09:37.263990 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:37.263993 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:37.264204 (+ 211us) server_negotiation.cc:407] Connection header received
0811 08:09:37.264718 (+ 514us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:37.264719 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:37.264732 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:37.264783 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:37.265933 (+ 1150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:37.266438 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:37.267420 (+ 982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:37.267610 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:37.267667 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:37.269698 (+ 2031us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:09:37.269699 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:09:37.269699 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:09:37.269708 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:09:37.270769 (+ 1061us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:37.271133 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:37.271134 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:37.271134 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:37.271190 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:37.271410 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:37.271411 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:37.271412 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:37.271523 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:09:37.271580 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 08:09:37.271840 (+ 260us) server_negotiation.cc:299] Negotiation successful
0811 08:09:37.271923 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 08:09:37.272188 14283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:37.263910 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:35843 (local address 127.27.243.195:49207)
0811 08:09:37.264080 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:37.264117 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:37.264621 (+ 504us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:37.264864 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:37.264867 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:37.265559 (+ 692us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:09:37.265843 (+ 284us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:37.265851 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:37.266518 (+ 667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:37.266520 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:37.267336 (+ 816us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:37.267339 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:37.267680 (+ 341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:37.267680 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:37.267825 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:37.268243 (+ 418us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:09:37.268251 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:09:37.269608 (+ 1357us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:09:37.270845 (+ 1237us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:09:37.270853 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:09:37.270855 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:09:37.271064 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:09:37.271245 (+ 181us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:09:37.271245 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:09:37.271246 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:09:37.271353 (+ 107us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:09:37.271580 (+ 227us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:09:37.271586 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:09:37.271722 (+ 136us) client_negotiation.cc:769] Sending connection context
0811 08:09:37.271818 (+ 96us) client_negotiation.cc:240] Negotiation successful
0811 08:09:37.271975 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":89,"threads_started":1}
I20260811 08:09:37.272608 14279 heartbeater.cc:347] Connected to a master server at 127.27.243.254:35843
I20260811 08:09:37.272693 14279 heartbeater.cc:464] Registering TS with master...
I20260811 08:09:37.272876 14279 heartbeater.cc:511] Master 127.27.243.254:35843 requested a full tablet report, sending...
I20260811 08:09:37.273234 13502 ts_manager.cc:194] Registered new tserver with Master: 065a105988a942f491122edf3c077f78 (127.27.243.195:43027)
I20260811 08:09:37.273636 13502 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.243.195@KRBTEST.COM'} at 127.27.243.195:49207
I20260811 08:09:37.276695 28623 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 08:09:37.283537 13568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:37.277954 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35624 (local address 127.27.243.254:35843)
0811 08:09:37.278002 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:37.278003 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:37.278136 (+ 133us) server_negotiation.cc:407] Connection header received
0811 08:09:37.278160 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:37.278160 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:37.278170 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:37.278219 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:09:37.278742 (+ 523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:37.279214 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:37.279945 (+ 731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:37.280184 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:37.280239 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:37.281239 (+ 1000us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:09:37.281240 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:09:37.281241 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:09:37.281246 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:09:37.282687 (+ 1441us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:37.282988 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:37.282989 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:37.282989 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:37.283036 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:09:37.283160 (+ 124us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:09:37.283161 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:09:37.283161 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:09:37.283279 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:09:37.283354 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 08:09:37.283424 (+ 70us) server_negotiation.cc:299] Negotiation successful
0811 08:09:37.283479 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 08:09:37.284845 13502 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35624:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 08:09:37.286430 13502 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 08:09:37.292418 14295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:37.288689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.194:37505 (local address 127.0.0.1:33920)
0811 08:09:37.288872 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:37.288911 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:37.288973 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:37.289341 (+ 368us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:37.289345 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:37.289347 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:09:37.289415 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:37.289417 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:37.290468 (+ 1051us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:37.290469 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:37.291385 (+ 916us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:37.291388 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:37.292113 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:37.292114 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:37.292199 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:37.292213 (+ 14us) client_negotiation.cc:769] Sending connection context
0811 08:09:37.292284 (+ 71us) client_negotiation.cc:240] Negotiation successful
0811 08:09:37.292342 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":48,"threads_started":1}
I20260811 08:09:37.292441 14296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:37.288789 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33920 (local address 127.27.243.194:37505)
0811 08:09:37.289114 (+ 325us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:37.289118 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:37.289131 (+ 13us) server_negotiation.cc:407] Connection header received
0811 08:09:37.289177 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:37.289179 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:37.289197 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:37.289531 (+ 334us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:09:37.289618 (+ 87us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:37.290371 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:37.291500 (+ 1129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:37.292018 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:37.292099 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:37.292156 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 08:09:37.292316 (+ 160us) server_negotiation.cc:299] Negotiation successful
0811 08:09:37.292361 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":281,"thread_start_us":85,"threads_started":1}
I20260811 08:09:37.293370 14299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:37.289111 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47542 (local address 127.27.243.195:43027)
0811 08:09:37.289285 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:37.289289 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:37.289423 (+ 134us) server_negotiation.cc:407] Connection header received
0811 08:09:37.289480 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:37.289482 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:37.289499 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:37.289599 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:09:37.289796 (+ 197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:37.290866 (+ 1070us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:37.292374 (+ 1508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:37.293055 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:37.293118 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:37.293156 (+ 38us) server_negotiation.cc:1035] Waiting for connection context
0811 08:09:37.293283 (+ 127us) server_negotiation.cc:299] Negotiation successful
0811 08:09:37.293311 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":148,"thread_start_us":80,"threads_started":1}
I20260811 08:09:37.293394 14294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:37.288920 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.195:43027 (local address 127.0.0.1:47542)
0811 08:09:37.289306 (+ 386us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:37.289315 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:37.289362 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:37.289668 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:37.289669 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:37.289671 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:09:37.289717 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:37.289719 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:37.290961 (+ 1242us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:37.290961 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:37.292296 (+ 1335us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:37.292298 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:37.293130 (+ 832us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:37.293132 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:37.293196 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:37.293202 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 08:09:37.293275 (+ 73us) client_negotiation.cc:240] Negotiation successful
0811 08:09:37.293324 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":375,"mutex_wait_us":51,"thread_start_us":64,"threads_started":1}
I20260811 08:09:37.293408 13947 tablet_service.cc:1467] Processing CreateTablet for tablet 385775cb53f44754b03662cdf5b7881d (DEFAULT_TABLE table=test-table [id=fbdc03220e2b4a4aa456b194821dda94]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:09:37.293861 13947 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 385775cb53f44754b03662cdf5b7881d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:09:37.294078 14172 tablet_service.cc:1467] Processing CreateTablet for tablet 385775cb53f44754b03662cdf5b7881d (DEFAULT_TABLE table=test-table [id=fbdc03220e2b4a4aa456b194821dda94]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:09:37.294418 14172 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 385775cb53f44754b03662cdf5b7881d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:09:37.297422 14300 tablet_bootstrap.cc:492] T 385775cb53f44754b03662cdf5b7881d P 893131f3f6a04ad38c7195af2c9faea3: Bootstrap starting.
I20260811 08:09:37.297816 14298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:37.288718 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.193:36797 (local address 127.0.0.1:40276)
0811 08:09:37.289131 (+ 413us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:37.289141 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:37.289204 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:37.289425 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:37.289426 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:37.289429 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:09:37.289558 (+ 129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:37.289560 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:37.290960 (+ 1400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:37.290961 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:37.292146 (+ 1185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:37.292149 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:37.297555 (+ 5406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:37.297557 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:37.297632 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:37.297637 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 08:09:37.297692 (+ 55us) client_negotiation.cc:240] Negotiation successful
0811 08:09:37.297732 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":386,"mutex_wait_us":44,"thread_start_us":100,"threads_started":1}
I20260811 08:09:37.297957 14302 tablet_bootstrap.cc:492] T 385775cb53f44754b03662cdf5b7881d P 065a105988a942f491122edf3c077f78: Bootstrap starting.
I20260811 08:09:37.298125 14297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:37.288854 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40276 (local address 127.27.243.193:36797)
0811 08:09:37.289057 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:37.289062 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:37.289206 (+ 144us) server_negotiation.cc:407] Connection header received
0811 08:09:37.289290 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:37.289292 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:37.289308 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:37.289638 (+ 330us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:09:37.289716 (+ 78us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:37.290837 (+ 1121us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:37.292232 (+ 1395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:37.292929 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:37.293004 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:37.293055 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 08:09:37.297985 (+ 4930us) server_negotiation.cc:299] Negotiation successful
0811 08:09:37.298034 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":163,"thread_start_us":104,"threads_started":1}
I20260811 08:09:37.298143 14300 tablet_bootstrap.cc:654] T 385775cb53f44754b03662cdf5b7881d P 893131f3f6a04ad38c7195af2c9faea3: Neither blocks nor log segments found. Creating new log.
I20260811 08:09:37.298648 14302 tablet_bootstrap.cc:654] T 385775cb53f44754b03662cdf5b7881d P 065a105988a942f491122edf3c077f78: Neither blocks nor log segments found. Creating new log.
I20260811 08:09:37.298719 14300 log.cc:824] T 385775cb53f44754b03662cdf5b7881d P 893131f3f6a04ad38c7195af2c9faea3: Log is configured to *not* fsync() on all Append() calls
I20260811 08:09:37.298657 13711 tablet_service.cc:1467] Processing CreateTablet for tablet 385775cb53f44754b03662cdf5b7881d (DEFAULT_TABLE table=test-table [id=fbdc03220e2b4a4aa456b194821dda94]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:09:37.298972 13711 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 385775cb53f44754b03662cdf5b7881d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:09:37.299214 14302 log.cc:824] T 385775cb53f44754b03662cdf5b7881d P 065a105988a942f491122edf3c077f78: Log is configured to *not* fsync() on all Append() calls
I20260811 08:09:37.299505 14300 tablet_bootstrap.cc:492] T 385775cb53f44754b03662cdf5b7881d P 893131f3f6a04ad38c7195af2c9faea3: No bootstrap required, opened a new log
I20260811 08:09:37.299587 14300 ts_tablet_manager.cc:1397] T 385775cb53f44754b03662cdf5b7881d P 893131f3f6a04ad38c7195af2c9faea3: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260811 08:09:37.299823 14302 tablet_bootstrap.cc:492] T 385775cb53f44754b03662cdf5b7881d P 065a105988a942f491122edf3c077f78: No bootstrap required, opened a new log
I20260811 08:09:37.299885 14302 ts_tablet_manager.cc:1397] T 385775cb53f44754b03662cdf5b7881d P 065a105988a942f491122edf3c077f78: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 08:09:37.301154 14302 raft_consensus.cc:348] T 385775cb53f44754b03662cdf5b7881d P 065a105988a942f491122edf3c077f78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "893131f3f6a04ad38c7195af2c9faea3" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 37505 } } peers { permanent_uuid: "11361e0b0b5c43939a53524504de4c0f" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 36797 } } peers { permanent_uuid: "065a105988a942f491122edf3c077f78" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 43027 } }
I20260811 08:09:37.301285 14302 raft_consensus.cc:374] T 385775cb53f44754b03662cdf5b7881d P 065a105988a942f491122edf3c077f78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:09:37.301327 14302 raft_consensus.cc:729] T 385775cb53f44754b03662cdf5b7881d P 065a105988a942f491122edf3c077f78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 065a105988a942f491122edf3c077f78, State: Initialized, Role: FOLLOWER
I20260811 08:09:37.301463 14302 consensus_queue.cc:260] T 385775cb53f44754b03662cdf5b7881d P 065a105988a942f491122edf3c077f78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "893131f3f6a04ad38c7195af2c9faea3" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 37505 } } peers { permanent_uuid: "11361e0b0b5c43939a53524504de4c0f" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 36797 } } peers { permanent_uuid: "065a105988a942f491122edf3c077f78" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 43027 } }
I20260811 08:09:37.301568 14300 raft_consensus.cc:348] T 385775cb53f44754b03662cdf5b7881d P 893131f3f6a04ad38c7195af2c9faea3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "893131f3f6a04ad38c7195af2c9faea3" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 37505 } } peers { permanent_uuid: "11361e0b0b5c43939a53524504de4c0f" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 36797 } } peers { permanent_uuid: "065a105988a942f491122edf3c077f78" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 43027 } }
I20260811 08:09:37.301736 14300 raft_consensus.cc:374] T 385775cb53f44754b03662cdf5b7881d P 893131f3f6a04ad38c7195af2c9faea3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:09:37.301777 14300 raft_consensus.cc:729] T 385775cb53f44754b03662cdf5b7881d P 893131f3f6a04ad38c7195af2c9faea3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 893131f3f6a04ad38c7195af2c9faea3, State: Initialized, Role: FOLLOWER
I20260811 08:09:37.301853 14302 ts_tablet_manager.cc:1428] T 385775cb53f44754b03662cdf5b7881d P 065a105988a942f491122edf3c077f78: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 08:09:37.301908 14300 consensus_queue.cc:260] T 385775cb53f44754b03662cdf5b7881d P 893131f3f6a04ad38c7195af2c9faea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "893131f3f6a04ad38c7195af2c9faea3" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 37505 } } peers { permanent_uuid: "11361e0b0b5c43939a53524504de4c0f" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 36797 } } peers { permanent_uuid: "065a105988a942f491122edf3c077f78" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 43027 } }
I20260811 08:09:37.301970 14279 heartbeater.cc:503] Master 127.27.243.254:35843 was elected leader, sending a full tablet report...
I20260811 08:09:37.302211 14052 heartbeater.cc:503] Master 127.27.243.254:35843 was elected leader, sending a full tablet report...
I20260811 08:09:37.302201 14300 ts_tablet_manager.cc:1428] T 385775cb53f44754b03662cdf5b7881d P 893131f3f6a04ad38c7195af2c9faea3: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260811 08:09:37.302909 14319 tablet_bootstrap.cc:492] T 385775cb53f44754b03662cdf5b7881d P 11361e0b0b5c43939a53524504de4c0f: Bootstrap starting.
I20260811 08:09:37.303540 14319 tablet_bootstrap.cc:654] T 385775cb53f44754b03662cdf5b7881d P 11361e0b0b5c43939a53524504de4c0f: Neither blocks nor log segments found. Creating new log.
I20260811 08:09:37.303970 14319 log.cc:824] T 385775cb53f44754b03662cdf5b7881d P 11361e0b0b5c43939a53524504de4c0f: Log is configured to *not* fsync() on all Append() calls
I20260811 08:09:37.304648 14319 tablet_bootstrap.cc:492] T 385775cb53f44754b03662cdf5b7881d P 11361e0b0b5c43939a53524504de4c0f: No bootstrap required, opened a new log
I20260811 08:09:37.304713 14319 ts_tablet_manager.cc:1397] T 385775cb53f44754b03662cdf5b7881d P 11361e0b0b5c43939a53524504de4c0f: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 08:09:37.306334 14319 raft_consensus.cc:348] T 385775cb53f44754b03662cdf5b7881d P 11361e0b0b5c43939a53524504de4c0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "893131f3f6a04ad38c7195af2c9faea3" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 37505 } } peers { permanent_uuid: "11361e0b0b5c43939a53524504de4c0f" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 36797 } } peers { permanent_uuid: "065a105988a942f491122edf3c077f78" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 43027 } }
I20260811 08:09:37.306464 14319 raft_consensus.cc:374] T 385775cb53f44754b03662cdf5b7881d P 11361e0b0b5c43939a53524504de4c0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:09:37.306488 14319 raft_consensus.cc:729] T 385775cb53f44754b03662cdf5b7881d P 11361e0b0b5c43939a53524504de4c0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11361e0b0b5c43939a53524504de4c0f, State: Initialized, Role: FOLLOWER
I20260811 08:09:37.306567 14319 consensus_queue.cc:260] T 385775cb53f44754b03662cdf5b7881d P 11361e0b0b5c43939a53524504de4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "893131f3f6a04ad38c7195af2c9faea3" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 37505 } } peers { permanent_uuid: "11361e0b0b5c43939a53524504de4c0f" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 36797 } } peers { permanent_uuid: "065a105988a942f491122edf3c077f78" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 43027 } }
I20260811 08:09:37.306792 14319 ts_tablet_manager.cc:1428] T 385775cb53f44754b03662cdf5b7881d P 11361e0b0b5c43939a53524504de4c0f: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260811 08:09:37.306824 13830 heartbeater.cc:503] Master 127.27.243.254:35843 was elected leader, sending a full tablet report...
I20260811 08:09:37.339916 14315 raft_consensus.cc:482] T 385775cb53f44754b03662cdf5b7881d P 065a105988a942f491122edf3c077f78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:09:37.340055 14315 raft_consensus.cc:504] T 385775cb53f44754b03662cdf5b7881d P 065a105988a942f491122edf3c077f78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "893131f3f6a04ad38c7195af2c9faea3" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 37505 } } peers { permanent_uuid: "11361e0b0b5c43939a53524504de4c0f" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 36797 } } peers { permanent_uuid: "065a105988a942f491122edf3c077f78" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 43027 } }
I20260811 08:09:37.340433 14315 leader_election.cc:288] T 385775cb53f44754b03662cdf5b7881d P 065a105988a942f491122edf3c077f78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 893131f3f6a04ad38c7195af2c9faea3 (127.27.243.194:37505), 11361e0b0b5c43939a53524504de4c0f (127.27.243.193:36797)
I20260811 08:09:37.343098 14297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:37.340639 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.195:42877 (local address 127.27.243.193:36797)
0811 08:09:37.340685 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:37.340687 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:37.340695 (+ 8us) server_negotiation.cc:407] Connection header received
0811 08:09:37.340724 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:37.340724 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:37.340734 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:37.340806 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:09:37.340962 (+ 156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:37.341440 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:37.342393 (+ 953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:37.342773 (+ 380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:37.342843 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:37.342852 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 08:09:37.342996 (+ 144us) server_negotiation.cc:299] Negotiation successful
0811 08:09:37.343033 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 08:09:37.343092 14283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:37.340580 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.193:36797 (local address 127.27.243.195:42877)
0811 08:09:37.340621 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:37.340632 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:37.340671 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:37.340816 (+ 145us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:37.340818 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:37.340820 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:09:37.340894 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:37.340896 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:37.341534 (+ 638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:37.341535 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:37.342309 (+ 774us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:37.342311 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:37.342850 (+ 539us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:37.342852 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:37.342930 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:37.342933 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 08:09:37.342976 (+ 43us) client_negotiation.cc:240] Negotiation successful
0811 08:09:37.343017 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":23,"mutex_wait_us":30}
I20260811 08:09:37.343183 14296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:37.340671 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.195:43255 (local address 127.27.243.194:37505)
0811 08:09:37.340711 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:37.340713 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:37.340873 (+ 160us) server_negotiation.cc:407] Connection header received
0811 08:09:37.340906 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:37.340907 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:37.340917 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:37.340972 (+ 55us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:09:37.341108 (+ 136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:37.341588 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:37.342494 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:37.342887 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:37.342949 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:37.342956 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0811 08:09:37.343077 (+ 121us) server_negotiation.cc:299] Negotiation successful
0811 08:09:37.343114 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 08:09:37.343209 14327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:37.340580 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.194:37505 (local address 127.27.243.195:43255)
0811 08:09:37.340784 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:37.340791 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0811 08:09:37.340834 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:09:37.340986 (+ 152us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:09:37.340987 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:09:37.340988 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:09:37.341054 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:37.341055 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:37.341665 (+ 610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:37.341666 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:37.342416 (+ 750us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:09:37.342418 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:09:37.342960 (+ 542us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:09:37.342961 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:09:37.343020 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:37.343024 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 08:09:37.343067 (+ 43us) client_negotiation.cc:240] Negotiation successful
0811 08:09:37.343104 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":191,"mutex_wait_us":49,"thread_start_us":107,"threads_started":1}
I20260811 08:09:37.343508 13753 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "385775cb53f44754b03662cdf5b7881d" candidate_uuid: "065a105988a942f491122edf3c077f78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11361e0b0b5c43939a53524504de4c0f" is_pre_election: true
I20260811 08:09:37.343535 13975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "385775cb53f44754b03662cdf5b7881d" candidate_uuid: "065a105988a942f491122edf3c077f78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "893131f3f6a04ad38c7195af2c9faea3" is_pre_election: true
I20260811 08:09:37.343654 13753 raft_consensus.cc:2454] T 385775cb53f44754b03662cdf5b7881d P 11361e0b0b5c43939a53524504de4c0f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 065a105988a942f491122edf3c077f78 in term 0.
I20260811 08:09:37.343679 13975 raft_consensus.cc:2454] T 385775cb53f44754b03662cdf5b7881d P 893131f3f6a04ad38c7195af2c9faea3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 065a105988a942f491122edf3c077f78 in term 0.
I20260811 08:09:37.343901 14087 leader_election.cc:302] T 385775cb53f44754b03662cdf5b7881d P 065a105988a942f491122edf3c077f78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 065a105988a942f491122edf3c077f78, 893131f3f6a04ad38c7195af2c9faea3; no voters:
I20260811 08:09:37.344058 14315 raft_consensus.cc:2781] T 385775cb53f44754b03662cdf5b7881d P 065a105988a942f491122edf3c077f78 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 08:09:37.344112 14315 raft_consensus.cc:482] T 385775cb53f44754b03662cdf5b7881d P 065a105988a942f491122edf3c077f78 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 08:09:37.344126 14315 raft_consensus.cc:3037] T 385775cb53f44754b03662cdf5b7881d P 065a105988a942f491122edf3c077f78 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:09:37.344786 14315 raft_consensus.cc:504] T 385775cb53f44754b03662cdf5b7881d P 065a105988a942f491122edf3c077f78 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "893131f3f6a04ad38c7195af2c9faea3" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 37505 } } peers { permanent_uuid: "11361e0b0b5c43939a53524504de4c0f" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 36797 } } peers { permanent_uuid: "065a105988a942f491122edf3c077f78" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 43027 } }
I20260811 08:09:37.344931 14315 leader_election.cc:288] T 385775cb53f44754b03662cdf5b7881d P 065a105988a942f491122edf3c077f78 [CANDIDATE]: Term 1 election: Requested vote from peers 893131f3f6a04ad38c7195af2c9faea3 (127.27.243.194:37505), 11361e0b0b5c43939a53524504de4c0f (127.27.243.193:36797)
I20260811 08:09:37.345068 13753 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "385775cb53f44754b03662cdf5b7881d" candidate_uuid: "065a105988a942f491122edf3c077f78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11361e0b0b5c43939a53524504de4c0f"
I20260811 08:09:37.345069 13975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "385775cb53f44754b03662cdf5b7881d" candidate_uuid: "065a105988a942f491122edf3c077f78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "893131f3f6a04ad38c7195af2c9faea3"
I20260811 08:09:37.345139 13975 raft_consensus.cc:3037] T 385775cb53f44754b03662cdf5b7881d P 893131f3f6a04ad38c7195af2c9faea3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:09:37.345139 13753 raft_consensus.cc:3037] T 385775cb53f44754b03662cdf5b7881d P 11361e0b0b5c43939a53524504de4c0f [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:09:37.345979 13753 raft_consensus.cc:2454] T 385775cb53f44754b03662cdf5b7881d P 11361e0b0b5c43939a53524504de4c0f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 065a105988a942f491122edf3c077f78 in term 1.
I20260811 08:09:37.346001 13975 raft_consensus.cc:2454] T 385775cb53f44754b03662cdf5b7881d P 893131f3f6a04ad38c7195af2c9faea3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 065a105988a942f491122edf3c077f78 in term 1.
I20260811 08:09:37.346134 14087 leader_election.cc:302] T 385775cb53f44754b03662cdf5b7881d P 065a105988a942f491122edf3c077f78 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 065a105988a942f491122edf3c077f78, 893131f3f6a04ad38c7195af2c9faea3; no voters:
I20260811 08:09:37.346230 14315 raft_consensus.cc:2781] T 385775cb53f44754b03662cdf5b7881d P 065a105988a942f491122edf3c077f78 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:09:37.346382 14315 raft_consensus.cc:686] T 385775cb53f44754b03662cdf5b7881d P 065a105988a942f491122edf3c077f78 [term 1 LEADER]: Becoming Leader. State: Replica: 065a105988a942f491122edf3c077f78, State: Running, Role: LEADER
I20260811 08:09:37.346472 14315 consensus_queue.cc:237] T 385775cb53f44754b03662cdf5b7881d P 065a105988a942f491122edf3c077f78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "893131f3f6a04ad38c7195af2c9faea3" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 37505 } } peers { permanent_uuid: "11361e0b0b5c43939a53524504de4c0f" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 36797 } } peers { permanent_uuid: "065a105988a942f491122edf3c077f78" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 43027 } }
I20260811 08:09:37.347195 13501 catalog_manager.cc:5495] T 385775cb53f44754b03662cdf5b7881d P 065a105988a942f491122edf3c077f78 reported cstate change: term changed from 0 to 1, leader changed from <none> to 065a105988a942f491122edf3c077f78 (127.27.243.195). New cstate: current_term: 1 leader_uuid: "065a105988a942f491122edf3c077f78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "893131f3f6a04ad38c7195af2c9faea3" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 37505 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11361e0b0b5c43939a53524504de4c0f" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 36797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "065a105988a942f491122edf3c077f78" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 43027 } health_report { overall_health: HEALTHY } } }
W20260811 08:09:37.351152 14054 tablet.cc:2369] T 385775cb53f44754b03662cdf5b7881d P 893131f3f6a04ad38c7195af2c9faea3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 08:09:37.354465 14299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:37.352420 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47554 (local address 127.27.243.195:43027)
0811 08:09:37.352472 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 08:09:37.352473 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 08:09:37.352481 (+ 8us) server_negotiation.cc:407] Connection header received
0811 08:09:37.352510 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:09:37.352510 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:09:37.352526 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:09:37.352580 (+ 54us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:09:37.352672 (+ 92us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:37.353114 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:37.353879 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:09:37.354051 (+ 172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:09:37.354093 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:09:37.354184 (+ 91us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:09:37.354273 (+ 89us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:09:37.354324 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 08:09:37.354372 (+ 48us) server_negotiation.cc:299] Negotiation successful
0811 08:09:37.354387 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260811 08:09:37.356261 13975 raft_consensus.cc:1261] T 385775cb53f44754b03662cdf5b7881d P 893131f3f6a04ad38c7195af2c9faea3 [term 1 FOLLOWER]: Refusing update from remote peer 065a105988a942f491122edf3c077f78: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:09:37.356304 13753 raft_consensus.cc:1261] T 385775cb53f44754b03662cdf5b7881d P 11361e0b0b5c43939a53524504de4c0f [term 1 FOLLOWER]: Refusing update from remote peer 065a105988a942f491122edf3c077f78: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:09:37.356594 14315 consensus_queue.cc:1035] T 385775cb53f44754b03662cdf5b7881d P 065a105988a942f491122edf3c077f78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "893131f3f6a04ad38c7195af2c9faea3" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 37505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:09:37.356724 14329 consensus_queue.cc:1035] T 385775cb53f44754b03662cdf5b7881d P 065a105988a942f491122edf3c077f78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11361e0b0b5c43939a53524504de4c0f" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 36797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:09:37.359338 14338 mvcc.cc:205] Tried to move back new op lower bound from 7317240944048922624 to 7317240944011730944. Current Snapshot: MvccSnapshot[applied={T|T < 7317240944048922624}]
I20260811 08:09:37.359820 14336 mvcc.cc:205] Tried to move back new op lower bound from 7317240944048922624 to 7317240944011730944. Current Snapshot: MvccSnapshot[applied={T|T < 7317240944048922624}]
I20260811 08:09:37.361016 13502 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35624:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:09:37.361099 13502 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35624:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:09:37.361778 13502 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c3e05004e23d478994ab2b93864784fd: Sending DeleteTablet for 3 replicas of tablet 385775cb53f44754b03662cdf5b7881d
I20260811 08:09:37.362083 13947 tablet_service.cc:1514] Processing DeleteTablet for tablet 385775cb53f44754b03662cdf5b7881d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:09:37 UTC) from {username='kudu', principal='kudu/127.27.243.254@KRBTEST.COM'} at 127.0.0.1:33920
I20260811 08:09:37.362121 13711 tablet_service.cc:1514] Processing DeleteTablet for tablet 385775cb53f44754b03662cdf5b7881d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:09:37 UTC) from {username='kudu', principal='kudu/127.27.243.254@KRBTEST.COM'} at 127.0.0.1:40276
I20260811 08:09:37.362157 14172 tablet_service.cc:1514] Processing DeleteTablet for tablet 385775cb53f44754b03662cdf5b7881d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:09:37 UTC) from {username='kudu', principal='kudu/127.27.243.254@KRBTEST.COM'} at 127.0.0.1:47542
I20260811 08:09:37.362304 14352 tablet_replica.cc:330] T 385775cb53f44754b03662cdf5b7881d P 893131f3f6a04ad38c7195af2c9faea3: stopping tablet replica
I20260811 08:09:37.362370 14355 tablet_replica.cc:330] T 385775cb53f44754b03662cdf5b7881d P 065a105988a942f491122edf3c077f78: stopping tablet replica
I20260811 08:09:37.362394 14352 raft_consensus.cc:2229] T 385775cb53f44754b03662cdf5b7881d P 893131f3f6a04ad38c7195af2c9faea3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:09:37.362452 14355 raft_consensus.cc:2229] T 385775cb53f44754b03662cdf5b7881d P 065a105988a942f491122edf3c077f78 [term 1 LEADER]: Raft consensus shutting down.
I20260811 08:09:37.362481 14352 raft_consensus.cc:2258] T 385775cb53f44754b03662cdf5b7881d P 893131f3f6a04ad38c7195af2c9faea3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:09:37.362531 14355 raft_consensus.cc:2258] T 385775cb53f44754b03662cdf5b7881d P 065a105988a942f491122edf3c077f78 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:09:37.362854 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 13612
I20260811 08:09:37.362916 14352 ts_tablet_manager.cc:1905] T 385775cb53f44754b03662cdf5b7881d P 893131f3f6a04ad38c7195af2c9faea3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:09:37.362916 14355 ts_tablet_manager.cc:1905] T 385775cb53f44754b03662cdf5b7881d P 065a105988a942f491122edf3c077f78: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:09:37.364670 14355 ts_tablet_manager.cc:1918] T 385775cb53f44754b03662cdf5b7881d P 065a105988a942f491122edf3c077f78: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:09:37.364727 14355 log.cc:1196] T 385775cb53f44754b03662cdf5b7881d P 065a105988a942f491122edf3c077f78: Deleting WAL directory at /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435717191469-28623-0/minicluster-data/ts-2/wal/wals/385775cb53f44754b03662cdf5b7881d
I20260811 08:09:37.364712 14352 ts_tablet_manager.cc:1918] T 385775cb53f44754b03662cdf5b7881d P 893131f3f6a04ad38c7195af2c9faea3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:09:37.364789 14352 log.cc:1196] T 385775cb53f44754b03662cdf5b7881d P 893131f3f6a04ad38c7195af2c9faea3: Deleting WAL directory at /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435717191469-28623-0/minicluster-data/ts-1/wal/wals/385775cb53f44754b03662cdf5b7881d
I20260811 08:09:37.364948 14355 ts_tablet_manager.cc:1939] T 385775cb53f44754b03662cdf5b7881d P 065a105988a942f491122edf3c077f78: Deleting consensus metadata
I20260811 08:09:37.365144 14352 ts_tablet_manager.cc:1939] T 385775cb53f44754b03662cdf5b7881d P 893131f3f6a04ad38c7195af2c9faea3: Deleting consensus metadata
I20260811 08:09:37.365248 13471 catalog_manager.cc:4841] TS 065a105988a942f491122edf3c077f78 (127.27.243.195:43027): tablet 385775cb53f44754b03662cdf5b7881d (table test-table [id=fbdc03220e2b4a4aa456b194821dda94]) successfully deleted
I20260811 08:09:37.365583 13477 catalog_manager.cc:4841] TS 893131f3f6a04ad38c7195af2c9faea3 (127.27.243.194:37505): tablet 385775cb53f44754b03662cdf5b7881d (table test-table [id=fbdc03220e2b4a4aa456b194821dda94]) successfully deleted
W20260811 08:09:37.374672 13471 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.27.243.193:36797 (error 108)
I20260811 08:09:37.374912 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 13835
I20260811 08:09:37.384811 14298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:09:37.384650 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.193:36797 (local address 127.0.0.1:40292)
0811 08:09:37.384708 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0811 08:09:37.384774 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.193:36797: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260811 08:09:37.384994 13471 catalog_manager.cc:4584] TS 11361e0b0b5c43939a53524504de4c0f (127.27.243.193:36797): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 385775cb53f44754b03662cdf5b7881d: Network error: Client connection negotiation failed: client connection to 127.27.243.193:36797: connect: Connection refused (error 111)
I20260811 08:09:37.388540 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 14061
I20260811 08:09:37.399387 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 13450
2026-08-11T08:09:37Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (2066 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:09:37 dist-test-slave-7lbf krb5kdc[14361](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:09:37 dist-test-slave-7lbf krb5kdc[14361](info): set up 2 sockets
Aug 11 08:09:37 dist-test-slave-7lbf krb5kdc[14361](info): commencing operation
krb5kdc: starting...
W20260811 08:09:38.568222 28623 mini_kdc.cc:121] Time spent starting KDC: real 1.141s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/krb5kdc/test-user.keytab.
Aug 11 08:09:38 dist-test-slave-7lbf krb5kdc[14361](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435778, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:09:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:09:38Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.27.243.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.27.243.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.27.243.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/krb5kdc/rangeradmin_127.27.243.212@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.27.243.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/krb5kdc/rangeradmin_127.27.243.212@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.27.243.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.27.243.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.27.243.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/krb5kdc/rangerlookup_127.27.243.212@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.27.243.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/krb5kdc/rangerlookup_127.27.243.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.27.243.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.27.243.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.27.243.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/krb5kdc/HTTP_127.27.243.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.27.243.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/krb5kdc/HTTP_127.27.243.212@KRBTEST.COM.keytab.
I20260811 08:09:38.736266 28623 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-task0_GQGb/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/minicluster-data/postgres -l logfile start
2026-08-11 08:09:41.162 UTC [14420] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-11 08:09:41.162 UTC [14420] LOG: listening on IPv4 address "127.27.243.212", port 48647
2026-08-11 08:09:41.165 UTC [14420] LOG: listening on Unix socket "/tmp/.s.PGSQL.48647"
2026-08-11 08:09:41.194 UTC [14424] LOG: database system was shut down at 2026-08-11 08:09:39 UTC
2026-08-11 08:09:41.197 UTC [14420] LOG: database system is ready to accept connections
I20260811 08:09:42.291394 28623 mini_postgres.cc:96] Postgres bound to 48647
2026-08-11 08:09:42.298 UTC [14438] FATAL: database "slave" does not exist
127.27.243.212:48647 - accepting connections
I20260811 08:09:42.299618 28623 mini_ranger.cc:161] Starting Ranger...
I20260811 08:09:42.315104 28623 mini_ranger.cc:84] Created miniranger Postgres user
I20260811 08:09:42.747681 28623 mini_ranger.cc:87] Created ranger Postgres database
I20260811 08:09:42.747768 28623 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/minicluster-data/ranger-admin
2026-08-11 08:09:43,079 [I] DB FLAVOR :POSTGRES
2026-08-11 08:09:43,080 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 08:09:43,080 [I] Checking connection..
2026-08-11 08:09:43,080 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0_GQGb/build/release/bin/postgresql.jar:/tmp/dist-test-task0_GQGb/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.243.212:48647/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-11 08:09:43,341 [I] Checking connection passed.
2026-08-11 08:09:43,341 [I] --------- Verifying version history table ---------
2026-08-11 08:09:43,341 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0_GQGb/build/release/bin/postgresql.jar:/tmp/dist-test-task0_GQGb/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.243.212:48647/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 08:09:43,601 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 08:09:43,601 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0_GQGb/build/release/bin/postgresql.jar:/tmp/dist-test-task0_GQGb/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.243.212:48647/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 08:09:43,859 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 08:09:43,860 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-11 08:09:43,860 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0_GQGb/build/release/bin/postgresql.jar:/tmp/dist-test-task0_GQGb/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.243.212:48647/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-task0_GQGb/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-11 08:09:44.087 UTC [14539] WARNING: there is no transaction in progress
2026-08-11 08:09:44,094 [I] create_dbversion_catalog.sql file imported successfully
2026-08-11 08:09:44,095 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0_GQGb/build/release/bin/postgresql.jar:/tmp/dist-test-task0_GQGb/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.243.212:48647/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 08:09:44,340 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-11 08:09:44,341 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 08:09:44,341 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0_GQGb/build/release/bin/postgresql.jar:/tmp/dist-test-task0_GQGb/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.243.212:48647/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-11 08:09:44,609 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0_GQGb/build/release/bin/postgresql.jar:/tmp/dist-test-task0_GQGb/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.243.212:48647/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-11 08:09:44,856 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0_GQGb/build/release/bin/postgresql.jar:/tmp/dist-test-task0_GQGb/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.243.212:48647/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-7lbf.c.gcp-upstream.internal','N') ;"
2026-08-11 08:09:45,107 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0_GQGb/build/release/bin/postgresql.jar:/tmp/dist-test-task0_GQGb/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.243.212:48647/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 08:09:45,352 [I] Table x_portal_user does not exist in database ranger
2026-08-11 08:09:45,352 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0_GQGb/build/release/bin/postgresql.jar:/tmp/dist-test-task0_GQGb/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.243.212:48647/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 08:09:45,599 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-11 08:09:45,600 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0_GQGb/build/release/bin/postgresql.jar:/tmp/dist-test-task0_GQGb/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.243.212:48647/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 08:09:45,861 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0_GQGb/build/release/bin/postgresql.jar:/tmp/dist-test-task0_GQGb/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.243.212:48647/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 08:09:46,109 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-11 08:09:46,109 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0_GQGb/build/release/bin/postgresql.jar:/tmp/dist-test-task0_GQGb/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.243.212:48647/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-task0_GQGb/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-11 08:09:47.058 UTC [14735] WARNING: there is no transaction in progress
2026-08-11 08:09:47.074 UTC [14735] WARNING: there is no transaction in progress
2026-08-11 08:09:47.091 UTC [14735] WARNING: there is no transaction in progress
2026-08-11 08:09:47.107 UTC [14735] WARNING: there is no transaction in progress
2026-08-11 08:09:47.123 UTC [14735] WARNING: there is no transaction in progress
2026-08-11 08:09:47.141 UTC [14735] WARNING: there is no transaction in progress
2026-08-11 08:09:47.197 UTC [14735] WARNING: there is no transaction in progress
2026-08-11 08:09:47.204 UTC [14735] WARNING: there is no transaction in progress
2026-08-11 08:09:47.219 UTC [14735] WARNING: there is no transaction in progress
2026-08-11 08:09:47.229 UTC [14735] WARNING: there is no transaction in progress
2026-08-11 08:09:47.240 UTC [14735] WARNING: there is no transaction in progress
2026-08-11 08:09:47.254 UTC [14735] WARNING: there is no transaction in progress
2026-08-11 08:09:47.264 UTC [14735] WARNING: there is no transaction in progress
2026-08-11 08:09:47.270 UTC [14735] WARNING: there is no transaction in progress
2026-08-11 08:09:47.277 UTC [14735] WARNING: there is no transaction in progress
2026-08-11 08:09:47.283 UTC [14735] WARNING: there is no transaction in progress
2026-08-11 08:09:47,885 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-11 08:09:47,885 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0_GQGb/build/release/bin/postgresql.jar:/tmp/dist-test-task0_GQGb/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.243.212:48647/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-11 08:09:48,138 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-11 08:09:48,138 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0_GQGb/build/release/bin/postgresql.jar:/tmp/dist-test-task0_GQGb/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.243.212:48647/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 08:09:48,393 [I] Table x_portal_user already exists in database 'ranger'
2026-08-11 08:09:48,393 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0_GQGb/build/release/bin/postgresql.jar:/tmp/dist-test-task0_GQGb/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.243.212:48647/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 08:09:48,660 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-11 08:09:48,660 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0_GQGb/build/release/bin/postgresql.jar:/tmp/dist-test-task0_GQGb/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.243.212:48647/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 08:09:48,918 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0_GQGb/build/release/bin/postgresql.jar:/tmp/dist-test-task0_GQGb/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.243.212:48647/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 08:09:49,157 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0_GQGb/build/release/bin/postgresql.jar:/tmp/dist-test-task0_GQGb/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.243.212:48647/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-7lbf.c.gcp-upstream.internal';"
2026-08-11 08:09:49,389 [I] CORE_DB_SCHEMA import status has been updated
2026-08-11 08:09:49,389 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0_GQGb/build/release/bin/postgresql.jar:/tmp/dist-test-task0_GQGb/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.243.212:48647/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-11 08:09:49,643 [I] DB_PATCHES have already been applied
I20260811 08:09:49.649556 28623 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/minicluster-data/ranger-admin:/tmp/dist-test-task0_GQGb/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-task0_GQGb/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-task0_GQGb/build/release/bin/postgresql.jar:/tmp/dist-test-task0_GQGb/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260811 08:09:49.649636 28623 mini_ranger.cc:193] Using host: 127.27.243.212
I20260811 08:09:49.653592 28623 mini_ranger.cc:227] Ranger admin URL: http://127.27.243.212:35591
Aug 11, 2026 8:09:49 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 8:09:49 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 8:09:50 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/minicluster-data/ranger-admin/ews/webapp
Aug 11, 2026 8:09:50 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 11, 2026 8:09:50 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 11, 2026 8:09:50 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/minicluster-data/ranger-admin/ews/webapp].
Aug 11, 2026 8:09:50 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260811 08:09:50.934734 28623 mini_ranger.cc:160] Time spent starting Ranger: real 8.635s user 0.001s sys 0.010s
Aug 11, 2026 8:10:11 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 11, 2026 8:10:11 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 11, 2026 8:10:11 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 11, 2026 8:10:11 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 11, 2026 8:10:11 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 11, 2026 8:10:11 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 11, 2026 8:10:11 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 11, 2026 8:10:11 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 11, 2026 8:10:11 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 11, 2026 8:10:11 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 11, 2026 8:10:11 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 11, 2026 8:10:11 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 11, 2026 8:10:11 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 11, 2026 8:10:11 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 11, 2026 8:10:11 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 11, 2026 8:10:11 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 11, 2026 8:10:11 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 11, 2026 8:10:12 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260811 08:10:12.922955 28623 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.27.243.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.27.243.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.27.243.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/krb5kdc/rangerkms_127.27.243.212@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.27.243.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/krb5kdc/rangerkms_127.27.243.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.27.243.212@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.27.243.212@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.27.243.212@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/krb5kdc/HTTP_127.27.243.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.27.243.212@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/krb5kdc/HTTP_127.27.243.212@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 11 08:10:12 dist-test-slave-7lbf krb5kdc[14361](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435812, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260811 08:10:13.004938 28623 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260811 08:10:13.015283 28623 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260811 08:10:13.817068 28623 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260811 08:10:13.817157 28623 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/minicluster-data/ranger-kms
I20260811 08:10:13.817178 28623 mini_ranger_kms.cc:227] Using postgres at 127.27.243.212:48647
2026-08-11 08:10:13,999 [I] DB FLAVOR :POSTGRES
2026-08-11 08:10:13,999 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 08:10:13,999 [I] Checking connection
2026-08-11 08:10:13,999 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0_GQGb/build/release/bin/postgresql.jar:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.243.212:48647/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-11 08:10:14,236 [I] connection success
2026-08-11 08:10:14,237 [I] --------- Verifying Ranger DB tables ---------
2026-08-11 08:10:14,237 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-11 08:10:14,237 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0_GQGb/build/release/bin/postgresql.jar:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.243.212:48647/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-11 08:10:14,467 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-11 08:10:14,468 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 08:10:14,468 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-11 08:10:14,468 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0_GQGb/build/release/bin/postgresql.jar:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.243.212:48647/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-11 08:10:14,744 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260811 08:10:15.226398 28623 mini_ranger_kms.cc:310] Created kms service
I20260811 08:10:15.468842 28623 mini_ranger_kms.cc:326] Created kudu user
I20260811 08:10:15.514051 28623 mini_ranger_kms.cc:343] Created rangerkms user
Aug 11 08:10:15 dist-test-slave-7lbf krb5kdc[14361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435812, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.27.243.212@KRBTEST.COM
I20260811 08:10:15.910337 28623 mini_ranger_kms.cc:384] Added ranger policy
I20260811 08:10:15.910473 28623 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/minicluster-data/ranger-kms:/tmp/dist-test-task0_GQGb/build/release/bin/postgresql.jar:/tmp/dist-test-task0_GQGb/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-task0_GQGb/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260811 08:10:15.910498 28623 mini_ranger_kms.cc:240] Using host: 127.27.243.212
I20260811 08:10:15.914803 28623 mini_ranger_kms.cc:276] Ranger KMS PID: 15032
I20260811 08:10:15.914947 28623 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.27.243.212:35543
Aug 11, 2026 8:10:16 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 8:10:16 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 8:10:16 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 11, 2026 8:10:17 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 11, 2026 8:10:17 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/minicluster-data/ranger-kms/ews/webapp].
Aug 11, 2026 8:10:17 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 11 08:10:17 dist-test-slave-7lbf krb5kdc[14361](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786435817, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.27.243.212@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Aug 11 08:10:18 dist-test-slave-7lbf krb5kdc[14361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435817, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.27.243.212@KRBTEST.COM for HTTP/127.27.243.212@KRBTEST.COM
I20260811 08:10:18.518333 28623 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.513s user 0.013s sys 0.154s
I20260811 08:10:18.518441 28623 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260811 08:10:18.518514 28623 mini_ranger_kms.cc:401] 127.27.243.212:35543/kms/v1/keys
Aug 11 08:10:18 dist-test-slave-7lbf krb5kdc[14361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435817, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.27.243.212@KRBTEST.COM for HTTP/127.27.243.212@KRBTEST.COM
Aug 11 08:10:21 dist-test-slave-7lbf krb5kdc[14361](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435821, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.27.243.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.243.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.243.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab.
Entry for principal kudu/127.27.243.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab.
I20260811 08:10:21.184679 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.243.254:33959
--webserver_interface=127.27.243.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab
--principal=kudu/127.27.243.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:34551
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.243.254:33959
--ranger_config_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.27.243.212:35543/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:10:21.268954 15108 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:10:21.269161 15108 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:10:21.269182 15108 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:10:21.270375 15108 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:10:21.270418 15108 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:10:21.270431 15108 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:10:21.270443 15108 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:10:21.270467 15108 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:10:21.272101 15108 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:34551
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/minicluster-data/master-0/wal
--ranger_kms_url=127.27.243.212:35543/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.27.243.254:33959
--ranger_config_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab
--principal=kudu/127.27.243.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.243.254:33959
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.243.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15108
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:10:21.272333 15108 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:10:21.272534 15108 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:10:21.277143 15115 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:10:21.277153 15120 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:10:21.277237 15117 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:10:21.277385 15108 server_base.cc:1034] running on GCE node
I20260811 08:10:21.277721 15108 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:10:21.277988 15108 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:10:21.279134 15108 hybrid_clock.cc:648] HybridClock initialized: now 1786435821279112 us; error 39 us; skew 500 ppm
Aug 11 08:10:21 dist-test-slave-7lbf krb5kdc[14361](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435821, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:10:21.284633 15108 init.cc:377] Logged in from keytab as kudu/127.27.243.254@KRBTEST.COM (short username kudu)
I20260811 08:10:21.285087 15108 webserver.cc:460] Webserver started at http://127.27.243.254:34293/ using document root <none> and password file <none>
I20260811 08:10:21.285306 15108 fs_manager.cc:359] Metadata directory not provided
I20260811 08:10:21.285344 15108 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:10:21.285471 15108 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 08:10:21 dist-test-slave-7lbf krb5kdc[14361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435821, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.254@KRBTEST.COM for HTTP/127.27.243.212@KRBTEST.COM
I20260811 08:10:21.331964 15108 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/minicluster-data/master-0/data/instance:
uuid: "93eb52775b9341b2ab9115ecc11bbc9b"
format_stamp: "Formatted at 2026-08-11 08:10:21 on dist-test-slave-7lbf"
server_key: "ed88c773c7b2d4c012bab3dffa6c5e46"
server_key_iv: "a17b702e7ba7d13b77562644851c2598"
server_key_version: "kuduclusterkey@0"
I20260811 08:10:21.332392 15108 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/minicluster-data/master-0/wal/instance:
uuid: "93eb52775b9341b2ab9115ecc11bbc9b"
format_stamp: "Formatted at 2026-08-11 08:10:21 on dist-test-slave-7lbf"
server_key: "ed88c773c7b2d4c012bab3dffa6c5e46"
server_key_iv: "a17b702e7ba7d13b77562644851c2598"
server_key_version: "kuduclusterkey@0"
I20260811 08:10:21.333818 15108 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 08:10:21.345762 15136 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:10:21.345965 15108 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 08:10:21.346057 15108 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/minicluster-data/master-0/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/minicluster-data/master-0/wal
uuid: "93eb52775b9341b2ab9115ecc11bbc9b"
format_stamp: "Formatted at 2026-08-11 08:10:21 on dist-test-slave-7lbf"
server_key: "ed88c773c7b2d4c012bab3dffa6c5e46"
server_key_iv: "a17b702e7ba7d13b77562644851c2598"
server_key_version: "kuduclusterkey@0"
I20260811 08:10:21.346153 15108 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:10:21.358000 15108 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:10:21.359885 15108 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:10:21.360033 15108 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:10:21.364624 15108 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.254:33959
I20260811 08:10:21.364672 15233 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.254:33959 every 8 connection(s)
I20260811 08:10:21.365007 15108 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
I20260811 08:10:21.365831 15234 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:10:21.369200 15234 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 93eb52775b9341b2ab9115ecc11bbc9b: Bootstrap starting.
I20260811 08:10:21.369993 15234 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 93eb52775b9341b2ab9115ecc11bbc9b: Neither blocks nor log segments found. Creating new log.
I20260811 08:10:21.370328 15234 log.cc:824] T 00000000000000000000000000000000 P 93eb52775b9341b2ab9115ecc11bbc9b: Log is configured to *not* fsync() on all Append() calls
I20260811 08:10:21.371223 15234 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 93eb52775b9341b2ab9115ecc11bbc9b: No bootstrap required, opened a new log
I20260811 08:10:21.372200 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 15108
I20260811 08:10:21.372316 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/minicluster-data/master-0/wal/instance
I20260811 08:10:21.372498 28623 external_mini_cluster.cc:1428] Setting key c7a2ed59ed98feea389099f5d046746c
I20260811 08:10:21.374171 15234 raft_consensus.cc:348] T 00000000000000000000000000000000 P 93eb52775b9341b2ab9115ecc11bbc9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93eb52775b9341b2ab9115ecc11bbc9b" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 33959 } }
I20260811 08:10:21.374442 15234 raft_consensus.cc:374] T 00000000000000000000000000000000 P 93eb52775b9341b2ab9115ecc11bbc9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:10:21.374508 15234 raft_consensus.cc:729] T 00000000000000000000000000000000 P 93eb52775b9341b2ab9115ecc11bbc9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93eb52775b9341b2ab9115ecc11bbc9b, State: Initialized, Role: FOLLOWER
I20260811 08:10:21.374660 15234 consensus_queue.cc:260] T 00000000000000000000000000000000 P 93eb52775b9341b2ab9115ecc11bbc9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93eb52775b9341b2ab9115ecc11bbc9b" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 33959 } }
I20260811 08:10:21.374750 15234 raft_consensus.cc:388] T 00000000000000000000000000000000 P 93eb52775b9341b2ab9115ecc11bbc9b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:10:21.374817 15234 raft_consensus.cc:482] T 00000000000000000000000000000000 P 93eb52775b9341b2ab9115ecc11bbc9b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:10:21.374871 15234 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 93eb52775b9341b2ab9115ecc11bbc9b [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:10:21.375595 15234 raft_consensus.cc:504] T 00000000000000000000000000000000 P 93eb52775b9341b2ab9115ecc11bbc9b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93eb52775b9341b2ab9115ecc11bbc9b" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 33959 } }
I20260811 08:10:21.375712 15234 leader_election.cc:302] T 00000000000000000000000000000000 P 93eb52775b9341b2ab9115ecc11bbc9b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 93eb52775b9341b2ab9115ecc11bbc9b; no voters:
I20260811 08:10:21.375917 15234 leader_election.cc:288] T 00000000000000000000000000000000 P 93eb52775b9341b2ab9115ecc11bbc9b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:10:21.375963 15239 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 93eb52775b9341b2ab9115ecc11bbc9b [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:10:21.376390 15234 sys_catalog.cc:564] T 00000000000000000000000000000000 P 93eb52775b9341b2ab9115ecc11bbc9b [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:10:21.377130 15239 raft_consensus.cc:686] T 00000000000000000000000000000000 P 93eb52775b9341b2ab9115ecc11bbc9b [term 1 LEADER]: Becoming Leader. State: Replica: 93eb52775b9341b2ab9115ecc11bbc9b, State: Running, Role: LEADER
I20260811 08:10:21.377293 15239 consensus_queue.cc:237] T 00000000000000000000000000000000 P 93eb52775b9341b2ab9115ecc11bbc9b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93eb52775b9341b2ab9115ecc11bbc9b" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 33959 } }
I20260811 08:10:21.377698 15239 sys_catalog.cc:455] T 00000000000000000000000000000000 P 93eb52775b9341b2ab9115ecc11bbc9b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 93eb52775b9341b2ab9115ecc11bbc9b. Latest consensus state: current_term: 1 leader_uuid: "93eb52775b9341b2ab9115ecc11bbc9b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93eb52775b9341b2ab9115ecc11bbc9b" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 33959 } } }
I20260811 08:10:21.377863 15239 sys_catalog.cc:458] T 00000000000000000000000000000000 P 93eb52775b9341b2ab9115ecc11bbc9b [sys.catalog]: This master's current role is: LEADER
I20260811 08:10:21.378180 15253 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:10:21.378769 15253 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:10:21.379304 15234 ranger_client.cc:318] Using new properties file: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260811 08:10:21.379956 15240 sys_catalog.cc:455] T 00000000000000000000000000000000 P 93eb52775b9341b2ab9115ecc11bbc9b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "93eb52775b9341b2ab9115ecc11bbc9b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93eb52775b9341b2ab9115ecc11bbc9b" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 33959 } } }
I20260811 08:10:21.380095 15240 sys_catalog.cc:458] T 00000000000000000000000000000000 P 93eb52775b9341b2ab9115ecc11bbc9b [sys.catalog]: This master's current role is: LEADER
Aug 11 08:10:21 dist-test-slave-7lbf krb5kdc[14361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435821, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.243.254@KRBTEST.COM
I20260811 08:10:21.387315 15253 catalog_manager.cc:1347] Generated new cluster ID: d160bb886244410eac714be6cdb2def5
I20260811 08:10:21.387447 15253 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:10:21.388391 15238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:10:21.373003 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37798 (local address 127.27.243.254:33959)
0811 08:10:21.373187 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0811 08:10:21.373197 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 08:10:21.373228 (+ 31us) server_negotiation.cc:407] Connection header received
0811 08:10:21.374142 (+ 914us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:10:21.374151 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:10:21.374208 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:10:21.374360 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:10:21.375083 (+ 723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:10:21.376157 (+ 1074us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:10:21.376996 (+ 839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:10:21.377673 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:10:21.377779 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:10:21.380747 (+ 2968us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:10:21.380751 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:10:21.380751 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:10:21.380763 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:10:21.385255 (+ 4492us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:10:21.385868 (+ 613us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:10:21.385871 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:10:21.385872 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:10:21.386047 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:10:21.386292 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:10:21.386293 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:10:21.386294 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:10:21.386935 (+ 641us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:10:21.387507 (+ 572us) server_negotiation.cc:1035] Waiting for connection context
0811 08:10:21.387612 (+ 105us) server_negotiation.cc:299] Negotiation successful
0811 08:10:21.387937 (+ 325us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":138,"thread_start_us":71,"threads_started":1}
I20260811 08:10:21.397485 15253 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:10:21.398542 15253 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:10:21.402273 15253 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 93eb52775b9341b2ab9115ecc11bbc9b: Generated new TSK 0
I20260811 08:10:21.402518 15253 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.27.243.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.243.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.243.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.193.keytab.
Entry for principal kudu/127.27.243.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.193.keytab.
I20260811 08:10:22.192384 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.27.243.212:35543/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.243.193:0
--local_ip_for_outbound_sockets=127.27.243.193
--webserver_interface=127.27.243.193
--webserver_port=0
--tserver_master_addrs=127.27.243.254:33959
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.193.keytab
--principal=kudu/127.27.243.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:34551
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:10:22.305130 15300 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:10:22.305502 15300 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:10:22.305624 15300 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:10:22.307359 15300 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:10:22.307480 15300 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:10:22.307569 15300 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.243.193
I20260811 08:10:22.309846 15300 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:34551
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.27.243.212:35543/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.193.keytab
--principal=kudu/127.27.243.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.243.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.243.193
--webserver_port=0
--tserver_master_addrs=127.27.243.254:33959
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15300
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.243.193
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:10:22.310089 15300 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:10:22.310341 15300 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:10:22.315737 15315 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:10:22.315944 15314 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:10:22.316123 15300 server_base.cc:1034] running on GCE node
W20260811 08:10:22.316165 15317 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:10:22.316390 15300 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:10:22.316634 15300 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:10:22.317836 15300 hybrid_clock.cc:648] HybridClock initialized: now 1786435822317769 us; error 34 us; skew 500 ppm
Aug 11 08:10:22 dist-test-slave-7lbf krb5kdc[14361](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435822, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:10:22.320923 15300 init.cc:377] Logged in from keytab as kudu/127.27.243.193@KRBTEST.COM (short username kudu)
I20260811 08:10:22.321446 15300 webserver.cc:460] Webserver started at http://127.27.243.193:36975/ using document root <none> and password file <none>
I20260811 08:10:22.321725 15300 fs_manager.cc:359] Metadata directory not provided
I20260811 08:10:22.321801 15300 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:10:22.321943 15300 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 08:10:22 dist-test-slave-7lbf krb5kdc[14361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435822, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.193@KRBTEST.COM for HTTP/127.27.243.212@KRBTEST.COM
I20260811 08:10:22.336601 15300 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/minicluster-data/ts-0/data/instance:
uuid: "0d2a40a472884975987cf4a45569b6cf"
format_stamp: "Formatted at 2026-08-11 08:10:22 on dist-test-slave-7lbf"
server_key: "4fe2a3bcd00fe31306e8135e0e48bfd2"
server_key_iv: "6facc68b38e8d5b3183386436027f383"
server_key_version: "kuduclusterkey@0"
I20260811 08:10:22.337144 15300 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/minicluster-data/ts-0/wal/instance:
uuid: "0d2a40a472884975987cf4a45569b6cf"
format_stamp: "Formatted at 2026-08-11 08:10:22 on dist-test-slave-7lbf"
server_key: "4fe2a3bcd00fe31306e8135e0e48bfd2"
server_key_iv: "6facc68b38e8d5b3183386436027f383"
server_key_version: "kuduclusterkey@0"
I20260811 08:10:22.339396 15300 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260811 08:10:22.357690 15327 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:10:22.358022 15300 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.001s sys 0.000s
I20260811 08:10:22.358150 15300 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/minicluster-data/ts-0/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/minicluster-data/ts-0/wal
uuid: "0d2a40a472884975987cf4a45569b6cf"
format_stamp: "Formatted at 2026-08-11 08:10:22 on dist-test-slave-7lbf"
server_key: "4fe2a3bcd00fe31306e8135e0e48bfd2"
server_key_iv: "6facc68b38e8d5b3183386436027f383"
server_key_version: "kuduclusterkey@0"
I20260811 08:10:22.358254 15300 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:10:22.376040 15300 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:10:22.379938 15300 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:10:22.380151 15300 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:10:22.380458 15300 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:10:22.380898 15300 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:10:22.380985 15300 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:10:22.381045 15300 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:10:22.381090 15300 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:10:22.387310 15300 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.193:34819
I20260811 08:10:22.387691 15300 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/minicluster-data/ts-0/data/info.pb
I20260811 08:10:22.389452 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 15300
I20260811 08:10:22.389580 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/minicluster-data/ts-0/wal/instance
I20260811 08:10:22.389810 28623 external_mini_cluster.cc:1428] Setting key 65c88996fa25c9392cc23974246295f8
I20260811 08:10:22.392140 15514 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.193:34819 every 8 connection(s)
Aug 11 08:10:22 dist-test-slave-7lbf krb5kdc[14361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435822, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.193@KRBTEST.COM for kudu/127.27.243.254@KRBTEST.COM
I20260811 08:10:22.406286 15524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:10:22.392823 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:33959 (local address 127.27.243.193:59809)
0811 08:10:22.393315 (+ 492us) negotiation.cc:107] Waiting for socket to connect
0811 08:10:22.393366 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0811 08:10:22.394053 (+ 687us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:10:22.396109 (+ 2056us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:10:22.396114 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:10:22.396392 (+ 278us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:10:22.396694 (+ 302us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:10:22.396702 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:10:22.397787 (+ 1085us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:10:22.397788 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:10:22.399096 (+ 1308us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:10:22.399099 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:10:22.399652 (+ 553us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:10:22.399654 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:10:22.399828 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:10:22.400456 (+ 628us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:10:22.400467 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:10:22.402257 (+ 1790us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:10:22.404445 (+ 2188us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:10:22.404452 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:10:22.404454 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:10:22.404752 (+ 298us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:10:22.405017 (+ 265us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:10:22.405018 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:10:22.405018 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:10:22.405176 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:10:22.405507 (+ 331us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:10:22.405548 (+ 41us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:10:22.405729 (+ 181us) client_negotiation.cc:769] Sending connection context
0811 08:10:22.405861 (+ 132us) client_negotiation.cc:240] Negotiation successful
0811 08:10:22.406038 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":442,"thread_start_us":84,"threads_started":1}
I20260811 08:10:22.407223 15525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:10:22.393125 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.193:59809 (local address 127.27.243.254:33959)
0811 08:10:22.395725 (+ 2600us) server_negotiation.cc:206] Beginning negotiation
0811 08:10:22.395727 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:10:22.395737 (+ 10us) server_negotiation.cc:407] Connection header received
0811 08:10:22.395763 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:10:22.395764 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:10:22.395776 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:10:22.395850 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:10:22.396853 (+ 1003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:10:22.397673 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:10:22.399199 (+ 1526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:10:22.399505 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:10:22.399576 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:10:22.402535 (+ 2959us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:10:22.402536 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:10:22.402537 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:10:22.402544 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:10:22.404351 (+ 1807us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:10:22.404867 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:10:22.404869 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:10:22.404869 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:10:22.404942 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:10:22.405262 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:10:22.405263 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:10:22.405264 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:10:22.405408 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:10:22.405477 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 08:10:22.407037 (+ 1560us) server_negotiation.cc:299] Negotiation successful
0811 08:10:22.407127 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2565,"thread_start_us":74,"threads_started":1}
WARNING: no policy specified for kudu/127.27.243.194@KRBTEST.COM; defaulting to no policy
I20260811 08:10:22.407984 15515 heartbeater.cc:347] Connected to a master server at 127.27.243.254:33959
I20260811 08:10:22.408094 15515 heartbeater.cc:464] Registering TS with master...
I20260811 08:10:22.408304 15515 heartbeater.cc:511] Master 127.27.243.254:33959 requested a full tablet report, sending...
I20260811 08:10:22.408875 15176 ts_manager.cc:194] Registered new tserver with Master: 0d2a40a472884975987cf4a45569b6cf (127.27.243.193:34819)
I20260811 08:10:22.409718 15176 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.243.193@KRBTEST.COM'} at 127.27.243.193:59809
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.243.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.243.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.194.keytab.
Entry for principal kudu/127.27.243.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.194.keytab.
I20260811 08:10:22.429626 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.27.243.212:35543/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.243.194:0
--local_ip_for_outbound_sockets=127.27.243.194
--webserver_interface=127.27.243.194
--webserver_port=0
--tserver_master_addrs=127.27.243.254:33959
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.194.keytab
--principal=kudu/127.27.243.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:34551
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:10:22.563129 15528 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:10:22.563495 15528 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:10:22.563591 15528 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:10:22.565371 15528 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:10:22.565480 15528 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:10:22.565589 15528 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.243.194
I20260811 08:10:22.567859 15528 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:34551
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.27.243.212:35543/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.194.keytab
--principal=kudu/127.27.243.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.243.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.243.194
--webserver_port=0
--tserver_master_addrs=127.27.243.254:33959
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15528
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.243.194
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:10:22.568400 15528 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:10:22.568748 15528 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:10:22.574517 15539 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:10:22.574527 15540 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:10:22.574752 15542 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:10:22.575146 15528 server_base.cc:1034] running on GCE node
I20260811 08:10:22.575338 15528 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:10:22.575575 15528 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:10:22.576761 15528 hybrid_clock.cc:648] HybridClock initialized: now 1786435822576743 us; error 31 us; skew 500 ppm
Aug 11 08:10:22 dist-test-slave-7lbf krb5kdc[14361](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435822, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:10:22.579563 15528 init.cc:377] Logged in from keytab as kudu/127.27.243.194@KRBTEST.COM (short username kudu)
I20260811 08:10:22.579967 15528 webserver.cc:460] Webserver started at http://127.27.243.194:46239/ using document root <none> and password file <none>
I20260811 08:10:22.580193 15528 fs_manager.cc:359] Metadata directory not provided
I20260811 08:10:22.580242 15528 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:10:22.580374 15528 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 08:10:22 dist-test-slave-7lbf krb5kdc[14361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435822, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.194@KRBTEST.COM for HTTP/127.27.243.212@KRBTEST.COM
I20260811 08:10:22.601986 15528 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/minicluster-data/ts-1/data/instance:
uuid: "eb580b85f3574afeb640014c5a2eb9fd"
format_stamp: "Formatted at 2026-08-11 08:10:22 on dist-test-slave-7lbf"
server_key: "9e3d1b095799f3903695a1691251ab76"
server_key_iv: "a4bc456cbba919100a6c654e534c764d"
server_key_version: "kuduclusterkey@0"
I20260811 08:10:22.602488 15528 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/minicluster-data/ts-1/wal/instance:
uuid: "eb580b85f3574afeb640014c5a2eb9fd"
format_stamp: "Formatted at 2026-08-11 08:10:22 on dist-test-slave-7lbf"
server_key: "9e3d1b095799f3903695a1691251ab76"
server_key_iv: "a4bc456cbba919100a6c654e534c764d"
server_key_version: "kuduclusterkey@0"
I20260811 08:10:22.612375 15528 fs_manager.cc:691] Time spent creating directory manager: real 0.010s user 0.003s sys 0.000s
Aug 11 08:10:22 dist-test-slave-7lbf krb5kdc[14361](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786435822, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:10:22.632982 15557 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:10:22.633180 15528 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.001s sys 0.000s
I20260811 08:10:22.633296 15528 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/minicluster-data/ts-1/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/minicluster-data/ts-1/wal
uuid: "eb580b85f3574afeb640014c5a2eb9fd"
format_stamp: "Formatted at 2026-08-11 08:10:22 on dist-test-slave-7lbf"
server_key: "9e3d1b095799f3903695a1691251ab76"
server_key_iv: "a4bc456cbba919100a6c654e534c764d"
server_key_version: "kuduclusterkey@0"
I20260811 08:10:22.633402 15528 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:10:22.650249 15528 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:10:22.652688 15528 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:10:22.652848 15528 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:10:22.653116 15528 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:10:22.653565 15528 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:10:22.653621 15528 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:10:22.653657 15528 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:10:22.653678 15528 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:10:22.669369 15528 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.194:41243
I20260811 08:10:22.669499 15736 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.194:41243 every 8 connection(s)
I20260811 08:10:22.669983 15528 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/minicluster-data/ts-1/data/info.pb
Aug 11 08:10:22 dist-test-slave-7lbf krb5kdc[14361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435822, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.194@KRBTEST.COM for kudu/127.27.243.254@KRBTEST.COM
I20260811 08:10:22.678224 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 15528
I20260811 08:10:22.678345 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/minicluster-data/ts-1/wal/instance
I20260811 08:10:22.678534 28623 external_mini_cluster.cc:1428] Setting key b41731237db3d9ba1cbf8b43387b815c
I20260811 08:10:22.683661 15525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:10:22.670956 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.194:58637 (local address 127.27.243.254:33959)
0811 08:10:22.671026 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0811 08:10:22.671028 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:10:22.671406 (+ 378us) server_negotiation.cc:407] Connection header received
0811 08:10:22.672184 (+ 778us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:10:22.672185 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:10:22.672204 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:10:22.672253 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:10:22.673077 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:10:22.673649 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:10:22.674767 (+ 1118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:10:22.674988 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:10:22.675058 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:10:22.677652 (+ 2594us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:10:22.677654 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:10:22.677654 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:10:22.677663 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:10:22.679833 (+ 2170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:10:22.682525 (+ 2692us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:10:22.682526 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:10:22.682527 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:10:22.682594 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:10:22.682878 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:10:22.682879 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:10:22.682880 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:10:22.683021 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:10:22.683072 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 08:10:22.683470 (+ 398us) server_negotiation.cc:299] Negotiation successful
0811 08:10:22.683566 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 08:10:22.683852 15744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:10:22.670949 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:33959 (local address 127.27.243.194:58637)
0811 08:10:22.671235 (+ 286us) negotiation.cc:107] Waiting for socket to connect
0811 08:10:22.671289 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0811 08:10:22.672074 (+ 785us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:10:22.672351 (+ 277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:10:22.672356 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:10:22.672673 (+ 317us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:10:22.672975 (+ 302us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:10:22.672981 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:10:22.673738 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:10:22.673740 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:10:22.674674 (+ 934us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:10:22.674676 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:10:22.675136 (+ 460us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:10:22.675137 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:10:22.675293 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:10:22.675893 (+ 600us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:10:22.675902 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:10:22.677486 (+ 1584us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:10:22.682096 (+ 4610us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:10:22.682105 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:10:22.682107 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:10:22.682421 (+ 314us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:10:22.682670 (+ 249us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:10:22.682671 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:10:22.682671 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:10:22.682797 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:10:22.683129 (+ 332us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:10:22.683137 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:10:22.683316 (+ 179us) client_negotiation.cc:769] Sending connection context
0811 08:10:22.683435 (+ 119us) client_negotiation.cc:240] Negotiation successful
0811 08:10:22.683581 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":223,"thread_start_us":146,"threads_started":1}
I20260811 08:10:22.684294 15738 heartbeater.cc:347] Connected to a master server at 127.27.243.254:33959
I20260811 08:10:22.684394 15738 heartbeater.cc:464] Registering TS with master...
I20260811 08:10:22.684585 15738 heartbeater.cc:511] Master 127.27.243.254:33959 requested a full tablet report, sending...
I20260811 08:10:22.684954 15176 ts_manager.cc:194] Registered new tserver with Master: eb580b85f3574afeb640014c5a2eb9fd (127.27.243.194:41243)
I20260811 08:10:22.685415 15176 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.243.194@KRBTEST.COM'} at 127.27.243.194:58637
WARNING: no policy specified for kudu/127.27.243.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.243.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.243.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.195.keytab.
Entry for principal kudu/127.27.243.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.195.keytab.
I20260811 08:10:22.708210 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.27.243.212:35543/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.243.195:0
--local_ip_for_outbound_sockets=127.27.243.195
--webserver_interface=127.27.243.195
--webserver_port=0
--tserver_master_addrs=127.27.243.254:33959
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.195.keytab
--principal=kudu/127.27.243.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:34551
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:10:22.825469 15751 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:10:22.825752 15751 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:10:22.825784 15751 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:10:22.826930 15751 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:10:22.826970 15751 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:10:22.827004 15751 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.243.195
I20260811 08:10:22.828805 15751 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:34551
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.27.243.212:35543/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.195.keytab
--principal=kudu/127.27.243.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.243.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.243.195
--webserver_port=0
--tserver_master_addrs=127.27.243.254:33959
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15751
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.243.195
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:10:22.829056 15751 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:10:22.829326 15751 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:10:22.834578 15766 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:10:22.834812 15759 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:10:22.834947 15761 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:10:22.835088 15751 server_base.cc:1034] running on GCE node
I20260811 08:10:22.835284 15751 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:10:22.835512 15751 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:10:22.836663 15751 hybrid_clock.cc:648] HybridClock initialized: now 1786435822836649 us; error 25 us; skew 500 ppm
Aug 11 08:10:22 dist-test-slave-7lbf krb5kdc[14361](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435822, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:10:22.839912 15751 init.cc:377] Logged in from keytab as kudu/127.27.243.195@KRBTEST.COM (short username kudu)
I20260811 08:10:22.840346 15751 webserver.cc:460] Webserver started at http://127.27.243.195:33447/ using document root <none> and password file <none>
I20260811 08:10:22.840615 15751 fs_manager.cc:359] Metadata directory not provided
I20260811 08:10:22.840672 15751 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:10:22.840797 15751 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 08:10:22 dist-test-slave-7lbf krb5kdc[14361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435822, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.195@KRBTEST.COM for HTTP/127.27.243.212@KRBTEST.COM
I20260811 08:10:22.859290 15751 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/minicluster-data/ts-2/data/instance:
uuid: "d1c4f3e4ef6f4242a6deb81c5d4e703a"
format_stamp: "Formatted at 2026-08-11 08:10:22 on dist-test-slave-7lbf"
server_key: "166cd0e53f08e2e6521e13f6e6549c58"
server_key_iv: "c53235abfc3520595b1ec0279c5c081b"
server_key_version: "kuduclusterkey@0"
I20260811 08:10:22.859766 15751 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/minicluster-data/ts-2/wal/instance:
uuid: "d1c4f3e4ef6f4242a6deb81c5d4e703a"
format_stamp: "Formatted at 2026-08-11 08:10:22 on dist-test-slave-7lbf"
server_key: "166cd0e53f08e2e6521e13f6e6549c58"
server_key_iv: "c53235abfc3520595b1ec0279c5c081b"
server_key_version: "kuduclusterkey@0"
I20260811 08:10:22.863638 15751 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260811 08:10:22.880318 15780 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:10:22.880518 15751 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260811 08:10:22.880638 15751 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/minicluster-data/ts-2/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/minicluster-data/ts-2/wal
uuid: "d1c4f3e4ef6f4242a6deb81c5d4e703a"
format_stamp: "Formatted at 2026-08-11 08:10:22 on dist-test-slave-7lbf"
server_key: "166cd0e53f08e2e6521e13f6e6549c58"
server_key_iv: "c53235abfc3520595b1ec0279c5c081b"
server_key_version: "kuduclusterkey@0"
I20260811 08:10:22.880762 15751 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:10:22.907387 15751 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:10:22.910926 15751 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:10:22.911091 15751 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:10:22.911339 15751 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:10:22.911720 15751 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:10:22.911772 15751 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:10:22.911805 15751 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:10:22.911823 15751 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:10:22.919077 15751 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.195:39781
I20260811 08:10:22.919649 15751 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/minicluster-data/ts-2/data/info.pb
I20260811 08:10:22.920710 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 15751
I20260811 08:10:22.920825 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/minicluster-data/ts-2/wal/instance
I20260811 08:10:22.921038 28623 external_mini_cluster.cc:1428] Setting key 3c46facf1522c8cc783439dccc7eb672
I20260811 08:10:22.928269 15977 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.195:39781 every 8 connection(s)
Aug 11 08:10:22 dist-test-slave-7lbf krb5kdc[14361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435822, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.195@KRBTEST.COM for kudu/127.27.243.254@KRBTEST.COM
I20260811 08:10:22.940479 15525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:10:22.929284 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.195:41285 (local address 127.27.243.254:33959)
0811 08:10:22.929339 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 08:10:22.929341 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:10:22.929709 (+ 368us) server_negotiation.cc:407] Connection header received
0811 08:10:22.930425 (+ 716us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:10:22.930426 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:10:22.930438 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:10:22.930469 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:10:22.931369 (+ 900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:10:22.932150 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:10:22.934302 (+ 2152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:10:22.934595 (+ 293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:10:22.934644 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:10:22.937181 (+ 2537us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:10:22.937183 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:10:22.937183 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:10:22.937190 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:10:22.938858 (+ 1668us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:10:22.939362 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:10:22.939363 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:10:22.939363 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:10:22.939428 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:10:22.939717 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:10:22.939718 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:10:22.939718 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:10:22.939855 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:10:22.939900 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0811 08:10:22.940287 (+ 387us) server_negotiation.cc:299] Negotiation successful
0811 08:10:22.940388 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260811 08:10:22.941228 15981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:10:22.928975 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:33959 (local address 127.27.243.195:41285)
0811 08:10:22.929566 (+ 591us) negotiation.cc:107] Waiting for socket to connect
0811 08:10:22.929614 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0811 08:10:22.930287 (+ 673us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:10:22.930682 (+ 395us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:10:22.930687 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:10:22.930953 (+ 266us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:10:22.931237 (+ 284us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:10:22.931244 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:10:22.932844 (+ 1600us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:10:22.932846 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:10:22.934180 (+ 1334us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:10:22.934184 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:10:22.934741 (+ 557us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:10:22.934742 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:10:22.934913 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:10:22.935418 (+ 505us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:10:22.935429 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:10:22.937073 (+ 1644us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:10:22.938956 (+ 1883us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:10:22.938963 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:10:22.938965 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:10:22.939252 (+ 287us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:10:22.939499 (+ 247us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:10:22.939500 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:10:22.939501 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:10:22.939635 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:10:22.939949 (+ 314us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:10:22.939956 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:10:22.940123 (+ 167us) client_negotiation.cc:769] Sending connection context
0811 08:10:22.940818 (+ 695us) client_negotiation.cc:240] Negotiation successful
0811 08:10:22.940982 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":519,"thread_start_us":102,"threads_started":1}
I20260811 08:10:22.942021 15978 heartbeater.cc:347] Connected to a master server at 127.27.243.254:33959
I20260811 08:10:22.942121 15978 heartbeater.cc:464] Registering TS with master...
I20260811 08:10:22.942324 15978 heartbeater.cc:511] Master 127.27.243.254:33959 requested a full tablet report, sending...
I20260811 08:10:22.942735 15176 ts_manager.cc:194] Registered new tserver with Master: d1c4f3e4ef6f4242a6deb81c5d4e703a (127.27.243.195:39781)
I20260811 08:10:22.943225 15176 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.243.195@KRBTEST.COM'} at 127.27.243.195:41285
I20260811 08:10:22.944634 28623 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 08:10:22.954528 15525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:10:22.946508 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37812 (local address 127.27.243.254:33959)
0811 08:10:22.946550 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 08:10:22.946551 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 08:10:22.946862 (+ 311us) server_negotiation.cc:407] Connection header received
0811 08:10:22.946953 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:10:22.946954 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:10:22.946964 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:10:22.946992 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:10:22.947766 (+ 774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:10:22.948537 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:10:22.949782 (+ 1245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:10:22.950077 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:10:22.950122 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:10:22.951676 (+ 1554us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:10:22.951677 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:10:22.951678 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:10:22.951684 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:10:22.953260 (+ 1576us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:10:22.953693 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:10:22.953694 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:10:22.953695 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:10:22.953751 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:10:22.953961 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:10:22.953962 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:10:22.953963 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:10:22.954081 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:10:22.954149 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 08:10:22.954368 (+ 219us) server_negotiation.cc:299] Negotiation successful
0811 08:10:22.954443 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 08:10:22.956655 15176 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37812:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 08:10:22.958984 15176 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 08:10:22.967170 15998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:10:22.961861 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.195:39781 (local address 127.0.0.1:36038)
0811 08:10:22.962066 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0811 08:10:22.962105 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 08:10:22.962168 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:10:22.962815 (+ 647us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:10:22.962819 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:10:22.962821 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:10:22.962892 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:10:22.962894 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:10:22.964158 (+ 1264us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:10:22.964159 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:10:22.965624 (+ 1465us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:10:22.965627 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:10:22.966653 (+ 1026us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:10:22.966654 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:10:22.966743 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:10:22.966762 (+ 19us) client_negotiation.cc:769] Sending connection context
0811 08:10:22.967022 (+ 260us) client_negotiation.cc:240] Negotiation successful
0811 08:10:22.967089 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":87,"threads_started":1}
I20260811 08:10:22.967501 16000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:10:22.962072 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36038 (local address 127.27.243.195:39781)
0811 08:10:22.962332 (+ 260us) server_negotiation.cc:206] Beginning negotiation
0811 08:10:22.962337 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 08:10:22.962349 (+ 12us) server_negotiation.cc:407] Connection header received
0811 08:10:22.962608 (+ 259us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:10:22.962611 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:10:22.962633 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:10:22.962787 (+ 154us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:10:22.962984 (+ 197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:10:22.964061 (+ 1077us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:10:22.965736 (+ 1675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:10:22.966516 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:10:22.966662 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:10:22.966897 (+ 235us) server_negotiation.cc:1035] Waiting for connection context
0811 08:10:22.967369 (+ 472us) server_negotiation.cc:299] Negotiation successful
0811 08:10:22.967415 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":210,"thread_start_us":99,"threads_started":1}
I20260811 08:10:22.968205 15848 tablet_service.cc:1467] Processing CreateTablet for tablet 904315723aa74775913cb42864fde9c5 (DEFAULT_TABLE table=test-table [id=9f21c4b976684e2ebb6ed7659025e4f5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:10:22.968612 15848 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 904315723aa74775913cb42864fde9c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:10:22.971652 15998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:10:22.961861 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.194:41243 (local address 127.0.0.1:50864)
0811 08:10:22.967789 (+ 5928us) negotiation.cc:107] Waiting for socket to connect
0811 08:10:22.967800 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 08:10:22.967858 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:10:22.968146 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:10:22.968147 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:10:22.968148 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:10:22.968180 (+ 32us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:10:22.968181 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:10:22.969456 (+ 1275us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:10:22.969457 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:10:22.970475 (+ 1018us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:10:22.970478 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:10:22.971457 (+ 979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:10:22.971458 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:10:22.971518 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:10:22.971522 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 08:10:22.971547 (+ 25us) client_negotiation.cc:240] Negotiation successful
0811 08:10:22.971583 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5916,"mutex_wait_us":4,"thread_start_us":122,"threads_started":1}
I20260811 08:10:22.971989 16002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:10:22.962260 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50864 (local address 127.27.243.194:41243)
0811 08:10:22.962928 (+ 668us) server_negotiation.cc:206] Beginning negotiation
0811 08:10:22.962933 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 08:10:22.967917 (+ 4984us) server_negotiation.cc:407] Connection header received
0811 08:10:22.967976 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:10:22.967978 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:10:22.967995 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:10:22.968064 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:10:22.968247 (+ 183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:10:22.969356 (+ 1109us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:10:22.970616 (+ 1260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:10:22.971364 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:10:22.971784 (+ 420us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:10:22.971851 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 08:10:22.971876 (+ 25us) server_negotiation.cc:299] Negotiation successful
0811 08:10:22.971913 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":629,"thread_start_us":148,"threads_started":1}
I20260811 08:10:22.972585 15634 tablet_service.cc:1467] Processing CreateTablet for tablet 904315723aa74775913cb42864fde9c5 (DEFAULT_TABLE table=test-table [id=9f21c4b976684e2ebb6ed7659025e4f5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:10:22.972961 15634 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 904315723aa74775913cb42864fde9c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:10:22.973945 15999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:10:22.962113 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.193:34819 (local address 127.0.0.1:46464)
0811 08:10:22.969723 (+ 7610us) negotiation.cc:107] Waiting for socket to connect
0811 08:10:22.969733 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 08:10:22.969800 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:10:22.970113 (+ 313us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:10:22.970113 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:10:22.970115 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:10:22.970151 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:10:22.970152 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:10:22.971635 (+ 1483us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:10:22.971636 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:10:22.972743 (+ 1107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:10:22.972746 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:10:22.973717 (+ 971us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:10:22.973718 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:10:22.973779 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:10:22.973782 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 08:10:22.973844 (+ 62us) client_negotiation.cc:240] Negotiation successful
0811 08:10:22.973882 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7576,"thread_start_us":119,"threads_started":1}
I20260811 08:10:22.974289 16004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:10:22.962573 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46464 (local address 127.27.243.193:34819)
0811 08:10:22.969598 (+ 7025us) server_negotiation.cc:206] Beginning negotiation
0811 08:10:22.969602 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 08:10:22.969860 (+ 258us) server_negotiation.cc:407] Connection header received
0811 08:10:22.969897 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:10:22.969900 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:10:22.969916 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:10:22.969983 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:10:22.970218 (+ 235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:10:22.971557 (+ 1339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:10:22.972853 (+ 1296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:10:22.973562 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:10:22.973631 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:10:22.973682 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 08:10:22.974167 (+ 485us) server_negotiation.cc:299] Negotiation successful
0811 08:10:22.974214 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6991,"thread_start_us":65,"threads_started":1}
I20260811 08:10:22.975168 15390 tablet_service.cc:1467] Processing CreateTablet for tablet 904315723aa74775913cb42864fde9c5 (DEFAULT_TABLE table=test-table [id=9f21c4b976684e2ebb6ed7659025e4f5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:10:22.975500 15390 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 904315723aa74775913cb42864fde9c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:10:22.977149 16006 tablet_bootstrap.cc:492] T 904315723aa74775913cb42864fde9c5 P d1c4f3e4ef6f4242a6deb81c5d4e703a: Bootstrap starting.
I20260811 08:10:22.978276 16006 tablet_bootstrap.cc:654] T 904315723aa74775913cb42864fde9c5 P d1c4f3e4ef6f4242a6deb81c5d4e703a: Neither blocks nor log segments found. Creating new log.
I20260811 08:10:22.978677 16006 log.cc:824] T 904315723aa74775913cb42864fde9c5 P d1c4f3e4ef6f4242a6deb81c5d4e703a: Log is configured to *not* fsync() on all Append() calls
I20260811 08:10:22.979212 16010 tablet_bootstrap.cc:492] T 904315723aa74775913cb42864fde9c5 P 0d2a40a472884975987cf4a45569b6cf: Bootstrap starting.
I20260811 08:10:22.979545 16008 tablet_bootstrap.cc:492] T 904315723aa74775913cb42864fde9c5 P eb580b85f3574afeb640014c5a2eb9fd: Bootstrap starting.
I20260811 08:10:22.979983 16010 tablet_bootstrap.cc:654] T 904315723aa74775913cb42864fde9c5 P 0d2a40a472884975987cf4a45569b6cf: Neither blocks nor log segments found. Creating new log.
I20260811 08:10:22.980720 16010 log.cc:824] T 904315723aa74775913cb42864fde9c5 P 0d2a40a472884975987cf4a45569b6cf: Log is configured to *not* fsync() on all Append() calls
I20260811 08:10:22.980849 16008 tablet_bootstrap.cc:654] T 904315723aa74775913cb42864fde9c5 P eb580b85f3574afeb640014c5a2eb9fd: Neither blocks nor log segments found. Creating new log.
I20260811 08:10:22.981225 16008 log.cc:824] T 904315723aa74775913cb42864fde9c5 P eb580b85f3574afeb640014c5a2eb9fd: Log is configured to *not* fsync() on all Append() calls
I20260811 08:10:22.981561 16010 tablet_bootstrap.cc:492] T 904315723aa74775913cb42864fde9c5 P 0d2a40a472884975987cf4a45569b6cf: No bootstrap required, opened a new log
I20260811 08:10:22.981637 16010 ts_tablet_manager.cc:1397] T 904315723aa74775913cb42864fde9c5 P 0d2a40a472884975987cf4a45569b6cf: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 08:10:22.982160 16006 tablet_bootstrap.cc:492] T 904315723aa74775913cb42864fde9c5 P d1c4f3e4ef6f4242a6deb81c5d4e703a: No bootstrap required, opened a new log
I20260811 08:10:22.982250 16006 ts_tablet_manager.cc:1397] T 904315723aa74775913cb42864fde9c5 P d1c4f3e4ef6f4242a6deb81c5d4e703a: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260811 08:10:22.984251 16006 raft_consensus.cc:348] T 904315723aa74775913cb42864fde9c5 P d1c4f3e4ef6f4242a6deb81c5d4e703a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c4f3e4ef6f4242a6deb81c5d4e703a" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 39781 } } peers { permanent_uuid: "eb580b85f3574afeb640014c5a2eb9fd" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 41243 } } peers { permanent_uuid: "0d2a40a472884975987cf4a45569b6cf" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 34819 } }
I20260811 08:10:22.984423 16006 raft_consensus.cc:374] T 904315723aa74775913cb42864fde9c5 P d1c4f3e4ef6f4242a6deb81c5d4e703a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:10:22.984462 16006 raft_consensus.cc:729] T 904315723aa74775913cb42864fde9c5 P d1c4f3e4ef6f4242a6deb81c5d4e703a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1c4f3e4ef6f4242a6deb81c5d4e703a, State: Initialized, Role: FOLLOWER
I20260811 08:10:22.984573 16006 consensus_queue.cc:260] T 904315723aa74775913cb42864fde9c5 P d1c4f3e4ef6f4242a6deb81c5d4e703a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c4f3e4ef6f4242a6deb81c5d4e703a" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 39781 } } peers { permanent_uuid: "eb580b85f3574afeb640014c5a2eb9fd" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 41243 } } peers { permanent_uuid: "0d2a40a472884975987cf4a45569b6cf" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 34819 } }
I20260811 08:10:22.984251 16010 raft_consensus.cc:348] T 904315723aa74775913cb42864fde9c5 P 0d2a40a472884975987cf4a45569b6cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c4f3e4ef6f4242a6deb81c5d4e703a" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 39781 } } peers { permanent_uuid: "eb580b85f3574afeb640014c5a2eb9fd" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 41243 } } peers { permanent_uuid: "0d2a40a472884975987cf4a45569b6cf" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 34819 } }
I20260811 08:10:22.984763 16010 raft_consensus.cc:374] T 904315723aa74775913cb42864fde9c5 P 0d2a40a472884975987cf4a45569b6cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:10:22.984850 16006 ts_tablet_manager.cc:1428] T 904315723aa74775913cb42864fde9c5 P d1c4f3e4ef6f4242a6deb81c5d4e703a: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 08:10:22.984848 16010 raft_consensus.cc:729] T 904315723aa74775913cb42864fde9c5 P 0d2a40a472884975987cf4a45569b6cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d2a40a472884975987cf4a45569b6cf, State: Initialized, Role: FOLLOWER
I20260811 08:10:22.984978 16010 consensus_queue.cc:260] T 904315723aa74775913cb42864fde9c5 P 0d2a40a472884975987cf4a45569b6cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c4f3e4ef6f4242a6deb81c5d4e703a" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 39781 } } peers { permanent_uuid: "eb580b85f3574afeb640014c5a2eb9fd" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 41243 } } peers { permanent_uuid: "0d2a40a472884975987cf4a45569b6cf" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 34819 } }
I20260811 08:10:22.985234 16010 ts_tablet_manager.cc:1428] T 904315723aa74775913cb42864fde9c5 P 0d2a40a472884975987cf4a45569b6cf: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260811 08:10:22.985225 15978 heartbeater.cc:503] Master 127.27.243.254:33959 was elected leader, sending a full tablet report...
I20260811 08:10:22.985345 15515 heartbeater.cc:503] Master 127.27.243.254:33959 was elected leader, sending a full tablet report...
I20260811 08:10:22.986280 16008 tablet_bootstrap.cc:492] T 904315723aa74775913cb42864fde9c5 P eb580b85f3574afeb640014c5a2eb9fd: No bootstrap required, opened a new log
I20260811 08:10:22.986429 16008 ts_tablet_manager.cc:1397] T 904315723aa74775913cb42864fde9c5 P eb580b85f3574afeb640014c5a2eb9fd: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20260811 08:10:22.987850 16008 raft_consensus.cc:348] T 904315723aa74775913cb42864fde9c5 P eb580b85f3574afeb640014c5a2eb9fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c4f3e4ef6f4242a6deb81c5d4e703a" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 39781 } } peers { permanent_uuid: "eb580b85f3574afeb640014c5a2eb9fd" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 41243 } } peers { permanent_uuid: "0d2a40a472884975987cf4a45569b6cf" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 34819 } }
I20260811 08:10:22.987974 16008 raft_consensus.cc:374] T 904315723aa74775913cb42864fde9c5 P eb580b85f3574afeb640014c5a2eb9fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:10:22.988003 16008 raft_consensus.cc:729] T 904315723aa74775913cb42864fde9c5 P eb580b85f3574afeb640014c5a2eb9fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb580b85f3574afeb640014c5a2eb9fd, State: Initialized, Role: FOLLOWER
I20260811 08:10:22.988133 16008 consensus_queue.cc:260] T 904315723aa74775913cb42864fde9c5 P eb580b85f3574afeb640014c5a2eb9fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c4f3e4ef6f4242a6deb81c5d4e703a" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 39781 } } peers { permanent_uuid: "eb580b85f3574afeb640014c5a2eb9fd" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 41243 } } peers { permanent_uuid: "0d2a40a472884975987cf4a45569b6cf" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 34819 } }
I20260811 08:10:22.988389 15738 heartbeater.cc:503] Master 127.27.243.254:33959 was elected leader, sending a full tablet report...
I20260811 08:10:22.988596 16008 ts_tablet_manager.cc:1428] T 904315723aa74775913cb42864fde9c5 P eb580b85f3574afeb640014c5a2eb9fd: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
W20260811 08:10:23.138608 15516 tablet.cc:2369] T 904315723aa74775913cb42864fde9c5 P 0d2a40a472884975987cf4a45569b6cf: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 08:10:23.149159 16018 raft_consensus.cc:482] T 904315723aa74775913cb42864fde9c5 P eb580b85f3574afeb640014c5a2eb9fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:10:23.149312 16018 raft_consensus.cc:504] T 904315723aa74775913cb42864fde9c5 P eb580b85f3574afeb640014c5a2eb9fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c4f3e4ef6f4242a6deb81c5d4e703a" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 39781 } } peers { permanent_uuid: "eb580b85f3574afeb640014c5a2eb9fd" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 41243 } } peers { permanent_uuid: "0d2a40a472884975987cf4a45569b6cf" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 34819 } }
I20260811 08:10:23.149796 16018 leader_election.cc:288] T 904315723aa74775913cb42864fde9c5 P eb580b85f3574afeb640014c5a2eb9fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d1c4f3e4ef6f4242a6deb81c5d4e703a (127.27.243.195:39781), 0d2a40a472884975987cf4a45569b6cf (127.27.243.193:34819)
I20260811 08:10:23.154083 15744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:10:23.150095 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.195:39781 (local address 127.27.243.194:54047)
0811 08:10:23.150397 (+ 302us) negotiation.cc:107] Waiting for socket to connect
0811 08:10:23.150408 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 08:10:23.150453 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:10:23.150854 (+ 401us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:10:23.150855 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:10:23.150857 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:10:23.150942 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:10:23.150944 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:10:23.151899 (+ 955us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:10:23.151900 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:10:23.153084 (+ 1184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:10:23.153087 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:10:23.153835 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:10:23.153836 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:10:23.153921 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:10:23.153925 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 08:10:23.153968 (+ 43us) client_negotiation.cc:240] Negotiation successful
0811 08:10:23.154006 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":281}
I20260811 08:10:23.154637 16000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:10:23.150617 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.194:54047 (local address 127.27.243.195:39781)
0811 08:10:23.150676 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0811 08:10:23.150679 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:10:23.150691 (+ 12us) server_negotiation.cc:407] Connection header received
0811 08:10:23.150723 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:10:23.150724 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:10:23.150736 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:10:23.150800 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:10:23.151013 (+ 213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:10:23.151749 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:10:23.153183 (+ 1434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:10:23.153729 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:10:23.153793 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:10:23.153802 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 08:10:23.154532 (+ 730us) server_negotiation.cc:299] Negotiation successful
0811 08:10:23.154573 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 08:10:23.154927 15896 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "904315723aa74775913cb42864fde9c5" candidate_uuid: "eb580b85f3574afeb640014c5a2eb9fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1c4f3e4ef6f4242a6deb81c5d4e703a" is_pre_election: true
I20260811 08:10:23.155068 15896 raft_consensus.cc:2454] T 904315723aa74775913cb42864fde9c5 P d1c4f3e4ef6f4242a6deb81c5d4e703a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb580b85f3574afeb640014c5a2eb9fd in term 0.
I20260811 08:10:23.155368 15561 leader_election.cc:302] T 904315723aa74775913cb42864fde9c5 P eb580b85f3574afeb640014c5a2eb9fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d1c4f3e4ef6f4242a6deb81c5d4e703a, eb580b85f3574afeb640014c5a2eb9fd; no voters:
I20260811 08:10:23.155489 16018 raft_consensus.cc:2781] T 904315723aa74775913cb42864fde9c5 P eb580b85f3574afeb640014c5a2eb9fd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 08:10:23.155524 16018 raft_consensus.cc:482] T 904315723aa74775913cb42864fde9c5 P eb580b85f3574afeb640014c5a2eb9fd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 08:10:23.155544 16018 raft_consensus.cc:3037] T 904315723aa74775913cb42864fde9c5 P eb580b85f3574afeb640014c5a2eb9fd [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:10:23.156445 16018 raft_consensus.cc:504] T 904315723aa74775913cb42864fde9c5 P eb580b85f3574afeb640014c5a2eb9fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c4f3e4ef6f4242a6deb81c5d4e703a" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 39781 } } peers { permanent_uuid: "eb580b85f3574afeb640014c5a2eb9fd" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 41243 } } peers { permanent_uuid: "0d2a40a472884975987cf4a45569b6cf" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 34819 } }
I20260811 08:10:23.156577 16018 leader_election.cc:288] T 904315723aa74775913cb42864fde9c5 P eb580b85f3574afeb640014c5a2eb9fd [CANDIDATE]: Term 1 election: Requested vote from peers d1c4f3e4ef6f4242a6deb81c5d4e703a (127.27.243.195:39781), 0d2a40a472884975987cf4a45569b6cf (127.27.243.193:34819)
I20260811 08:10:23.156972 15896 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "904315723aa74775913cb42864fde9c5" candidate_uuid: "eb580b85f3574afeb640014c5a2eb9fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1c4f3e4ef6f4242a6deb81c5d4e703a"
I20260811 08:10:23.157044 15896 raft_consensus.cc:3037] T 904315723aa74775913cb42864fde9c5 P d1c4f3e4ef6f4242a6deb81c5d4e703a [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:10:23.157917 15896 raft_consensus.cc:2454] T 904315723aa74775913cb42864fde9c5 P d1c4f3e4ef6f4242a6deb81c5d4e703a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb580b85f3574afeb640014c5a2eb9fd in term 1.
I20260811 08:10:23.158107 15561 leader_election.cc:302] T 904315723aa74775913cb42864fde9c5 P eb580b85f3574afeb640014c5a2eb9fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d1c4f3e4ef6f4242a6deb81c5d4e703a, eb580b85f3574afeb640014c5a2eb9fd; no voters:
I20260811 08:10:23.158228 16018 raft_consensus.cc:2781] T 904315723aa74775913cb42864fde9c5 P eb580b85f3574afeb640014c5a2eb9fd [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:10:23.158404 16018 raft_consensus.cc:686] T 904315723aa74775913cb42864fde9c5 P eb580b85f3574afeb640014c5a2eb9fd [term 1 LEADER]: Becoming Leader. State: Replica: eb580b85f3574afeb640014c5a2eb9fd, State: Running, Role: LEADER
I20260811 08:10:23.158488 16018 consensus_queue.cc:237] T 904315723aa74775913cb42864fde9c5 P eb580b85f3574afeb640014c5a2eb9fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c4f3e4ef6f4242a6deb81c5d4e703a" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 39781 } } peers { permanent_uuid: "eb580b85f3574afeb640014c5a2eb9fd" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 41243 } } peers { permanent_uuid: "0d2a40a472884975987cf4a45569b6cf" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 34819 } }
I20260811 08:10:23.159261 15176 catalog_manager.cc:5495] T 904315723aa74775913cb42864fde9c5 P eb580b85f3574afeb640014c5a2eb9fd reported cstate change: term changed from 0 to 1, leader changed from <none> to eb580b85f3574afeb640014c5a2eb9fd (127.27.243.194). New cstate: current_term: 1 leader_uuid: "eb580b85f3574afeb640014c5a2eb9fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c4f3e4ef6f4242a6deb81c5d4e703a" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 39781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb580b85f3574afeb640014c5a2eb9fd" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 41243 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d2a40a472884975987cf4a45569b6cf" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 34819 } health_report { overall_health: UNKNOWN } } }
I20260811 08:10:23.163645 16004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:10:23.150677 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.194:60413 (local address 127.27.243.193:34819)
0811 08:10:23.150735 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0811 08:10:23.150736 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 08:10:23.153673 (+ 2937us) server_negotiation.cc:407] Connection header received
0811 08:10:23.158161 (+ 4488us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:10:23.158163 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:10:23.158178 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:10:23.158204 (+ 26us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:10:23.158486 (+ 282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:10:23.159172 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:10:23.162547 (+ 3375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:10:23.163108 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:10:23.163170 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:10:23.163179 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 08:10:23.163527 (+ 348us) server_negotiation.cc:299] Negotiation successful
0811 08:10:23.163578 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260811 08:10:23.163902 16019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:10:23.150215 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.193:34819 (local address 127.27.243.194:60413)
0811 08:10:23.153596 (+ 3381us) negotiation.cc:107] Waiting for socket to connect
0811 08:10:23.153608 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 08:10:23.158061 (+ 4453us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:10:23.158262 (+ 201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:10:23.158263 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:10:23.158266 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:10:23.158411 (+ 145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:10:23.158413 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:10:23.159260 (+ 847us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:10:23.159261 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:10:23.162442 (+ 3181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:10:23.162445 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:10:23.163359 (+ 914us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:10:23.163360 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:10:23.163431 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:10:23.163436 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 08:10:23.163765 (+ 329us) client_negotiation.cc:240] Negotiation successful
0811 08:10:23.163805 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3364,"thread_start_us":75,"threads_started":1}
I20260811 08:10:23.164199 15437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "904315723aa74775913cb42864fde9c5" candidate_uuid: "eb580b85f3574afeb640014c5a2eb9fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d2a40a472884975987cf4a45569b6cf" is_pre_election: true
I20260811 08:10:23.164363 15437 raft_consensus.cc:2454] T 904315723aa74775913cb42864fde9c5 P 0d2a40a472884975987cf4a45569b6cf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb580b85f3574afeb640014c5a2eb9fd in term 0.
I20260811 08:10:23.164479 15436 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "904315723aa74775913cb42864fde9c5" candidate_uuid: "eb580b85f3574afeb640014c5a2eb9fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d2a40a472884975987cf4a45569b6cf"
I20260811 08:10:23.164535 15436 raft_consensus.cc:3037] T 904315723aa74775913cb42864fde9c5 P 0d2a40a472884975987cf4a45569b6cf [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:10:23.165380 15436 raft_consensus.cc:2454] T 904315723aa74775913cb42864fde9c5 P 0d2a40a472884975987cf4a45569b6cf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb580b85f3574afeb640014c5a2eb9fd in term 1.
Aug 11 08:10:23 dist-test-slave-7lbf krb5kdc[14361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435822, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.254@KRBTEST.COM for HTTP/127.27.243.212@KRBTEST.COM
W20260811 08:10:23.171123 15742 tablet.cc:2369] T 904315723aa74775913cb42864fde9c5 P eb580b85f3574afeb640014c5a2eb9fd: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 08:10:23.179677 15980 tablet.cc:2369] T 904315723aa74775913cb42864fde9c5 P d1c4f3e4ef6f4242a6deb81c5d4e703a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 08:10:23.198099 16002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:10:23.194822 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50876 (local address 127.27.243.194:41243)
0811 08:10:23.194866 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 08:10:23.194868 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:10:23.194874 (+ 6us) server_negotiation.cc:407] Connection header received
0811 08:10:23.194914 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:10:23.194915 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:10:23.194937 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:10:23.194995 (+ 58us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:10:23.195170 (+ 175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:10:23.195867 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:10:23.196914 (+ 1047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:10:23.197226 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:10:23.197289 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:10:23.197547 (+ 258us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:10:23.197683 (+ 136us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:10:23.197760 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 08:10:23.197998 (+ 238us) server_negotiation.cc:299] Negotiation successful
0811 08:10:23.198017 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 08:10:23.203856 15896 raft_consensus.cc:1261] T 904315723aa74775913cb42864fde9c5 P d1c4f3e4ef6f4242a6deb81c5d4e703a [term 1 FOLLOWER]: Refusing update from remote peer eb580b85f3574afeb640014c5a2eb9fd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:10:23.203857 15436 raft_consensus.cc:1261] T 904315723aa74775913cb42864fde9c5 P 0d2a40a472884975987cf4a45569b6cf [term 1 FOLLOWER]: Refusing update from remote peer eb580b85f3574afeb640014c5a2eb9fd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:10:23.204236 16020 consensus_queue.cc:1035] T 904315723aa74775913cb42864fde9c5 P eb580b85f3574afeb640014c5a2eb9fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d2a40a472884975987cf4a45569b6cf" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:10:23.204439 16018 consensus_queue.cc:1035] T 904315723aa74775913cb42864fde9c5 P eb580b85f3574afeb640014c5a2eb9fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1c4f3e4ef6f4242a6deb81c5d4e703a" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 39781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:10:23.207939 16025 mvcc.cc:205] Tried to move back new op lower bound from 7317241131840016384 to 7317241131657740288. Current Snapshot: MvccSnapshot[applied={T|T < 7317241131840016384}]
I20260811 08:10:23.209453 16027 mvcc.cc:205] Tried to move back new op lower bound from 7317241131840016384 to 7317241131657740288. Current Snapshot: MvccSnapshot[applied={T|T < 7317241131840016384}]
I20260811 08:10:23.211968 15174 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37812:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:10:23.212064 15174 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37812:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:10:23.212865 15174 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 93eb52775b9341b2ab9115ecc11bbc9b: Sending DeleteTablet for 3 replicas of tablet 904315723aa74775913cb42864fde9c5
I20260811 08:10:23.213285 15634 tablet_service.cc:1514] Processing DeleteTablet for tablet 904315723aa74775913cb42864fde9c5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:10:23 UTC) from {username='kudu', principal='kudu/127.27.243.254@KRBTEST.COM'} at 127.0.0.1:50864
I20260811 08:10:23.213588 15390 tablet_service.cc:1514] Processing DeleteTablet for tablet 904315723aa74775913cb42864fde9c5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:10:23 UTC) from {username='kudu', principal='kudu/127.27.243.254@KRBTEST.COM'} at 127.0.0.1:46464
I20260811 08:10:23.214016 15848 tablet_service.cc:1514] Processing DeleteTablet for tablet 904315723aa74775913cb42864fde9c5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:10:23 UTC) from {username='kudu', principal='kudu/127.27.243.254@KRBTEST.COM'} at 127.0.0.1:36038
I20260811 08:10:23.215936 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 15300
I20260811 08:10:23.230137 16037 tablet_replica.cc:330] T 904315723aa74775913cb42864fde9c5 P eb580b85f3574afeb640014c5a2eb9fd: stopping tablet replica
I20260811 08:10:23.231467 16039 tablet_replica.cc:330] T 904315723aa74775913cb42864fde9c5 P d1c4f3e4ef6f4242a6deb81c5d4e703a: stopping tablet replica
I20260811 08:10:23.236855 16037 raft_consensus.cc:2229] T 904315723aa74775913cb42864fde9c5 P eb580b85f3574afeb640014c5a2eb9fd [term 1 LEADER]: Raft consensus shutting down.
I20260811 08:10:23.237118 16039 raft_consensus.cc:2229] T 904315723aa74775913cb42864fde9c5 P d1c4f3e4ef6f4242a6deb81c5d4e703a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:10:23.237272 16039 raft_consensus.cc:2258] T 904315723aa74775913cb42864fde9c5 P d1c4f3e4ef6f4242a6deb81c5d4e703a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:10:23.237483 16037 raft_consensus.cc:2258] T 904315723aa74775913cb42864fde9c5 P eb580b85f3574afeb640014c5a2eb9fd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:10:23.238308 16037 ts_tablet_manager.cc:1905] T 904315723aa74775913cb42864fde9c5 P eb580b85f3574afeb640014c5a2eb9fd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:10:23.244449 16037 ts_tablet_manager.cc:1918] T 904315723aa74775913cb42864fde9c5 P eb580b85f3574afeb640014c5a2eb9fd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:10:23.244498 16039 ts_tablet_manager.cc:1905] T 904315723aa74775913cb42864fde9c5 P d1c4f3e4ef6f4242a6deb81c5d4e703a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:10:23.244601 16037 log.cc:1196] T 904315723aa74775913cb42864fde9c5 P eb580b85f3574afeb640014c5a2eb9fd: Deleting WAL directory at /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/minicluster-data/ts-1/wal/wals/904315723aa74775913cb42864fde9c5
I20260811 08:10:23.244943 16037 ts_tablet_manager.cc:1939] T 904315723aa74775913cb42864fde9c5 P eb580b85f3574afeb640014c5a2eb9fd: Deleting consensus metadata
I20260811 08:10:23.245455 15144 catalog_manager.cc:4841] TS eb580b85f3574afeb640014c5a2eb9fd (127.27.243.194:41243): tablet 904315723aa74775913cb42864fde9c5 (table test-table [id=9f21c4b976684e2ebb6ed7659025e4f5]) successfully deleted
I20260811 08:10:23.246275 16039 ts_tablet_manager.cc:1918] T 904315723aa74775913cb42864fde9c5 P d1c4f3e4ef6f4242a6deb81c5d4e703a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
W20260811 08:10:23.248325 15144 connection.cc:535] server connection from 127.27.243.193:59809 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260811 08:10:23.248618 15138 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.27.243.193:34819 (error 108)
I20260811 08:10:23.249805 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 15528
I20260811 08:10:23.274381 15999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:10:23.274237 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.193:34819 (local address 127.0.0.1:46466)
0811 08:10:23.274293 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0811 08:10:23.274333 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.193:34819: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260811 08:10:23.274672 15138 catalog_manager.cc:4584] TS 0d2a40a472884975987cf4a45569b6cf (127.27.243.193:34819): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 904315723aa74775913cb42864fde9c5: Network error: Client connection negotiation failed: client connection to 127.27.243.193:34819: connect: Connection refused (error 111)
I20260811 08:10:23.283368 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 15751
I20260811 08:10:23.283368 16039 log.cc:1196] T 904315723aa74775913cb42864fde9c5 P d1c4f3e4ef6f4242a6deb81c5d4e703a: Deleting WAL directory at /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435717191469-28623-0/minicluster-data/ts-2/wal/wals/904315723aa74775913cb42864fde9c5
I20260811 08:10:23.297695 15999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:10:23.297579 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.195:39781 (local address 127.0.0.1:36040)
0811 08:10:23.297619 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0811 08:10:23.297648 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.195:39781: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":17}
I20260811 08:10:23.297756 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 15108
I20260811 08:10:23.312827 28623 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260811 08:10:23.658838 28623 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260811 08:10:23.658943 28623 mini_ranger.cc:66] Stopping Ranger...
I20260811 08:10:24.014101 28623 mini_ranger.cc:68] Stopped Ranger
2026-08-11 08:10:24.014 UTC [14420] LOG: received smart shutdown request
2026-08-11 08:10:24.018 UTC [14420] LOG: background worker "logical replication launcher" (PID 14436) exited with exit code 1
2026-08-11 08:10:24.018 UTC [14425] LOG: shutting down
2026-08-11 08:10:24.162 UTC [14420] LOG: database system is shut down
2026-08-11T08:10:24Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (46855 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:10:24 dist-test-slave-7lbf krb5kdc[16053](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:10:24 dist-test-slave-7lbf krb5kdc[16053](info): set up 2 sockets
Aug 11 08:10:24 dist-test-slave-7lbf krb5kdc[16053](info): commencing operation
krb5kdc: starting...
W20260811 08:10:25.439606 28623 mini_kdc.cc:121] Time spent starting KDC: real 1.156s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/krb5kdc/test-user.keytab.
Aug 11 08:10:25 dist-test-slave-7lbf krb5kdc[16053](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435825, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:10:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:10:25Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.27.243.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.27.243.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.27.243.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/krb5kdc/rangeradmin_127.27.243.212@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.27.243.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/krb5kdc/rangeradmin_127.27.243.212@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.27.243.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.27.243.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.27.243.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/krb5kdc/rangerlookup_127.27.243.212@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.27.243.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/krb5kdc/rangerlookup_127.27.243.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.27.243.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.27.243.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.27.243.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/krb5kdc/HTTP_127.27.243.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.27.243.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/krb5kdc/HTTP_127.27.243.212@KRBTEST.COM.keytab.
I20260811 08:10:25.600323 28623 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-task0_GQGb/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/postgres -l logfile start
2026-08-11 08:10:27.909 UTC [16101] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-11 08:10:27.909 UTC [16101] LOG: listening on IPv4 address "127.27.243.212", port 43441
2026-08-11 08:10:27.913 UTC [16101] LOG: listening on Unix socket "/tmp/.s.PGSQL.43441"
2026-08-11 08:10:27.933 UTC [16107] LOG: database system was shut down at 2026-08-11 08:10:26 UTC
2026-08-11 08:10:27.936 UTC [16101] LOG: database system is ready to accept connections
I20260811 08:10:29.022895 28623 mini_postgres.cc:96] Postgres bound to 43441
2026-08-11 08:10:29.029 UTC [16122] FATAL: database "slave" does not exist
127.27.243.212:43441 - accepting connections
I20260811 08:10:29.030491 28623 mini_ranger.cc:161] Starting Ranger...
I20260811 08:10:29.045256 28623 mini_ranger.cc:84] Created miniranger Postgres user
I20260811 08:10:29.476574 28623 mini_ranger.cc:87] Created ranger Postgres database
I20260811 08:10:29.476657 28623 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/ranger-admin
2026-08-11 08:10:29,750 [I] DB FLAVOR :POSTGRES
2026-08-11 08:10:29,751 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 08:10:29,751 [I] Checking connection..
2026-08-11 08:10:29,751 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0_GQGb/build/release/bin/postgresql.jar:/tmp/dist-test-task0_GQGb/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.243.212:43441/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-11 08:10:30,009 [I] Checking connection passed.
2026-08-11 08:10:30,009 [I] --------- Verifying version history table ---------
2026-08-11 08:10:30,009 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0_GQGb/build/release/bin/postgresql.jar:/tmp/dist-test-task0_GQGb/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.243.212:43441/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 08:10:30,258 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 08:10:30,258 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0_GQGb/build/release/bin/postgresql.jar:/tmp/dist-test-task0_GQGb/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.243.212:43441/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 08:10:30,523 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 08:10:30,523 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-11 08:10:30,523 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0_GQGb/build/release/bin/postgresql.jar:/tmp/dist-test-task0_GQGb/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.243.212:43441/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-task0_GQGb/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-11 08:10:30.767 UTC [16224] WARNING: there is no transaction in progress
2026-08-11 08:10:30,776 [I] create_dbversion_catalog.sql file imported successfully
2026-08-11 08:10:30,776 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0_GQGb/build/release/bin/postgresql.jar:/tmp/dist-test-task0_GQGb/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.243.212:43441/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 08:10:31,034 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-11 08:10:31,034 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 08:10:31,034 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0_GQGb/build/release/bin/postgresql.jar:/tmp/dist-test-task0_GQGb/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.243.212:43441/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-11 08:10:31,274 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0_GQGb/build/release/bin/postgresql.jar:/tmp/dist-test-task0_GQGb/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.243.212:43441/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-11 08:10:31,555 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0_GQGb/build/release/bin/postgresql.jar:/tmp/dist-test-task0_GQGb/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.243.212:43441/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-7lbf.c.gcp-upstream.internal','N') ;"
2026-08-11 08:10:31,792 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0_GQGb/build/release/bin/postgresql.jar:/tmp/dist-test-task0_GQGb/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.243.212:43441/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 08:10:32,064 [I] Table x_portal_user does not exist in database ranger
2026-08-11 08:10:32,065 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0_GQGb/build/release/bin/postgresql.jar:/tmp/dist-test-task0_GQGb/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.243.212:43441/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 08:10:32,319 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-11 08:10:32,319 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0_GQGb/build/release/bin/postgresql.jar:/tmp/dist-test-task0_GQGb/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.243.212:43441/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 08:10:32,575 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0_GQGb/build/release/bin/postgresql.jar:/tmp/dist-test-task0_GQGb/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.243.212:43441/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 08:10:32,834 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-11 08:10:32,834 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0_GQGb/build/release/bin/postgresql.jar:/tmp/dist-test-task0_GQGb/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.243.212:43441/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-task0_GQGb/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-11 08:10:33.772 UTC [16404] WARNING: there is no transaction in progress
2026-08-11 08:10:33.788 UTC [16404] WARNING: there is no transaction in progress
2026-08-11 08:10:33.803 UTC [16404] WARNING: there is no transaction in progress
2026-08-11 08:10:33.819 UTC [16404] WARNING: there is no transaction in progress
2026-08-11 08:10:33.834 UTC [16404] WARNING: there is no transaction in progress
2026-08-11 08:10:33.851 UTC [16404] WARNING: there is no transaction in progress
2026-08-11 08:10:33.907 UTC [16404] WARNING: there is no transaction in progress
2026-08-11 08:10:33.915 UTC [16404] WARNING: there is no transaction in progress
2026-08-11 08:10:33.930 UTC [16404] WARNING: there is no transaction in progress
2026-08-11 08:10:33.939 UTC [16404] WARNING: there is no transaction in progress
2026-08-11 08:10:33.950 UTC [16404] WARNING: there is no transaction in progress
2026-08-11 08:10:33.963 UTC [16404] WARNING: there is no transaction in progress
2026-08-11 08:10:33.973 UTC [16404] WARNING: there is no transaction in progress
2026-08-11 08:10:33.979 UTC [16404] WARNING: there is no transaction in progress
2026-08-11 08:10:33.985 UTC [16404] WARNING: there is no transaction in progress
2026-08-11 08:10:33.992 UTC [16404] WARNING: there is no transaction in progress
2026-08-11 08:10:34,608 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-11 08:10:34,609 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0_GQGb/build/release/bin/postgresql.jar:/tmp/dist-test-task0_GQGb/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.243.212:43441/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-11 08:10:34,850 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-11 08:10:34,851 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0_GQGb/build/release/bin/postgresql.jar:/tmp/dist-test-task0_GQGb/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.243.212:43441/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 08:10:35,111 [I] Table x_portal_user already exists in database 'ranger'
2026-08-11 08:10:35,111 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0_GQGb/build/release/bin/postgresql.jar:/tmp/dist-test-task0_GQGb/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.243.212:43441/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 08:10:35,373 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-11 08:10:35,373 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0_GQGb/build/release/bin/postgresql.jar:/tmp/dist-test-task0_GQGb/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.243.212:43441/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 08:10:35,635 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0_GQGb/build/release/bin/postgresql.jar:/tmp/dist-test-task0_GQGb/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.243.212:43441/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 08:10:35,888 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0_GQGb/build/release/bin/postgresql.jar:/tmp/dist-test-task0_GQGb/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.243.212:43441/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-7lbf.c.gcp-upstream.internal';"
2026-08-11 08:10:36,125 [I] CORE_DB_SCHEMA import status has been updated
2026-08-11 08:10:36,125 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0_GQGb/build/release/bin/postgresql.jar:/tmp/dist-test-task0_GQGb/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.243.212:43441/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-11 08:10:36,383 [I] DB_PATCHES have already been applied
I20260811 08:10:36.389274 28623 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/ranger-admin:/tmp/dist-test-task0_GQGb/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-task0_GQGb/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-task0_GQGb/build/release/bin/postgresql.jar:/tmp/dist-test-task0_GQGb/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260811 08:10:36.389344 28623 mini_ranger.cc:193] Using host: 127.27.243.212
I20260811 08:10:36.393311 28623 mini_ranger.cc:227] Ranger admin URL: http://127.27.243.212:50617
Aug 11, 2026 8:10:36 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 8:10:36 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 8:10:36 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/ranger-admin/ews/webapp
Aug 11, 2026 8:10:36 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 11, 2026 8:10:36 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 11, 2026 8:10:37 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/ranger-admin/ews/webapp].
Aug 11, 2026 8:10:37 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260811 08:10:37.660302 28623 mini_ranger.cc:160] Time spent starting Ranger: real 8.630s user 0.000s sys 0.010s
Aug 11, 2026 8:10:57 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 11, 2026 8:10:57 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 11, 2026 8:10:57 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 11, 2026 8:10:57 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 11, 2026 8:10:57 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 11, 2026 8:10:57 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 11, 2026 8:10:57 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 11, 2026 8:10:57 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 11, 2026 8:10:57 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 11, 2026 8:10:57 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 11, 2026 8:10:57 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 11, 2026 8:10:57 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 11, 2026 8:10:57 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 11, 2026 8:10:57 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 11, 2026 8:10:57 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 11, 2026 8:10:57 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 11, 2026 8:10:57 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 11, 2026 8:10:58 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260811 08:10:58.869424 28623 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.27.243.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.27.243.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.27.243.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/krb5kdc/rangerkms_127.27.243.212@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.27.243.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/krb5kdc/rangerkms_127.27.243.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.27.243.212@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.27.243.212@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.27.243.212@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/krb5kdc/HTTP_127.27.243.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.27.243.212@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/krb5kdc/HTTP_127.27.243.212@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 11 08:10:58 dist-test-slave-7lbf krb5kdc[16053](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435858, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260811 08:10:58.973912 28623 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260811 08:10:58.984424 28623 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260811 08:10:59.784462 28623 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260811 08:10:59.784552 28623 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/ranger-kms
I20260811 08:10:59.784569 28623 mini_ranger_kms.cc:227] Using postgres at 127.27.243.212:43441
2026-08-11 08:10:59,940 [I] DB FLAVOR :POSTGRES
2026-08-11 08:10:59,940 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 08:10:59,940 [I] Checking connection
2026-08-11 08:10:59,940 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0_GQGb/build/release/bin/postgresql.jar:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.243.212:43441/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-11 08:11:00,196 [I] connection success
2026-08-11 08:11:00,196 [I] --------- Verifying Ranger DB tables ---------
2026-08-11 08:11:00,196 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-11 08:11:00,197 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0_GQGb/build/release/bin/postgresql.jar:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.243.212:43441/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-11 08:11:00,435 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-11 08:11:00,435 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 08:11:00,435 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-11 08:11:00,435 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0_GQGb/build/release/bin/postgresql.jar:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.243.212:43441/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-11 08:11:00,695 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260811 08:11:01.187995 28623 mini_ranger_kms.cc:310] Created kms service
I20260811 08:11:01.388798 28623 mini_ranger_kms.cc:326] Created kudu user
I20260811 08:11:01.430459 28623 mini_ranger_kms.cc:343] Created rangerkms user
Aug 11 08:11:01 dist-test-slave-7lbf krb5kdc[16053](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435858, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.27.243.212@KRBTEST.COM
I20260811 08:11:01.809929 28623 mini_ranger_kms.cc:384] Added ranger policy
I20260811 08:11:01.810055 28623 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/ranger-kms:/tmp/dist-test-task0_GQGb/build/release/bin/postgresql.jar:/tmp/dist-test-task0_GQGb/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-task0_GQGb/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260811 08:11:01.810073 28623 mini_ranger_kms.cc:240] Using host: 127.27.243.212
I20260811 08:11:01.814857 28623 mini_ranger_kms.cc:276] Ranger KMS PID: 16683
I20260811 08:11:01.814929 28623 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.27.243.212:47245
Aug 11, 2026 8:11:02 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 8:11:02 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 8:11:02 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 11, 2026 8:11:02 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 11, 2026 8:11:03 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/ranger-kms/ews/webapp].
Aug 11, 2026 8:11:03 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 11 08:11:04 dist-test-slave-7lbf krb5kdc[16053](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786435864, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.27.243.212@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:11:04.424860 28623 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.451s user 0.002s sys 0.137s
I20260811 08:11:04.424976 28623 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260811 08:11:04.425027 28623 mini_ranger_kms.cc:401] 127.27.243.212:47245/kms/v1/keys
Aug 11 08:11:04 dist-test-slave-7lbf krb5kdc[16053](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435864, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.27.243.212@KRBTEST.COM for HTTP/127.27.243.212@KRBTEST.COM
Aug 11 08:11:04 dist-test-slave-7lbf krb5kdc[16053](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435864, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.27.243.212@KRBTEST.COM for HTTP/127.27.243.212@KRBTEST.COM
Aug 11 08:11:07 dist-test-slave-7lbf krb5kdc[16053](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435867, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.27.243.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.243.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.243.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab.
Entry for principal kudu/127.27.243.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab.
I20260811 08:11:07.182047 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.243.254:42521
--webserver_interface=127.27.243.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab
--principal=kudu/127.27.243.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:36397
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.243.254:42521
--ranger_config_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.27.243.212:47245/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:11:07.267655 16769 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:11:07.267850 16769 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:11:07.267870 16769 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:11:07.269011 16769 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:11:07.269054 16769 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:11:07.269068 16769 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:11:07.269078 16769 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:11:07.269088 16769 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:11:07.270704 16769 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:36397
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/master-0/wal
--ranger_kms_url=127.27.243.212:47245/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.27.243.254:42521
--ranger_config_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab
--principal=kudu/127.27.243.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.243.254:42521
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.243.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16769
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:11:07.270928 16769 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:11:07.271142 16769 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:11:07.275977 16775 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:11:07.276047 16769 server_base.cc:1034] running on GCE node
W20260811 08:11:07.276129 16774 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:11:07.275987 16778 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:11:07.276405 16769 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:11:07.276703 16769 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:11:07.277840 16769 hybrid_clock.cc:648] HybridClock initialized: now 1786435867277821 us; error 36 us; skew 500 ppm
Aug 11 08:11:07 dist-test-slave-7lbf krb5kdc[16053](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435867, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:11:07.280249 16769 init.cc:377] Logged in from keytab as kudu/127.27.243.254@KRBTEST.COM (short username kudu)
I20260811 08:11:07.280718 16769 webserver.cc:460] Webserver started at http://127.27.243.254:35977/ using document root <none> and password file <none>
I20260811 08:11:07.280925 16769 fs_manager.cc:359] Metadata directory not provided
I20260811 08:11:07.280959 16769 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:11:07.281080 16769 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 08:11:07 dist-test-slave-7lbf krb5kdc[16053](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435867, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.254@KRBTEST.COM for HTTP/127.27.243.212@KRBTEST.COM
I20260811 08:11:07.339991 16769 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/master-0/data/instance:
uuid: "c1a8a0651c404143a4f831a827b9636c"
format_stamp: "Formatted at 2026-08-11 08:11:07 on dist-test-slave-7lbf"
server_key: "9df671a98b7b466b861c3012d17a57cd"
server_key_iv: "d65287db41c41819bbd5b106b8757781"
server_key_version: "kuduclusterkey@0"
I20260811 08:11:07.340337 16769 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/master-0/wal/instance:
uuid: "c1a8a0651c404143a4f831a827b9636c"
format_stamp: "Formatted at 2026-08-11 08:11:07 on dist-test-slave-7lbf"
server_key: "9df671a98b7b466b861c3012d17a57cd"
server_key_iv: "d65287db41c41819bbd5b106b8757781"
server_key_version: "kuduclusterkey@0"
I20260811 08:11:07.341717 16769 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 08:11:07.356307 16791 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:11:07.356587 16769 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:11:07.356719 16769 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/master-0/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/master-0/wal
uuid: "c1a8a0651c404143a4f831a827b9636c"
format_stamp: "Formatted at 2026-08-11 08:11:07 on dist-test-slave-7lbf"
server_key: "9df671a98b7b466b861c3012d17a57cd"
server_key_iv: "d65287db41c41819bbd5b106b8757781"
server_key_version: "kuduclusterkey@0"
I20260811 08:11:07.356824 16769 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:11:07.385509 16769 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:11:07.387629 16769 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:11:07.387799 16769 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:11:07.392964 16769 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.254:42521
I20260811 08:11:07.392997 16872 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.254:42521 every 8 connection(s)
I20260811 08:11:07.393406 16769 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
I20260811 08:11:07.394236 16873 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:11:07.396595 16873 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c1a8a0651c404143a4f831a827b9636c: Bootstrap starting.
I20260811 08:11:07.397207 16873 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c1a8a0651c404143a4f831a827b9636c: Neither blocks nor log segments found. Creating new log.
I20260811 08:11:07.397498 16873 log.cc:824] T 00000000000000000000000000000000 P c1a8a0651c404143a4f831a827b9636c: Log is configured to *not* fsync() on all Append() calls
I20260811 08:11:07.398239 16873 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c1a8a0651c404143a4f831a827b9636c: No bootstrap required, opened a new log
I20260811 08:11:07.399075 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 16769
I20260811 08:11:07.399188 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/master-0/wal/instance
I20260811 08:11:07.399410 28623 external_mini_cluster.cc:1428] Setting key b7dc5b83a1516c41ac361a38fb507de7
I20260811 08:11:07.401028 16873 raft_consensus.cc:348] T 00000000000000000000000000000000 P c1a8a0651c404143a4f831a827b9636c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1a8a0651c404143a4f831a827b9636c" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 42521 } }
I20260811 08:11:07.401327 16873 raft_consensus.cc:374] T 00000000000000000000000000000000 P c1a8a0651c404143a4f831a827b9636c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:11:07.401437 16873 raft_consensus.cc:729] T 00000000000000000000000000000000 P c1a8a0651c404143a4f831a827b9636c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1a8a0651c404143a4f831a827b9636c, State: Initialized, Role: FOLLOWER
I20260811 08:11:07.401674 16873 consensus_queue.cc:260] T 00000000000000000000000000000000 P c1a8a0651c404143a4f831a827b9636c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1a8a0651c404143a4f831a827b9636c" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 42521 } }
I20260811 08:11:07.401800 16873 raft_consensus.cc:388] T 00000000000000000000000000000000 P c1a8a0651c404143a4f831a827b9636c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:11:07.401840 16873 raft_consensus.cc:482] T 00000000000000000000000000000000 P c1a8a0651c404143a4f831a827b9636c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:11:07.401885 16873 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c1a8a0651c404143a4f831a827b9636c [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:11:07.402490 16873 raft_consensus.cc:504] T 00000000000000000000000000000000 P c1a8a0651c404143a4f831a827b9636c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1a8a0651c404143a4f831a827b9636c" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 42521 } }
I20260811 08:11:07.402599 16873 leader_election.cc:302] T 00000000000000000000000000000000 P c1a8a0651c404143a4f831a827b9636c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c1a8a0651c404143a4f831a827b9636c; no voters:
I20260811 08:11:07.402796 16873 leader_election.cc:288] T 00000000000000000000000000000000 P c1a8a0651c404143a4f831a827b9636c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:11:07.402830 16881 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c1a8a0651c404143a4f831a827b9636c [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:11:07.403074 16881 raft_consensus.cc:686] T 00000000000000000000000000000000 P c1a8a0651c404143a4f831a827b9636c [term 1 LEADER]: Becoming Leader. State: Replica: c1a8a0651c404143a4f831a827b9636c, State: Running, Role: LEADER
I20260811 08:11:07.403219 16881 consensus_queue.cc:237] T 00000000000000000000000000000000 P c1a8a0651c404143a4f831a827b9636c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1a8a0651c404143a4f831a827b9636c" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 42521 } }
I20260811 08:11:07.403105 16873 sys_catalog.cc:564] T 00000000000000000000000000000000 P c1a8a0651c404143a4f831a827b9636c [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:11:07.404384 16883 sys_catalog.cc:455] T 00000000000000000000000000000000 P c1a8a0651c404143a4f831a827b9636c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c1a8a0651c404143a4f831a827b9636c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1a8a0651c404143a4f831a827b9636c" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 42521 } } }
I20260811 08:11:07.404569 16883 sys_catalog.cc:458] T 00000000000000000000000000000000 P c1a8a0651c404143a4f831a827b9636c [sys.catalog]: This master's current role is: LEADER
I20260811 08:11:07.404844 16899 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:11:07.404927 16873 ranger_client.cc:318] Using new properties file: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260811 08:11:07.405287 16882 sys_catalog.cc:455] T 00000000000000000000000000000000 P c1a8a0651c404143a4f831a827b9636c [sys.catalog]: SysCatalogTable state changed. Reason: New leader c1a8a0651c404143a4f831a827b9636c. Latest consensus state: current_term: 1 leader_uuid: "c1a8a0651c404143a4f831a827b9636c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1a8a0651c404143a4f831a827b9636c" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 42521 } } }
I20260811 08:11:07.405368 16882 sys_catalog.cc:458] T 00000000000000000000000000000000 P c1a8a0651c404143a4f831a827b9636c [sys.catalog]: This master's current role is: LEADER
Aug 11 08:11:07 dist-test-slave-7lbf krb5kdc[16053](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435867, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.243.254@KRBTEST.COM
I20260811 08:11:07.407990 16899 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:11:07.412698 16906 mvcc.cc:205] Tried to move back new op lower bound from 7317241312912261120 to 7317241312884391936. Current Snapshot: MvccSnapshot[applied={T|T < 7317241312912261120}]
I20260811 08:11:07.415694 16880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:07.399973 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49786 (local address 127.27.243.254:42521)
0811 08:11:07.400177 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0811 08:11:07.400187 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 08:11:07.400223 (+ 36us) server_negotiation.cc:407] Connection header received
0811 08:11:07.401002 (+ 779us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:11:07.401013 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:11:07.401082 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:11:07.401249 (+ 167us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:11:07.402047 (+ 798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:07.403490 (+ 1443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:07.404539 (+ 1049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:07.405139 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:07.405237 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:07.408828 (+ 3591us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:11:07.408886 (+ 58us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:11:07.408886 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:11:07.409021 (+ 135us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:11:07.413324 (+ 4303us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:11:07.413837 (+ 513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:11:07.413840 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:11:07.413841 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:11:07.413968 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:11:07.414204 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:11:07.414205 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:11:07.414206 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:11:07.414547 (+ 341us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:11:07.414720 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0811 08:11:07.415290 (+ 570us) server_negotiation.cc:299] Negotiation successful
0811 08:11:07.415459 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":157,"thread_start_us":101,"threads_started":1}
I20260811 08:11:07.417685 16899 catalog_manager.cc:1347] Generated new cluster ID: 382d01ca16a14775a7e9d23182829389
I20260811 08:11:07.417739 16899 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:11:07.425352 16899 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:11:07.426204 16899 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:11:07.444205 16899 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c1a8a0651c404143a4f831a827b9636c: Generated new TSK 0
I20260811 08:11:07.444440 16899 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.27.243.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.243.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.243.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.193.keytab.
Entry for principal kudu/127.27.243.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.193.keytab.
I20260811 08:11:08.143914 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.27.243.212:47245/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.243.193:0
--local_ip_for_outbound_sockets=127.27.243.193
--webserver_interface=127.27.243.193
--webserver_port=0
--tserver_master_addrs=127.27.243.254:42521
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.193.keytab
--principal=kudu/127.27.243.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:36397
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:11:08.254168 16941 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:11:08.254367 16941 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:11:08.254390 16941 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:11:08.255520 16941 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:11:08.255560 16941 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:11:08.255594 16941 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.243.193
I20260811 08:11:08.257207 16941 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:36397
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.27.243.212:47245/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.193.keytab
--principal=kudu/127.27.243.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.243.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.243.193
--webserver_port=0
--tserver_master_addrs=127.27.243.254:42521
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16941
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.243.193
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:11:08.257453 16941 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:11:08.257768 16941 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:11:08.263856 16952 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:11:08.263934 16948 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:11:08.263934 16949 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:11:08.264158 16941 server_base.cc:1034] running on GCE node
I20260811 08:11:08.264358 16941 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:11:08.264581 16941 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:11:08.265717 16941 hybrid_clock.cc:648] HybridClock initialized: now 1786435868265705 us; error 33 us; skew 500 ppm
Aug 11 08:11:08 dist-test-slave-7lbf krb5kdc[16053](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435868, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:11:08.268489 16941 init.cc:377] Logged in from keytab as kudu/127.27.243.193@KRBTEST.COM (short username kudu)
I20260811 08:11:08.269068 16941 webserver.cc:460] Webserver started at http://127.27.243.193:35023/ using document root <none> and password file <none>
I20260811 08:11:08.269362 16941 fs_manager.cc:359] Metadata directory not provided
I20260811 08:11:08.269433 16941 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:11:08.269599 16941 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 08:11:08 dist-test-slave-7lbf krb5kdc[16053](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435868, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.193@KRBTEST.COM for HTTP/127.27.243.212@KRBTEST.COM
I20260811 08:11:08.285351 16941 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/ts-0/data/instance:
uuid: "964e4a5333d447809aee3388a7bae907"
format_stamp: "Formatted at 2026-08-11 08:11:08 on dist-test-slave-7lbf"
server_key: "2d93b13cb2a3c49b90535494c23b0744"
server_key_iv: "d47ccdd990695c7e796c391354542f8a"
server_key_version: "kuduclusterkey@0"
I20260811 08:11:08.285889 16941 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/ts-0/wal/instance:
uuid: "964e4a5333d447809aee3388a7bae907"
format_stamp: "Formatted at 2026-08-11 08:11:08 on dist-test-slave-7lbf"
server_key: "2d93b13cb2a3c49b90535494c23b0744"
server_key_iv: "d47ccdd990695c7e796c391354542f8a"
server_key_version: "kuduclusterkey@0"
I20260811 08:11:08.287688 16941 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260811 08:11:08.302785 16965 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:11:08.303085 16941 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:11:08.303175 16941 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/ts-0/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/ts-0/wal
uuid: "964e4a5333d447809aee3388a7bae907"
format_stamp: "Formatted at 2026-08-11 08:11:08 on dist-test-slave-7lbf"
server_key: "2d93b13cb2a3c49b90535494c23b0744"
server_key_iv: "d47ccdd990695c7e796c391354542f8a"
server_key_version: "kuduclusterkey@0"
I20260811 08:11:08.303268 16941 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:11:08.321623 16941 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:11:08.323916 16941 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:11:08.324160 16941 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:11:08.324548 16941 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:11:08.324999 16941 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:11:08.325098 16941 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:11:08.325205 16941 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:11:08.325284 16941 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:11:08.331790 16941 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.193:37485
I20260811 08:11:08.332408 16941 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/ts-0/data/info.pb
I20260811 08:11:08.335415 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 16941
I20260811 08:11:08.335523 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/ts-0/wal/instance
I20260811 08:11:08.335722 28623 external_mini_cluster.cc:1428] Setting key 07b99b169889eeb1ba797ebee8112d6e
I20260811 08:11:08.334322 17155 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.193:37485 every 8 connection(s)
Aug 11 08:11:08 dist-test-slave-7lbf krb5kdc[16053](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435868, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.193@KRBTEST.COM for kudu/127.27.243.254@KRBTEST.COM
I20260811 08:11:08.351568 17162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:08.335725 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.193:48129 (local address 127.27.243.254:42521)
0811 08:11:08.342615 (+ 6890us) server_negotiation.cc:206] Beginning negotiation
0811 08:11:08.342617 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:11:08.342624 (+ 7us) server_negotiation.cc:407] Connection header received
0811 08:11:08.342650 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:11:08.342650 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:11:08.342663 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:11:08.342729 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:11:08.343542 (+ 813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:08.344341 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:08.345454 (+ 1113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:08.345768 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:08.345841 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:08.348329 (+ 2488us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:11:08.348330 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:11:08.348330 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:11:08.348338 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:11:08.350065 (+ 1727us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:11:08.350570 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:11:08.350571 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:11:08.350572 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:11:08.350643 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:11:08.350921 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:11:08.350922 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:11:08.350923 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:11:08.351048 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:11:08.351108 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0811 08:11:08.351383 (+ 275us) server_negotiation.cc:299] Negotiation successful
0811 08:11:08.351468 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6855,"thread_start_us":89,"threads_started":1}
I20260811 08:11:08.351719 17161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:08.335390 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:42521 (local address 127.27.243.193:48129)
0811 08:11:08.341687 (+ 6297us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:08.341746 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0811 08:11:08.342412 (+ 666us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:11:08.342871 (+ 459us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:11:08.342876 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:11:08.343131 (+ 255us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:11:08.343429 (+ 298us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:11:08.343436 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:11:08.344456 (+ 1020us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:11:08.344457 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:11:08.345358 (+ 901us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:11:08.345360 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:11:08.345930 (+ 570us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:11:08.345931 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:11:08.346071 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:08.346654 (+ 583us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:11:08.346665 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:11:08.348223 (+ 1558us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:11:08.350158 (+ 1935us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:11:08.350167 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:11:08.350170 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:11:08.350463 (+ 293us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:11:08.350711 (+ 248us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:11:08.350712 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:11:08.350713 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:11:08.350849 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:11:08.351113 (+ 264us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:11:08.351120 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:11:08.351254 (+ 134us) client_negotiation.cc:769] Sending connection context
0811 08:11:08.351347 (+ 93us) client_negotiation.cc:240] Negotiation successful
0811 08:11:08.351492 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6237,"thread_start_us":93,"threads_started":1}
I20260811 08:11:08.352260 17156 heartbeater.cc:347] Connected to a master server at 127.27.243.254:42521
I20260811 08:11:08.352370 17156 heartbeater.cc:464] Registering TS with master...
I20260811 08:11:08.352555 17156 heartbeater.cc:511] Master 127.27.243.254:42521 requested a full tablet report, sending...
I20260811 08:11:08.353086 16817 ts_manager.cc:194] Registered new tserver with Master: 964e4a5333d447809aee3388a7bae907 (127.27.243.193:37485)
I20260811 08:11:08.353735 16817 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.243.193@KRBTEST.COM'} at 127.27.243.193:48129
WARNING: no policy specified for kudu/127.27.243.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.243.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.243.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.194.keytab.
Entry for principal kudu/127.27.243.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.194.keytab.
I20260811 08:11:08.384087 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.27.243.212:47245/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.243.194:0
--local_ip_for_outbound_sockets=127.27.243.194
--webserver_interface=127.27.243.194
--webserver_port=0
--tserver_master_addrs=127.27.243.254:42521
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.194.keytab
--principal=kudu/127.27.243.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:36397
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:11:08.482707 17166 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:11:08.482923 17166 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:11:08.482956 17166 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:11:08.484176 17166 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:11:08.484222 17166 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:11:08.484256 17166 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.243.194
I20260811 08:11:08.485742 17166 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:36397
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.27.243.212:47245/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.194.keytab
--principal=kudu/127.27.243.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.243.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.243.194
--webserver_port=0
--tserver_master_addrs=127.27.243.254:42521
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17166
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.243.194
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:11:08.485982 17166 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:11:08.486189 17166 file_cache.cc:493] Constructed file cache file cache with capacity 419430
Aug 11 08:11:08 dist-test-slave-7lbf krb5kdc[16053](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786435868, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260811 08:11:08.491070 17187 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:11:08.491290 17178 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:11:08.491317 17179 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:11:08.491549 17166 server_base.cc:1034] running on GCE node
I20260811 08:11:08.491823 17166 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:11:08.492069 17166 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:11:08.493223 17166 hybrid_clock.cc:648] HybridClock initialized: now 1786435868493210 us; error 26 us; skew 500 ppm
Aug 11 08:11:08 dist-test-slave-7lbf krb5kdc[16053](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435868, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:11:08.495886 17166 init.cc:377] Logged in from keytab as kudu/127.27.243.194@KRBTEST.COM (short username kudu)
I20260811 08:11:08.496340 17166 webserver.cc:460] Webserver started at http://127.27.243.194:33433/ using document root <none> and password file <none>
I20260811 08:11:08.496560 17166 fs_manager.cc:359] Metadata directory not provided
I20260811 08:11:08.496609 17166 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:11:08.496742 17166 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 08:11:08 dist-test-slave-7lbf krb5kdc[16053](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435868, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.194@KRBTEST.COM for HTTP/127.27.243.212@KRBTEST.COM
I20260811 08:11:08.515269 17166 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/ts-1/data/instance:
uuid: "34788ced6040463d9ed73f6333426f80"
format_stamp: "Formatted at 2026-08-11 08:11:08 on dist-test-slave-7lbf"
server_key: "8446b965b83ad92c782eda41dac35029"
server_key_iv: "d816dc4150b3fe9794d075cc2d747322"
server_key_version: "kuduclusterkey@0"
I20260811 08:11:08.515681 17166 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/ts-1/wal/instance:
uuid: "34788ced6040463d9ed73f6333426f80"
format_stamp: "Formatted at 2026-08-11 08:11:08 on dist-test-slave-7lbf"
server_key: "8446b965b83ad92c782eda41dac35029"
server_key_iv: "d816dc4150b3fe9794d075cc2d747322"
server_key_version: "kuduclusterkey@0"
I20260811 08:11:08.517889 17166 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260811 08:11:08.541664 17199 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:11:08.541864 17166 fs_manager.cc:725] Time spent opening block manager: real 0.007s user 0.001s sys 0.000s
I20260811 08:11:08.541978 17166 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/ts-1/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/ts-1/wal
uuid: "34788ced6040463d9ed73f6333426f80"
format_stamp: "Formatted at 2026-08-11 08:11:08 on dist-test-slave-7lbf"
server_key: "8446b965b83ad92c782eda41dac35029"
server_key_iv: "d816dc4150b3fe9794d075cc2d747322"
server_key_version: "kuduclusterkey@0"
I20260811 08:11:08.542083 17166 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:11:08.554490 17166 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:11:08.556301 17166 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:11:08.556445 17166 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:11:08.556674 17166 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:11:08.557036 17166 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:11:08.557085 17166 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:11:08.557116 17166 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:11:08.557132 17166 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:11:08.563482 17166 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.194:42941
I20260811 08:11:08.563905 17166 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/ts-1/data/info.pb
I20260811 08:11:08.569378 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 17166
I20260811 08:11:08.569478 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/ts-1/wal/instance
I20260811 08:11:08.569695 28623 external_mini_cluster.cc:1428] Setting key ae6c934f9210f3065204f06bf0e97a03
I20260811 08:11:08.575397 17384 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.194:42941 every 8 connection(s)
WARNING: no policy specified for kudu/127.27.243.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.243.195@KRBTEST.COM" created.
Aug 11 08:11:08 dist-test-slave-7lbf krb5kdc[16053](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435868, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.194@KRBTEST.COM for kudu/127.27.243.254@KRBTEST.COM
I20260811 08:11:08.596499 17162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:08.575904 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.194:40701 (local address 127.27.243.254:42521)
0811 08:11:08.575947 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 08:11:08.575950 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:11:08.576154 (+ 204us) server_negotiation.cc:407] Connection header received
0811 08:11:08.576846 (+ 692us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:11:08.576848 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:11:08.576863 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:11:08.576893 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:11:08.577793 (+ 900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:08.578609 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:08.580138 (+ 1529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:08.580449 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:08.580491 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:08.592787 (+ 12296us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:11:08.592789 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:11:08.592789 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:11:08.592798 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:11:08.594567 (+ 1769us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:11:08.595126 (+ 559us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:11:08.595127 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:11:08.595128 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:11:08.595194 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:11:08.595505 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:11:08.595506 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:11:08.595507 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:11:08.595659 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:11:08.595707 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0811 08:11:08.596306 (+ 599us) server_negotiation.cc:299] Negotiation successful
0811 08:11:08.596404 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 08:11:08.597731 17392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:08.575588 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:42521 (local address 127.27.243.194:40701)
0811 08:11:08.576030 (+ 442us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:08.576076 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 08:11:08.576706 (+ 630us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:11:08.577086 (+ 380us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:11:08.577091 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:11:08.577350 (+ 259us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:11:08.577674 (+ 324us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:11:08.577682 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:11:08.578735 (+ 1053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:11:08.578736 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:11:08.580032 (+ 1296us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:11:08.580035 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:11:08.580652 (+ 617us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:11:08.580653 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:11:08.580804 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:08.591088 (+ 10284us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:11:08.591100 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:11:08.592680 (+ 1580us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:11:08.594673 (+ 1993us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:11:08.594681 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:11:08.594683 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:11:08.595017 (+ 334us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:11:08.595273 (+ 256us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:11:08.595274 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:11:08.595274 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:11:08.595418 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:11:08.595759 (+ 341us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:11:08.595765 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:11:08.595978 (+ 213us) client_negotiation.cc:769] Sending connection context
0811 08:11:08.596902 (+ 924us) client_negotiation.cc:240] Negotiation successful
0811 08:11:08.597093 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":398,"thread_start_us":84,"threads_started":1}
I20260811 08:11:08.598430 17386 heartbeater.cc:347] Connected to a master server at 127.27.243.254:42521
I20260811 08:11:08.598529 17386 heartbeater.cc:464] Registering TS with master...
I20260811 08:11:08.598729 17386 heartbeater.cc:511] Master 127.27.243.254:42521 requested a full tablet report, sending...
I20260811 08:11:08.599259 16817 ts_manager.cc:194] Registered new tserver with Master: 34788ced6040463d9ed73f6333426f80 (127.27.243.194:42941)
I20260811 08:11:08.599772 16817 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.243.194@KRBTEST.COM'} at 127.27.243.194:40701
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.243.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.195.keytab.
Entry for principal kudu/127.27.243.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.195.keytab.
I20260811 08:11:08.606029 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.27.243.212:47245/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.243.195:0
--local_ip_for_outbound_sockets=127.27.243.195
--webserver_interface=127.27.243.195
--webserver_port=0
--tserver_master_addrs=127.27.243.254:42521
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.195.keytab
--principal=kudu/127.27.243.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:36397
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:11:08.729501 17394 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:11:08.729918 17394 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:11:08.730003 17394 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:11:08.731669 17394 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:11:08.731789 17394 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:11:08.731887 17394 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.243.195
I20260811 08:11:08.734354 17394 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:36397
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.27.243.212:47245/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.195.keytab
--principal=kudu/127.27.243.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.243.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.243.195
--webserver_port=0
--tserver_master_addrs=127.27.243.254:42521
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17394
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.243.195
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:11:08.734831 17394 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:11:08.735138 17394 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:11:08.741679 17403 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:11:08.741673 17404 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:11:08.742056 17408 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:11:08.742760 17394 server_base.cc:1034] running on GCE node
I20260811 08:11:08.742976 17394 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:11:08.743256 17394 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:11:08.744442 17394 hybrid_clock.cc:648] HybridClock initialized: now 1786435868744402 us; error 54 us; skew 500 ppm
Aug 11 08:11:08 dist-test-slave-7lbf krb5kdc[16053](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435868, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:11:08.747884 17394 init.cc:377] Logged in from keytab as kudu/127.27.243.195@KRBTEST.COM (short username kudu)
I20260811 08:11:08.748407 17394 webserver.cc:460] Webserver started at http://127.27.243.195:37553/ using document root <none> and password file <none>
I20260811 08:11:08.748688 17394 fs_manager.cc:359] Metadata directory not provided
I20260811 08:11:08.748755 17394 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:11:08.748883 17394 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 08:11:08 dist-test-slave-7lbf krb5kdc[16053](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435868, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.195@KRBTEST.COM for HTTP/127.27.243.212@KRBTEST.COM
I20260811 08:11:08.767319 17394 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/ts-2/data/instance:
uuid: "c610b818ba404da4b58b7616b721b868"
format_stamp: "Formatted at 2026-08-11 08:11:08 on dist-test-slave-7lbf"
server_key: "c2b2721b9dd2cf385d9dd58f2f32cd29"
server_key_iv: "4f664dc369023334994aa76b51e18879"
server_key_version: "kuduclusterkey@0"
I20260811 08:11:08.768007 17394 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/ts-2/wal/instance:
uuid: "c610b818ba404da4b58b7616b721b868"
format_stamp: "Formatted at 2026-08-11 08:11:08 on dist-test-slave-7lbf"
server_key: "c2b2721b9dd2cf385d9dd58f2f32cd29"
server_key_iv: "4f664dc369023334994aa76b51e18879"
server_key_version: "kuduclusterkey@0"
I20260811 08:11:08.773289 17394 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.000s
I20260811 08:11:08.788813 17419 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:11:08.789045 17394 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.001s
I20260811 08:11:08.789140 17394 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/ts-2/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/ts-2/wal
uuid: "c610b818ba404da4b58b7616b721b868"
format_stamp: "Formatted at 2026-08-11 08:11:08 on dist-test-slave-7lbf"
server_key: "c2b2721b9dd2cf385d9dd58f2f32cd29"
server_key_iv: "4f664dc369023334994aa76b51e18879"
server_key_version: "kuduclusterkey@0"
I20260811 08:11:08.789243 17394 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:11:08.814543 17394 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:11:08.816943 17394 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:11:08.817109 17394 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:11:08.817341 17394 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:11:08.817746 17394 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:11:08.817801 17394 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:11:08.817831 17394 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:11:08.817852 17394 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:11:08.825469 17394 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.195:39967
I20260811 08:11:08.825567 17602 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.195:39967 every 8 connection(s)
I20260811 08:11:08.826066 17394 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/ts-2/data/info.pb
I20260811 08:11:08.829595 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 17394
I20260811 08:11:08.829699 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/ts-2/wal/instance
I20260811 08:11:08.829886 28623 external_mini_cluster.cc:1428] Setting key e8985831b7f8e51277b7ffa50518e703
Aug 11 08:11:08 dist-test-slave-7lbf krb5kdc[16053](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435868, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.195@KRBTEST.COM for kudu/127.27.243.254@KRBTEST.COM
I20260811 08:11:08.837622 17162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:08.827246 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.195:39783 (local address 127.27.243.254:42521)
0811 08:11:08.827293 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 08:11:08.827296 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:11:08.827314 (+ 18us) server_negotiation.cc:407] Connection header received
0811 08:11:08.827982 (+ 668us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:11:08.827983 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:11:08.827996 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:11:08.828056 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:11:08.828792 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:08.829578 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:08.831617 (+ 2039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:08.831908 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:08.831983 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:08.834454 (+ 2471us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:11:08.834455 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:11:08.834456 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:11:08.834464 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:11:08.836007 (+ 1543us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:11:08.836474 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:11:08.836476 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:11:08.836476 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:11:08.836548 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:11:08.836834 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:11:08.836836 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:11:08.836836 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:11:08.836996 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:11:08.837076 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 08:11:08.837386 (+ 310us) server_negotiation.cc:299] Negotiation successful
0811 08:11:08.837494 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 08:11:08.838065 17607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:08.826987 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:42521 (local address 127.27.243.195:39783)
0811 08:11:08.827183 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:08.827237 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0811 08:11:08.827859 (+ 622us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:11:08.828147 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:11:08.828151 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:11:08.828406 (+ 255us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:11:08.828696 (+ 290us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:11:08.828704 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:11:08.829783 (+ 1079us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:11:08.829784 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:11:08.831522 (+ 1738us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:11:08.831525 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:11:08.832010 (+ 485us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:11:08.832011 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:11:08.832155 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:08.832739 (+ 584us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:11:08.832749 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:11:08.834355 (+ 1606us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:11:08.836098 (+ 1743us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:11:08.836106 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:11:08.836108 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:11:08.836379 (+ 271us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:11:08.836631 (+ 252us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:11:08.836632 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:11:08.836632 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:11:08.836767 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:11:08.837071 (+ 304us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:11:08.837076 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:11:08.837238 (+ 162us) client_negotiation.cc:769] Sending connection context
0811 08:11:08.837350 (+ 112us) client_negotiation.cc:240] Negotiation successful
0811 08:11:08.837541 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":92,"threads_started":1}
I20260811 08:11:08.838686 17604 heartbeater.cc:347] Connected to a master server at 127.27.243.254:42521
I20260811 08:11:08.838824 17604 heartbeater.cc:464] Registering TS with master...
I20260811 08:11:08.839051 17604 heartbeater.cc:511] Master 127.27.243.254:42521 requested a full tablet report, sending...
I20260811 08:11:08.839419 16817 ts_manager.cc:194] Registered new tserver with Master: c610b818ba404da4b58b7616b721b868 (127.27.243.195:39967)
I20260811 08:11:08.839877 16817 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.243.195@KRBTEST.COM'} at 127.27.243.195:39783
I20260811 08:11:08.841697 28623 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 08:11:08.842518 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 16941
I20260811 08:11:08.899149 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 17166
I20260811 08:11:08.910815 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 17394
I20260811 08:11:08.923679 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 16769
I20260811 08:11:08.937408 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.243.254:42521
--webserver_interface=127.27.243.254
--webserver_port=35977
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab
--principal=kudu/127.27.243.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:36397
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.243.254:42521
--ranger_config_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.27.243.212:47245/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.27.243.212:47245/kms with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:11:09.021795 17608 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:11:09.022014 17608 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:11:09.022045 17608 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:11:09.023171 17608 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:11:09.023221 17608 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:11:09.023243 17608 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:11:09.023262 17608 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:11:09.023280 17608 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:11:09.024848 17608 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:36397
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.27.243.212:47245/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.27.243.254:42521
--ranger_config_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab
--principal=kudu/127.27.243.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.243.254:42521
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.243.254
--webserver_port=35977
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17608
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:11:09.025080 17608 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:11:09.025301 17608 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:11:09.031112 17615 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:11:09.031209 17614 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:11:09.031131 17617 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:11:09.031396 17608 server_base.cc:1034] running on GCE node
I20260811 08:11:09.031634 17608 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:11:09.031929 17608 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:11:09.033092 17608 hybrid_clock.cc:648] HybridClock initialized: now 1786435869033076 us; error 33 us; skew 500 ppm
Aug 11 08:11:09 dist-test-slave-7lbf krb5kdc[16053](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435869, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:11:09.035681 17608 init.cc:377] Logged in from keytab as kudu/127.27.243.254@KRBTEST.COM (short username kudu)
I20260811 08:11:09.036147 17608 webserver.cc:460] Webserver started at http://127.27.243.254:35977/ using document root <none> and password file <none>
I20260811 08:11:09.036401 17608 fs_manager.cc:359] Metadata directory not provided
I20260811 08:11:09.036468 17608 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 08:11:09 dist-test-slave-7lbf krb5kdc[16053](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435869, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.254@KRBTEST.COM for HTTP/127.27.243.212@KRBTEST.COM
I20260811 08:11:09.116345 17608 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:11:09.117231 17630 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:11:09.117413 17608 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 08:11:09.117499 17608 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/master-0/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/master-0/wal
uuid: "c1a8a0651c404143a4f831a827b9636c"
format_stamp: "Formatted at 2026-08-11 08:11:07 on dist-test-slave-7lbf"
server_key: "9df671a98b7b466b861c3012d17a57cd"
server_key_iv: "d65287db41c41819bbd5b106b8757781"
server_key_version: "kuduclusterkey@0"
I20260811 08:11:09.117897 17608 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:11:09.132491 17608 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:11:09.134330 17608 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:11:09.134469 17608 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:11:09.138561 17608 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.254:42521
I20260811 08:11:09.138615 17717 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.254:42521 every 8 connection(s)
I20260811 08:11:09.138965 17608 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
I20260811 08:11:09.140280 17723 sys_catalog.cc:263] Verifying existing consensus state
I20260811 08:11:09.140914 17723 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c1a8a0651c404143a4f831a827b9636c: Bootstrap starting.
I20260811 08:11:09.144774 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 17608
I20260811 08:11:09.145031 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.27.243.212:47245/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.243.193:37485
--local_ip_for_outbound_sockets=127.27.243.193
--tserver_master_addrs=127.27.243.254:42521
--webserver_port=35023
--webserver_interface=127.27.243.193
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.193.keytab
--principal=kudu/127.27.243.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:36397
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.27.243.212:47245/kms with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 08:11:09.148717 17723 log.cc:824] T 00000000000000000000000000000000 P c1a8a0651c404143a4f831a827b9636c: Log is configured to *not* fsync() on all Append() calls
I20260811 08:11:09.150636 17723 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c1a8a0651c404143a4f831a827b9636c: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 08:11:09.150915 17723 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c1a8a0651c404143a4f831a827b9636c: Bootstrap complete.
I20260811 08:11:09.153110 17723 raft_consensus.cc:348] T 00000000000000000000000000000000 P c1a8a0651c404143a4f831a827b9636c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1a8a0651c404143a4f831a827b9636c" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 42521 } }
I20260811 08:11:09.153347 17723 raft_consensus.cc:729] T 00000000000000000000000000000000 P c1a8a0651c404143a4f831a827b9636c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1a8a0651c404143a4f831a827b9636c, State: Initialized, Role: FOLLOWER
I20260811 08:11:09.153542 17723 consensus_queue.cc:260] T 00000000000000000000000000000000 P c1a8a0651c404143a4f831a827b9636c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1a8a0651c404143a4f831a827b9636c" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 42521 } }
I20260811 08:11:09.153631 17723 raft_consensus.cc:388] T 00000000000000000000000000000000 P c1a8a0651c404143a4f831a827b9636c [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:11:09.153682 17723 raft_consensus.cc:482] T 00000000000000000000000000000000 P c1a8a0651c404143a4f831a827b9636c [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:11:09.153735 17723 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c1a8a0651c404143a4f831a827b9636c [term 1 FOLLOWER]: Advancing to term 2
I20260811 08:11:09.154739 17723 raft_consensus.cc:504] T 00000000000000000000000000000000 P c1a8a0651c404143a4f831a827b9636c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1a8a0651c404143a4f831a827b9636c" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 42521 } }
I20260811 08:11:09.154850 17723 leader_election.cc:302] T 00000000000000000000000000000000 P c1a8a0651c404143a4f831a827b9636c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c1a8a0651c404143a4f831a827b9636c; no voters:
I20260811 08:11:09.155012 17723 leader_election.cc:288] T 00000000000000000000000000000000 P c1a8a0651c404143a4f831a827b9636c [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 08:11:09.155066 17728 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c1a8a0651c404143a4f831a827b9636c [term 2 FOLLOWER]: Leader election won for term 2
I20260811 08:11:09.155185 17728 raft_consensus.cc:686] T 00000000000000000000000000000000 P c1a8a0651c404143a4f831a827b9636c [term 2 LEADER]: Becoming Leader. State: Replica: c1a8a0651c404143a4f831a827b9636c, State: Running, Role: LEADER
I20260811 08:11:09.155284 17723 sys_catalog.cc:564] T 00000000000000000000000000000000 P c1a8a0651c404143a4f831a827b9636c [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:11:09.155296 17728 consensus_queue.cc:237] T 00000000000000000000000000000000 P c1a8a0651c404143a4f831a827b9636c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1a8a0651c404143a4f831a827b9636c" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 42521 } }
I20260811 08:11:09.155603 17730 sys_catalog.cc:455] T 00000000000000000000000000000000 P c1a8a0651c404143a4f831a827b9636c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "c1a8a0651c404143a4f831a827b9636c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1a8a0651c404143a4f831a827b9636c" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 42521 } } }
I20260811 08:11:09.155683 17730 sys_catalog.cc:458] T 00000000000000000000000000000000 P c1a8a0651c404143a4f831a827b9636c [sys.catalog]: This master's current role is: LEADER
I20260811 08:11:09.155978 17731 sys_catalog.cc:455] T 00000000000000000000000000000000 P c1a8a0651c404143a4f831a827b9636c [sys.catalog]: SysCatalogTable state changed. Reason: New leader c1a8a0651c404143a4f831a827b9636c. Latest consensus state: current_term: 2 leader_uuid: "c1a8a0651c404143a4f831a827b9636c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1a8a0651c404143a4f831a827b9636c" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 42521 } } }
I20260811 08:11:09.156054 17731 sys_catalog.cc:458] T 00000000000000000000000000000000 P c1a8a0651c404143a4f831a827b9636c [sys.catalog]: This master's current role is: LEADER
I20260811 08:11:09.156167 17734 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:11:09.156653 17734 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:11:09.156769 17734 catalog_manager.cc:1259] Loaded cluster ID: 382d01ca16a14775a7e9d23182829389
I20260811 08:11:09.156800 17734 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:11:09.157024 17723 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260811 08:11:09.160390 17734 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:11:09.160914 17734 catalog_manager.cc:5879] T 00000000000000000000000000000000 P c1a8a0651c404143a4f831a827b9636c: Loaded TSK: 0
I20260811 08:11:09.161204 17734 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 08:11:09.232264 17726 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:11:09.232465 17726 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:11:09.232497 17726 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:11:09.233788 17726 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:11:09.233835 17726 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:11:09.233879 17726 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.243.193
I20260811 08:11:09.235776 17726 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:36397
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.27.243.212:47245/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.193.keytab
--principal=kudu/127.27.243.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.243.193:37485
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.243.193
--webserver_port=35023
--tserver_master_addrs=127.27.243.254:42521
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17726
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.243.193
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:11:09.235997 17726 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:11:09.236225 17726 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:11:09.242214 17780 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:11:09.242336 17785 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:11:09.242214 17778 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:11:09.243192 17726 server_base.cc:1034] running on GCE node
I20260811 08:11:09.243424 17726 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:11:09.243654 17726 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:11:09.246874 17726 hybrid_clock.cc:648] HybridClock initialized: now 1786435869246864 us; error 26 us; skew 500 ppm
Aug 11 08:11:09 dist-test-slave-7lbf krb5kdc[16053](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435869, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:11:09.249370 17726 init.cc:377] Logged in from keytab as kudu/127.27.243.193@KRBTEST.COM (short username kudu)
I20260811 08:11:09.249846 17726 webserver.cc:460] Webserver started at http://127.27.243.193:35023/ using document root <none> and password file <none>
I20260811 08:11:09.250059 17726 fs_manager.cc:359] Metadata directory not provided
I20260811 08:11:09.250124 17726 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 08:11:09 dist-test-slave-7lbf krb5kdc[16053](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435869, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.193@KRBTEST.COM for HTTP/127.27.243.212@KRBTEST.COM
I20260811 08:11:09.265187 17726 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.000s sys 0.001s
I20260811 08:11:09.266333 17803 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:11:09.266544 17726 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 08:11:09.266636 17726 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/ts-0/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/ts-0/wal
uuid: "964e4a5333d447809aee3388a7bae907"
format_stamp: "Formatted at 2026-08-11 08:11:08 on dist-test-slave-7lbf"
server_key: "2d93b13cb2a3c49b90535494c23b0744"
server_key_iv: "d47ccdd990695c7e796c391354542f8a"
server_key_version: "kuduclusterkey@0"
I20260811 08:11:09.267107 17726 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:11:09.280686 17726 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:11:09.282564 17726 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:11:09.282711 17726 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:11:09.282923 17726 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:11:09.283263 17726 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:11:09.283300 17726 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:11:09.283329 17726 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:11:09.283370 17726 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:11:09.290171 17726 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.193:37485
I20260811 08:11:09.290702 17726 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/ts-0/data/info.pb
I20260811 08:11:09.291924 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 17726
I20260811 08:11:09.292212 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.27.243.212:47245/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.243.194:42941
--local_ip_for_outbound_sockets=127.27.243.194
--tserver_master_addrs=127.27.243.254:42521
--webserver_port=33433
--webserver_interface=127.27.243.194
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.194.keytab
--principal=kudu/127.27.243.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:36397
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.27.243.212:47245/kms with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 08:11:09.298028 17982 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.193:37485 every 8 connection(s)
Aug 11 08:11:09 dist-test-slave-7lbf krb5kdc[16053](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435869, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.193@KRBTEST.COM for kudu/127.27.243.254@KRBTEST.COM
I20260811 08:11:09.311687 17988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:09.298699 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:42521 (local address 127.27.243.193:54733)
0811 08:11:09.299417 (+ 718us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:09.299465 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0811 08:11:09.300104 (+ 639us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:11:09.300892 (+ 788us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:11:09.300898 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:11:09.301127 (+ 229us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:11:09.301451 (+ 324us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:11:09.301459 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:11:09.303144 (+ 1685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:11:09.303145 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:11:09.304402 (+ 1257us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:11:09.304406 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:11:09.305355 (+ 949us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:11:09.305356 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:11:09.305490 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:09.306084 (+ 594us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:11:09.306094 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:11:09.307557 (+ 1463us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:11:09.309788 (+ 2231us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:11:09.309794 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:11:09.309797 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:11:09.310094 (+ 297us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:11:09.310388 (+ 294us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:11:09.310389 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:11:09.310389 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:11:09.310510 (+ 121us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:11:09.311005 (+ 495us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:11:09.311012 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:11:09.311166 (+ 154us) client_negotiation.cc:769] Sending connection context
0811 08:11:09.311276 (+ 110us) client_negotiation.cc:240] Negotiation successful
0811 08:11:09.311454 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":675,"thread_start_us":92,"threads_started":1}
I20260811 08:11:09.312454 17993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:09.298803 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.193:54733 (local address 127.27.243.254:42521)
0811 08:11:09.299318 (+ 515us) server_negotiation.cc:206] Beginning negotiation
0811 08:11:09.299329 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 08:11:09.300274 (+ 945us) server_negotiation.cc:407] Connection header received
0811 08:11:09.300454 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:11:09.300462 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:11:09.300556 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:11:09.300699 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:11:09.301613 (+ 914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:09.303023 (+ 1410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:09.304506 (+ 1483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:09.305118 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:09.305225 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:09.307700 (+ 2475us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:11:09.307705 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:11:09.307705 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:11:09.307717 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:11:09.309699 (+ 1982us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:11:09.310200 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:11:09.310203 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:11:09.310204 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:11:09.310318 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:11:09.310595 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:11:09.310596 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:11:09.310596 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:11:09.310889 (+ 293us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:11:09.310975 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0811 08:11:09.312096 (+ 1121us) server_negotiation.cc:299] Negotiation successful
0811 08:11:09.312215 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":436,"thread_start_us":115,"threads_started":1}
I20260811 08:11:09.313583 17983 heartbeater.cc:347] Connected to a master server at 127.27.243.254:42521
I20260811 08:11:09.313685 17983 heartbeater.cc:464] Registering TS with master...
I20260811 08:11:09.313876 17983 heartbeater.cc:511] Master 127.27.243.254:42521 requested a full tablet report, sending...
W20260811 08:11:09.314819 17983 heartbeater.cc:644] Failed to heartbeat to 127.27.243.254:42521 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260811 08:11:09.314893 17983 heartbeater.cc:464] Registering TS with master...
I20260811 08:11:09.314955 17983 heartbeater.cc:511] Master 127.27.243.254:42521 requested a full tablet report, sending...
I20260811 08:11:09.315372 17983 heartbeater.cc:464] Registering TS with master...
I20260811 08:11:09.315443 17983 heartbeater.cc:511] Master 127.27.243.254:42521 requested a full tablet report, sending...
W20260811 08:11:09.315739 17983 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 08:11:09.411617 17987 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:11:09.411895 17987 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:11:09.411935 17987 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:11:09.413642 17987 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:11:09.413767 17987 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:11:09.413880 17987 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.243.194
I20260811 08:11:09.416051 17987 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:36397
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.27.243.212:47245/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.194.keytab
--principal=kudu/127.27.243.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.243.194:42941
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.243.194
--webserver_port=33433
--tserver_master_addrs=127.27.243.254:42521
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17987
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.243.194
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:11:09.416517 17987 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:11:09.416898 17987 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 08:11:09.423702 17987 server_base.cc:1034] running on GCE node
W20260811 08:11:09.423676 18003 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:11:09.423950 18009 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:11:09.424137 18000 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:11:09.424363 17987 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:11:09.424578 17987 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:11:09.425729 17987 hybrid_clock.cc:648] HybridClock initialized: now 1786435869425712 us; error 32 us; skew 500 ppm
Aug 11 08:11:09 dist-test-slave-7lbf krb5kdc[16053](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435869, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:11:09.429147 17987 init.cc:377] Logged in from keytab as kudu/127.27.243.194@KRBTEST.COM (short username kudu)
I20260811 08:11:09.429704 17987 webserver.cc:460] Webserver started at http://127.27.243.194:33433/ using document root <none> and password file <none>
I20260811 08:11:09.429975 17987 fs_manager.cc:359] Metadata directory not provided
I20260811 08:11:09.430047 17987 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 08:11:09 dist-test-slave-7lbf krb5kdc[16053](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435869, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.194@KRBTEST.COM for HTTP/127.27.243.212@KRBTEST.COM
I20260811 08:11:09.457934 17987 fs_manager.cc:709] Time spent opening directory manager: real 0.006s user 0.001s sys 0.000s
I20260811 08:11:09.459033 18026 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:11:09.459240 17987 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 08:11:09.459335 17987 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/ts-1/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/ts-1/wal
uuid: "34788ced6040463d9ed73f6333426f80"
format_stamp: "Formatted at 2026-08-11 08:11:08 on dist-test-slave-7lbf"
server_key: "8446b965b83ad92c782eda41dac35029"
server_key_iv: "d816dc4150b3fe9794d075cc2d747322"
server_key_version: "kuduclusterkey@0"
I20260811 08:11:09.459787 17987 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:11:09.479575 17987 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:11:09.481997 17987 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:11:09.482223 17987 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:11:09.482542 17987 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:11:09.482969 17987 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:11:09.483032 17987 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:11:09.483063 17987 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:11:09.483124 17987 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:11:09.490224 17987 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.194:42941
I20260811 08:11:09.490610 17987 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/ts-1/data/info.pb
I20260811 08:11:09.491151 18202 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.194:42941 every 8 connection(s)
I20260811 08:11:09.492262 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 17987
I20260811 08:11:09.492547 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.27.243.212:47245/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.243.195:39967
--local_ip_for_outbound_sockets=127.27.243.195
--tserver_master_addrs=127.27.243.254:42521
--webserver_port=37553
--webserver_interface=127.27.243.195
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.195.keytab
--principal=kudu/127.27.243.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:36397
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.27.243.212:47245/kms with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 08:11:09 dist-test-slave-7lbf krb5kdc[16053](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435869, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.194@KRBTEST.COM for kudu/127.27.243.254@KRBTEST.COM
I20260811 08:11:09.501223 18207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:09.491328 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:42521 (local address 127.27.243.194:59655)
0811 08:11:09.491488 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:09.491527 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 08:11:09.492083 (+ 556us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:11:09.492498 (+ 415us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:11:09.492503 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:11:09.492704 (+ 201us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:11:09.492963 (+ 259us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:11:09.492969 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:11:09.493978 (+ 1009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:11:09.493979 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:11:09.494941 (+ 962us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:11:09.494945 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:11:09.495464 (+ 519us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:11:09.495465 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:11:09.495605 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:09.496139 (+ 534us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:11:09.496151 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:11:09.497659 (+ 1508us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:11:09.499556 (+ 1897us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:11:09.499564 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:11:09.499566 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:11:09.499871 (+ 305us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:11:09.500109 (+ 238us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:11:09.500110 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:11:09.500110 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:11:09.500244 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:11:09.500546 (+ 302us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:11:09.500553 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:11:09.500715 (+ 162us) client_negotiation.cc:769] Sending connection context
0811 08:11:09.500841 (+ 126us) client_negotiation.cc:240] Negotiation successful
0811 08:11:09.500996 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":81,"threads_started":1}
I20260811 08:11:09.501724 17993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:09.491636 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.194:59655 (local address 127.27.243.254:42521)
0811 08:11:09.491698 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0811 08:11:09.491701 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:11:09.491712 (+ 11us) server_negotiation.cc:407] Connection header received
0811 08:11:09.492219 (+ 507us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:11:09.492221 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:11:09.492235 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:11:09.492266 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:11:09.493085 (+ 819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:09.493874 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:09.495040 (+ 1166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:09.495345 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:09.495429 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:09.497861 (+ 2432us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:11:09.497863 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:11:09.497863 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:11:09.497871 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:11:09.499465 (+ 1594us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:11:09.499965 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:11:09.499967 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:11:09.499967 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:11:09.500037 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:11:09.500319 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:11:09.500320 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:11:09.500321 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:11:09.500456 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:11:09.500517 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 08:11:09.501547 (+ 1030us) server_negotiation.cc:299] Negotiation successful
0811 08:11:09.501634 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260811 08:11:09.502390 18204 heartbeater.cc:347] Connected to a master server at 127.27.243.254:42521
I20260811 08:11:09.502532 18204 heartbeater.cc:464] Registering TS with master...
I20260811 08:11:09.502765 18204 heartbeater.cc:511] Master 127.27.243.254:42521 requested a full tablet report, sending...
W20260811 08:11:09.503456 18204 heartbeater.cc:644] Failed to heartbeat to 127.27.243.254:42521 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260811 08:11:09.503573 18204 heartbeater.cc:464] Registering TS with master...
I20260811 08:11:09.503679 18204 heartbeater.cc:511] Master 127.27.243.254:42521 requested a full tablet report, sending...
I20260811 08:11:09.504050 18204 heartbeater.cc:464] Registering TS with master...
I20260811 08:11:09.504163 18204 heartbeater.cc:511] Master 127.27.243.254:42521 requested a full tablet report, sending...
W20260811 08:11:09.504518 18204 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 08:11:09.591704 18208 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:11:09.591970 18208 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:11:09.592005 18208 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:11:09.593691 18208 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:11:09.593817 18208 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:11:09.593906 18208 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.243.195
I20260811 08:11:09.596053 18208 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:36397
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.27.243.212:47245/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.195.keytab
--principal=kudu/127.27.243.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.243.195:39967
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.243.195
--webserver_port=37553
--tserver_master_addrs=127.27.243.254:42521
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18208
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.243.195
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:11:09.596522 18208 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:11:09.596837 18208 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:11:09.603812 18219 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:11:09.603814 18220 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:11:09.604803 18225 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:11:09.605290 18208 server_base.cc:1034] running on GCE node
I20260811 08:11:09.605507 18208 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:11:09.605782 18208 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:11:09.606946 18208 hybrid_clock.cc:648] HybridClock initialized: now 1786435869606911 us; error 47 us; skew 500 ppm
Aug 11 08:11:09 dist-test-slave-7lbf krb5kdc[16053](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435869, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:11:09.610162 18208 init.cc:377] Logged in from keytab as kudu/127.27.243.195@KRBTEST.COM (short username kudu)
I20260811 08:11:09.610707 18208 webserver.cc:460] Webserver started at http://127.27.243.195:37553/ using document root <none> and password file <none>
I20260811 08:11:09.610975 18208 fs_manager.cc:359] Metadata directory not provided
I20260811 08:11:09.611061 18208 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 08:11:09 dist-test-slave-7lbf krb5kdc[16053](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435869, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.195@KRBTEST.COM for HTTP/127.27.243.212@KRBTEST.COM
I20260811 08:11:09.634016 18208 fs_manager.cc:709] Time spent opening directory manager: real 0.009s user 0.001s sys 0.000s
I20260811 08:11:09.637964 18246 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:11:09.638229 18208 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.000s sys 0.000s
I20260811 08:11:09.638347 18208 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/ts-2/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/ts-2/wal
uuid: "c610b818ba404da4b58b7616b721b868"
format_stamp: "Formatted at 2026-08-11 08:11:08 on dist-test-slave-7lbf"
server_key: "c2b2721b9dd2cf385d9dd58f2f32cd29"
server_key_iv: "4f664dc369023334994aa76b51e18879"
server_key_version: "kuduclusterkey@0"
I20260811 08:11:09.638862 18208 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:11:09.666095 18208 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:11:09.668455 18208 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:11:09.668629 18208 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:11:09.668929 18208 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:11:09.669318 18208 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:11:09.669364 18208 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:11:09.669386 18208 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:11:09.669397 18208 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:11:09.676849 18208 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.195:39967
I20260811 08:11:09.676911 18442 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.195:39967 every 8 connection(s)
I20260811 08:11:09.677459 18208 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/ts-2/data/info.pb
I20260811 08:11:09.682838 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 18208
Aug 11 08:11:09 dist-test-slave-7lbf krb5kdc[16053](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435869, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.195@KRBTEST.COM for kudu/127.27.243.254@KRBTEST.COM
I20260811 08:11:09.689071 17993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:09.678850 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.195:52391 (local address 127.27.243.254:42521)
0811 08:11:09.678950 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0811 08:11:09.678952 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:11:09.679101 (+ 149us) server_negotiation.cc:407] Connection header received
0811 08:11:09.679793 (+ 692us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:11:09.679795 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:11:09.679809 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:11:09.679897 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:11:09.680609 (+ 712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:09.681355 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:09.682898 (+ 1543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:09.683142 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:09.683217 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:09.685855 (+ 2638us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:11:09.685857 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:11:09.685857 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:11:09.685864 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:11:09.687479 (+ 1615us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:11:09.687947 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:11:09.687948 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:11:09.687948 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:11:09.688017 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:11:09.688315 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:11:09.688316 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:11:09.688316 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:11:09.688444 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:11:09.688516 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0811 08:11:09.688851 (+ 335us) server_negotiation.cc:299] Negotiation successful
0811 08:11:09.688973 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260811 08:11:09.689216 18446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:09.678485 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:42521 (local address 127.27.243.195:52391)
0811 08:11:09.678950 (+ 465us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:09.679001 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0811 08:11:09.679657 (+ 656us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:11:09.679984 (+ 327us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:11:09.679989 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:11:09.680216 (+ 227us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:11:09.680492 (+ 276us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:11:09.680500 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:11:09.681467 (+ 967us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:11:09.681468 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:11:09.682795 (+ 1327us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:11:09.682798 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:11:09.683541 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:11:09.683542 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:11:09.683684 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:09.684242 (+ 558us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:11:09.684253 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:11:09.685752 (+ 1499us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:11:09.687566 (+ 1814us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:11:09.687574 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:11:09.687577 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:11:09.687873 (+ 296us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:11:09.688091 (+ 218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:11:09.688092 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:11:09.688093 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:11:09.688235 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:11:09.688518 (+ 283us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:11:09.688524 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:11:09.688690 (+ 166us) client_negotiation.cc:769] Sending connection context
0811 08:11:09.688822 (+ 132us) client_negotiation.cc:240] Negotiation successful
0811 08:11:09.688979 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":419,"thread_start_us":71,"threads_started":1}
I20260811 08:11:09.689679 18443 heartbeater.cc:347] Connected to a master server at 127.27.243.254:42521
I20260811 08:11:09.689795 18443 heartbeater.cc:464] Registering TS with master...
I20260811 08:11:09.689985 18443 heartbeater.cc:511] Master 127.27.243.254:42521 requested a full tablet report, sending...
W20260811 08:11:09.690924 18443 heartbeater.cc:644] Failed to heartbeat to 127.27.243.254:42521 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260811 08:11:09.691174 18443 heartbeater.cc:464] Registering TS with master...
I20260811 08:11:09.691269 18443 heartbeater.cc:511] Master 127.27.243.254:42521 requested a full tablet report, sending...
I20260811 08:11:09.691610 18443 heartbeater.cc:464] Registering TS with master...
I20260811 08:11:09.691695 18443 heartbeater.cc:511] Master 127.27.243.254:42521 requested a full tablet report, sending...
W20260811 08:11:09.692040 18443 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 08:11:09.692468 18450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:09.683413 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40862 (local address 127.27.243.254:42521)
0811 08:11:09.683956 (+ 543us) server_negotiation.cc:206] Beginning negotiation
0811 08:11:09.683958 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:11:09.683967 (+ 9us) server_negotiation.cc:407] Connection header received
0811 08:11:09.683988 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:11:09.683989 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:11:09.684000 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:11:09.684123 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:11:09.684941 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:09.686114 (+ 1173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:09.687056 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:09.687262 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:09.687322 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:09.688786 (+ 1464us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:11:09.688787 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:11:09.688787 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:11:09.688794 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:11:09.690926 (+ 2132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:11:09.691456 (+ 530us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:11:09.691457 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:11:09.691457 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:11:09.691580 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:11:09.691896 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:11:09.691896 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:11:09.691897 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:11:09.692080 (+ 183us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:11:09.692246 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0811 08:11:09.692290 (+ 44us) server_negotiation.cc:299] Negotiation successful
0811 08:11:09.692374 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":522,"thread_start_us":59,"threads_started":1}
Aug 11 08:11:10 dist-test-slave-7lbf krb5kdc[16053](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786435870, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:11:10.315915 17983 heartbeater.cc:464] Registering TS with master...
I20260811 08:11:10.316062 17983 heartbeater.cc:511] Master 127.27.243.254:42521 requested a full tablet report, sending...
I20260811 08:11:10.316498 17653 ts_manager.cc:194] Registered new tserver with Master: 964e4a5333d447809aee3388a7bae907 (127.27.243.193:37485)
I20260811 08:11:10.317554 17653 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.243.193@KRBTEST.COM'} at 127.27.243.193:54733
I20260811 08:11:10.504719 18204 heartbeater.cc:464] Registering TS with master...
I20260811 08:11:10.504856 18204 heartbeater.cc:511] Master 127.27.243.254:42521 requested a full tablet report, sending...
I20260811 08:11:10.505170 17653 ts_manager.cc:194] Registered new tserver with Master: 34788ced6040463d9ed73f6333426f80 (127.27.243.194:42941)
I20260811 08:11:10.505755 17653 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.243.194@KRBTEST.COM'} at 127.27.243.194:59655
Aug 11 08:11:10 dist-test-slave-7lbf krb5kdc[16053](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435870, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.254@KRBTEST.COM for HTTP/127.27.243.212@KRBTEST.COM
I20260811 08:11:10.692215 18443 heartbeater.cc:464] Registering TS with master...
I20260811 08:11:10.692381 18443 heartbeater.cc:511] Master 127.27.243.254:42521 requested a full tablet report, sending...
I20260811 08:11:10.692646 17653 ts_manager.cc:194] Registered new tserver with Master: c610b818ba404da4b58b7616b721b868 (127.27.243.195:39967)
I20260811 08:11:10.693172 17653 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.243.195@KRBTEST.COM'} at 127.27.243.195:52391
I20260811 08:11:10.702152 28623 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 08:11:10.721241 18486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:10.708357 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40864 (local address 127.27.243.254:42521)
0811 08:11:10.709618 (+ 1261us) server_negotiation.cc:206] Beginning negotiation
0811 08:11:10.709620 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:11:10.709713 (+ 93us) server_negotiation.cc:407] Connection header received
0811 08:11:10.709789 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:11:10.709790 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:11:10.709802 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:11:10.709870 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:11:10.710597 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:10.711358 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:10.712393 (+ 1035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:10.712684 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:10.712743 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:10.717886 (+ 5143us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:11:10.717887 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:11:10.717888 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:11:10.717896 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:11:10.719628 (+ 1732us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:11:10.720040 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:11:10.720041 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:11:10.720042 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:11:10.720206 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:11:10.720447 (+ 241us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:11:10.720448 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:11:10.720448 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:11:10.720623 (+ 175us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:11:10.720709 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0811 08:11:10.720928 (+ 219us) server_negotiation.cc:299] Negotiation successful
0811 08:11:10.721028 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1234,"thread_start_us":84,"threads_started":1}
I20260811 08:11:10.723548 17653 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40864:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 08:11:10.725950 17653 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 08:11:10.737641 18503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:10.729017 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.193:37485 (local address 127.0.0.1:58396)
0811 08:11:10.729567 (+ 550us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:10.729610 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 08:11:10.729679 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:11:10.733972 (+ 4293us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:11:10.733973 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:11:10.733975 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:11:10.734021 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:11:10.734022 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:11:10.735301 (+ 1279us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:11:10.735302 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:11:10.736391 (+ 1089us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:11:10.736394 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:11:10.737313 (+ 919us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:11:10.737315 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:11:10.737395 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:10.737413 (+ 18us) client_negotiation.cc:769] Sending connection context
0811 08:11:10.737457 (+ 44us) client_negotiation.cc:240] Negotiation successful
0811 08:11:10.737554 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":488,"mutex_wait_us":41,"thread_start_us":75,"threads_started":1}
I20260811 08:11:10.738209 18498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:10.729398 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.194:42941 (local address 127.0.0.1:59590)
0811 08:11:10.733627 (+ 4229us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:10.733638 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 08:11:10.733700 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:11:10.734235 (+ 535us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:11:10.734236 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:11:10.734239 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:11:10.734280 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:11:10.734281 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:11:10.735493 (+ 1212us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:11:10.735494 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:11:10.736560 (+ 1066us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:11:10.736564 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:11:10.737984 (+ 1420us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:11:10.737985 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:11:10.738048 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:10.738052 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 08:11:10.738098 (+ 46us) client_negotiation.cc:240] Negotiation successful
0811 08:11:10.738138 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4210,"thread_start_us":68,"threads_started":1}
I20260811 08:11:10.738269 18499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:10.729126 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58396 (local address 127.27.243.193:37485)
0811 08:11:10.733814 (+ 4688us) server_negotiation.cc:206] Beginning negotiation
0811 08:11:10.733818 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 08:11:10.733829 (+ 11us) server_negotiation.cc:407] Connection header received
0811 08:11:10.733863 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:11:10.733865 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:11:10.733880 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:11:10.734085 (+ 205us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:11:10.734172 (+ 87us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:10.735201 (+ 1029us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:10.736490 (+ 1289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:10.737218 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:10.738062 (+ 844us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:10.738130 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 08:11:10.738156 (+ 26us) server_negotiation.cc:299] Negotiation successful
0811 08:11:10.738195 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4648,"thread_start_us":69,"threads_started":1}
I20260811 08:11:10.738502 18504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:10.729675 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59590 (local address 127.27.243.194:42941)
0811 08:11:10.730160 (+ 485us) server_negotiation.cc:206] Beginning negotiation
0811 08:11:10.730166 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 08:11:10.733717 (+ 3551us) server_negotiation.cc:407] Connection header received
0811 08:11:10.733761 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:11:10.733764 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:11:10.733782 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:11:10.733877 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:11:10.734361 (+ 484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:10.735389 (+ 1028us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:10.736673 (+ 1284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:10.737790 (+ 1117us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:10.737881 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:10.737946 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 08:11:10.738372 (+ 426us) server_negotiation.cc:299] Negotiation successful
0811 08:11:10.738419 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":448,"thread_start_us":60,"threads_started":1}
I20260811 08:11:10.739153 17882 tablet_service.cc:1467] Processing CreateTablet for tablet ed3d950ee91e4483b70036aa1d029424 (DEFAULT_TABLE table=test-table [id=3d78656d1e144e63859be96027e08ccf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:11:10.739274 18069 tablet_service.cc:1467] Processing CreateTablet for tablet ed3d950ee91e4483b70036aa1d029424 (DEFAULT_TABLE table=test-table [id=3d78656d1e144e63859be96027e08ccf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:11:10.739555 17882 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ed3d950ee91e4483b70036aa1d029424. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:11:10.739624 18069 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ed3d950ee91e4483b70036aa1d029424. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:11:10.743621 18506 tablet_bootstrap.cc:492] T ed3d950ee91e4483b70036aa1d029424 P 964e4a5333d447809aee3388a7bae907: Bootstrap starting.
I20260811 08:11:10.744365 18506 tablet_bootstrap.cc:654] T ed3d950ee91e4483b70036aa1d029424 P 964e4a5333d447809aee3388a7bae907: Neither blocks nor log segments found. Creating new log.
I20260811 08:11:10.744748 18506 log.cc:824] T ed3d950ee91e4483b70036aa1d029424 P 964e4a5333d447809aee3388a7bae907: Log is configured to *not* fsync() on all Append() calls
I20260811 08:11:10.745177 18500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:10.729250 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.195:39967 (local address 127.0.0.1:48992)
0811 08:11:10.730213 (+ 963us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:10.730223 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 08:11:10.730270 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:11:10.730576 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:11:10.730580 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:11:10.730582 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:11:10.730664 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:11:10.730666 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:11:10.732313 (+ 1647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:11:10.732315 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:11:10.733655 (+ 1340us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:11:10.733659 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:11:10.744933 (+ 11274us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:11:10.744934 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:11:10.745003 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:10.745009 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 08:11:10.745042 (+ 33us) client_negotiation.cc:240] Negotiation successful
0811 08:11:10.745089 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":948,"thread_start_us":65,"threads_started":1}
I20260811 08:11:10.745609 18501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:10.729345 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48992 (local address 127.27.243.195:39967)
0811 08:11:10.730373 (+ 1028us) server_negotiation.cc:206] Beginning negotiation
0811 08:11:10.730378 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 08:11:10.730388 (+ 10us) server_negotiation.cc:407] Connection header received
0811 08:11:10.730422 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:11:10.730424 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:11:10.730440 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:11:10.730750 (+ 310us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:11:10.730828 (+ 78us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:10.732207 (+ 1379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:10.743943 (+ 11736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:10.744808 (+ 865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:10.745351 (+ 543us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:10.745430 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 08:11:10.745459 (+ 29us) server_negotiation.cc:299] Negotiation successful
0811 08:11:10.745502 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":994,"thread_start_us":58,"threads_started":1}
I20260811 08:11:10.745875 18506 tablet_bootstrap.cc:492] T ed3d950ee91e4483b70036aa1d029424 P 964e4a5333d447809aee3388a7bae907: No bootstrap required, opened a new log
I20260811 08:11:10.745954 18506 ts_tablet_manager.cc:1397] T ed3d950ee91e4483b70036aa1d029424 P 964e4a5333d447809aee3388a7bae907: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 08:11:10.747545 18507 tablet_bootstrap.cc:492] T ed3d950ee91e4483b70036aa1d029424 P 34788ced6040463d9ed73f6333426f80: Bootstrap starting.
I20260811 08:11:10.748133 18507 tablet_bootstrap.cc:654] T ed3d950ee91e4483b70036aa1d029424 P 34788ced6040463d9ed73f6333426f80: Neither blocks nor log segments found. Creating new log.
I20260811 08:11:10.748355 18507 log.cc:824] T ed3d950ee91e4483b70036aa1d029424 P 34788ced6040463d9ed73f6333426f80: Log is configured to *not* fsync() on all Append() calls
I20260811 08:11:10.748487 18506 raft_consensus.cc:348] T ed3d950ee91e4483b70036aa1d029424 P 964e4a5333d447809aee3388a7bae907 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c610b818ba404da4b58b7616b721b868" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 39967 } } peers { permanent_uuid: "34788ced6040463d9ed73f6333426f80" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 42941 } } peers { permanent_uuid: "964e4a5333d447809aee3388a7bae907" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 37485 } }
I20260811 08:11:10.748646 18506 raft_consensus.cc:374] T ed3d950ee91e4483b70036aa1d029424 P 964e4a5333d447809aee3388a7bae907 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:11:10.748672 18506 raft_consensus.cc:729] T ed3d950ee91e4483b70036aa1d029424 P 964e4a5333d447809aee3388a7bae907 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 964e4a5333d447809aee3388a7bae907, State: Initialized, Role: FOLLOWER
I20260811 08:11:10.748783 18506 consensus_queue.cc:260] T ed3d950ee91e4483b70036aa1d029424 P 964e4a5333d447809aee3388a7bae907 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c610b818ba404da4b58b7616b721b868" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 39967 } } peers { permanent_uuid: "34788ced6040463d9ed73f6333426f80" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 42941 } } peers { permanent_uuid: "964e4a5333d447809aee3388a7bae907" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 37485 } }
I20260811 08:11:10.749028 18506 ts_tablet_manager.cc:1428] T ed3d950ee91e4483b70036aa1d029424 P 964e4a5333d447809aee3388a7bae907: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260811 08:11:10.749039 18507 tablet_bootstrap.cc:492] T ed3d950ee91e4483b70036aa1d029424 P 34788ced6040463d9ed73f6333426f80: No bootstrap required, opened a new log
I20260811 08:11:10.749087 17983 heartbeater.cc:503] Master 127.27.243.254:42521 was elected leader, sending a full tablet report...
I20260811 08:11:10.749104 18507 ts_tablet_manager.cc:1397] T ed3d950ee91e4483b70036aa1d029424 P 34788ced6040463d9ed73f6333426f80: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 08:11:10.749873 18333 tablet_service.cc:1467] Processing CreateTablet for tablet ed3d950ee91e4483b70036aa1d029424 (DEFAULT_TABLE table=test-table [id=3d78656d1e144e63859be96027e08ccf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:11:10.750264 18333 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ed3d950ee91e4483b70036aa1d029424. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:11:10.754664 18507 raft_consensus.cc:348] T ed3d950ee91e4483b70036aa1d029424 P 34788ced6040463d9ed73f6333426f80 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c610b818ba404da4b58b7616b721b868" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 39967 } } peers { permanent_uuid: "34788ced6040463d9ed73f6333426f80" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 42941 } } peers { permanent_uuid: "964e4a5333d447809aee3388a7bae907" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 37485 } }
I20260811 08:11:10.754813 18507 raft_consensus.cc:374] T ed3d950ee91e4483b70036aa1d029424 P 34788ced6040463d9ed73f6333426f80 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:11:10.754863 18507 raft_consensus.cc:729] T ed3d950ee91e4483b70036aa1d029424 P 34788ced6040463d9ed73f6333426f80 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34788ced6040463d9ed73f6333426f80, State: Initialized, Role: FOLLOWER
I20260811 08:11:10.754981 18507 consensus_queue.cc:260] T ed3d950ee91e4483b70036aa1d029424 P 34788ced6040463d9ed73f6333426f80 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c610b818ba404da4b58b7616b721b868" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 39967 } } peers { permanent_uuid: "34788ced6040463d9ed73f6333426f80" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 42941 } } peers { permanent_uuid: "964e4a5333d447809aee3388a7bae907" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 37485 } }
I20260811 08:11:10.755303 18507 ts_tablet_manager.cc:1428] T ed3d950ee91e4483b70036aa1d029424 P 34788ced6040463d9ed73f6333426f80: Time spent starting tablet: real 0.006s user 0.000s sys 0.003s
I20260811 08:11:10.755317 18204 heartbeater.cc:503] Master 127.27.243.254:42521 was elected leader, sending a full tablet report...
I20260811 08:11:10.755542 18513 tablet_bootstrap.cc:492] T ed3d950ee91e4483b70036aa1d029424 P c610b818ba404da4b58b7616b721b868: Bootstrap starting.
I20260811 08:11:10.756383 18513 tablet_bootstrap.cc:654] T ed3d950ee91e4483b70036aa1d029424 P c610b818ba404da4b58b7616b721b868: Neither blocks nor log segments found. Creating new log.
I20260811 08:11:10.756692 18513 log.cc:824] T ed3d950ee91e4483b70036aa1d029424 P c610b818ba404da4b58b7616b721b868: Log is configured to *not* fsync() on all Append() calls
I20260811 08:11:10.757390 18513 tablet_bootstrap.cc:492] T ed3d950ee91e4483b70036aa1d029424 P c610b818ba404da4b58b7616b721b868: No bootstrap required, opened a new log
I20260811 08:11:10.757454 18513 ts_tablet_manager.cc:1397] T ed3d950ee91e4483b70036aa1d029424 P c610b818ba404da4b58b7616b721b868: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 08:11:10.759450 18513 raft_consensus.cc:348] T ed3d950ee91e4483b70036aa1d029424 P c610b818ba404da4b58b7616b721b868 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c610b818ba404da4b58b7616b721b868" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 39967 } } peers { permanent_uuid: "34788ced6040463d9ed73f6333426f80" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 42941 } } peers { permanent_uuid: "964e4a5333d447809aee3388a7bae907" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 37485 } }
I20260811 08:11:10.759586 18513 raft_consensus.cc:374] T ed3d950ee91e4483b70036aa1d029424 P c610b818ba404da4b58b7616b721b868 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:11:10.759625 18513 raft_consensus.cc:729] T ed3d950ee91e4483b70036aa1d029424 P c610b818ba404da4b58b7616b721b868 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c610b818ba404da4b58b7616b721b868, State: Initialized, Role: FOLLOWER
I20260811 08:11:10.759745 18513 consensus_queue.cc:260] T ed3d950ee91e4483b70036aa1d029424 P c610b818ba404da4b58b7616b721b868 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c610b818ba404da4b58b7616b721b868" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 39967 } } peers { permanent_uuid: "34788ced6040463d9ed73f6333426f80" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 42941 } } peers { permanent_uuid: "964e4a5333d447809aee3388a7bae907" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 37485 } }
I20260811 08:11:10.760030 18443 heartbeater.cc:503] Master 127.27.243.254:42521 was elected leader, sending a full tablet report...
I20260811 08:11:10.760016 18513 ts_tablet_manager.cc:1428] T ed3d950ee91e4483b70036aa1d029424 P c610b818ba404da4b58b7616b721b868: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 08:11:10.788542 18514 raft_consensus.cc:482] T ed3d950ee91e4483b70036aa1d029424 P 34788ced6040463d9ed73f6333426f80 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:11:10.788748 18514 raft_consensus.cc:504] T ed3d950ee91e4483b70036aa1d029424 P 34788ced6040463d9ed73f6333426f80 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c610b818ba404da4b58b7616b721b868" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 39967 } } peers { permanent_uuid: "34788ced6040463d9ed73f6333426f80" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 42941 } } peers { permanent_uuid: "964e4a5333d447809aee3388a7bae907" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 37485 } }
I20260811 08:11:10.789382 18514 leader_election.cc:288] T ed3d950ee91e4483b70036aa1d029424 P 34788ced6040463d9ed73f6333426f80 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c610b818ba404da4b58b7616b721b868 (127.27.243.195:39967), 964e4a5333d447809aee3388a7bae907 (127.27.243.193:37485)
I20260811 08:11:10.795462 18501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:10.789930 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.194:44965 (local address 127.27.243.195:39967)
0811 08:11:10.789986 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0811 08:11:10.789988 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:11:10.791865 (+ 1877us) server_negotiation.cc:407] Connection header received
0811 08:11:10.791928 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:11:10.791929 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:11:10.791940 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:11:10.792032 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:11:10.792257 (+ 225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:10.792972 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:10.794466 (+ 1494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:10.795060 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:10.795111 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:10.795120 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 08:11:10.795351 (+ 231us) server_negotiation.cc:299] Negotiation successful
0811 08:11:10.795393 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 08:11:10.795732 18522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:10.789697 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.195:39967 (local address 127.27.243.194:44965)
0811 08:11:10.791046 (+ 1349us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:10.791057 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 08:11:10.791126 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:11:10.792093 (+ 967us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:11:10.792094 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:11:10.792097 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:11:10.792180 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:11:10.792182 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:11:10.793086 (+ 904us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:11:10.793087 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:11:10.794360 (+ 1273us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:11:10.794364 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:11:10.795202 (+ 838us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:11:10.795203 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:11:10.795273 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:10.795277 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 08:11:10.795593 (+ 316us) client_negotiation.cc:240] Negotiation successful
0811 08:11:10.795638 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1328,"thread_start_us":95,"threads_started":1}
I20260811 08:11:10.796058 18359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed3d950ee91e4483b70036aa1d029424" candidate_uuid: "34788ced6040463d9ed73f6333426f80" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c610b818ba404da4b58b7616b721b868" is_pre_election: true
I20260811 08:11:10.796240 18359 raft_consensus.cc:2454] T ed3d950ee91e4483b70036aa1d029424 P c610b818ba404da4b58b7616b721b868 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34788ced6040463d9ed73f6333426f80 in term 0.
I20260811 08:11:10.796516 18032 leader_election.cc:302] T ed3d950ee91e4483b70036aa1d029424 P 34788ced6040463d9ed73f6333426f80 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34788ced6040463d9ed73f6333426f80, c610b818ba404da4b58b7616b721b868; no voters:
I20260811 08:11:10.796658 18514 raft_consensus.cc:2781] T ed3d950ee91e4483b70036aa1d029424 P 34788ced6040463d9ed73f6333426f80 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 08:11:10.796705 18514 raft_consensus.cc:482] T ed3d950ee91e4483b70036aa1d029424 P 34788ced6040463d9ed73f6333426f80 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 08:11:10.796725 18514 raft_consensus.cc:3037] T ed3d950ee91e4483b70036aa1d029424 P 34788ced6040463d9ed73f6333426f80 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:11:10.797745 18514 raft_consensus.cc:504] T ed3d950ee91e4483b70036aa1d029424 P 34788ced6040463d9ed73f6333426f80 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c610b818ba404da4b58b7616b721b868" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 39967 } } peers { permanent_uuid: "34788ced6040463d9ed73f6333426f80" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 42941 } } peers { permanent_uuid: "964e4a5333d447809aee3388a7bae907" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 37485 } }
I20260811 08:11:10.797910 18514 leader_election.cc:288] T ed3d950ee91e4483b70036aa1d029424 P 34788ced6040463d9ed73f6333426f80 [CANDIDATE]: Term 1 election: Requested vote from peers c610b818ba404da4b58b7616b721b868 (127.27.243.195:39967), 964e4a5333d447809aee3388a7bae907 (127.27.243.193:37485)
I20260811 08:11:10.798354 18359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed3d950ee91e4483b70036aa1d029424" candidate_uuid: "34788ced6040463d9ed73f6333426f80" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c610b818ba404da4b58b7616b721b868"
I20260811 08:11:10.798445 18359 raft_consensus.cc:3037] T ed3d950ee91e4483b70036aa1d029424 P c610b818ba404da4b58b7616b721b868 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:11:10.799006 18499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:10.790911 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.194:32777 (local address 127.27.243.193:37485)
0811 08:11:10.790975 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0811 08:11:10.790978 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:11:10.795991 (+ 5013us) server_negotiation.cc:407] Connection header received
0811 08:11:10.796085 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:11:10.796086 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:11:10.796096 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:11:10.796123 (+ 27us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:11:10.796272 (+ 149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:10.796938 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:10.798116 (+ 1178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:10.798668 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:10.798712 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:10.798720 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 08:11:10.798894 (+ 174us) server_negotiation.cc:299] Negotiation successful
0811 08:11:10.798931 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 08:11:10.799228 18522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:10.789820 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.193:37485 (local address 127.27.243.194:32777)
0811 08:11:10.795933 (+ 6113us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:10.795943 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 08:11:10.796017 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:11:10.796180 (+ 163us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:11:10.796180 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:11:10.796182 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:11:10.796210 (+ 28us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:11:10.796211 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:11:10.797040 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:11:10.797041 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:11:10.798025 (+ 984us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:11:10.798029 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:11:10.798772 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:11:10.798773 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:11:10.798828 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:10.798831 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 08:11:10.799124 (+ 293us) client_negotiation.cc:240] Negotiation successful
0811 08:11:10.799168 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6100,"thread_start_us":101,"threads_started":1}
I20260811 08:11:10.799360 18359 raft_consensus.cc:2454] T ed3d950ee91e4483b70036aa1d029424 P c610b818ba404da4b58b7616b721b868 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34788ced6040463d9ed73f6333426f80 in term 1.
I20260811 08:11:10.799620 17908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed3d950ee91e4483b70036aa1d029424" candidate_uuid: "34788ced6040463d9ed73f6333426f80" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "964e4a5333d447809aee3388a7bae907"
I20260811 08:11:10.799600 17909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed3d950ee91e4483b70036aa1d029424" candidate_uuid: "34788ced6040463d9ed73f6333426f80" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "964e4a5333d447809aee3388a7bae907" is_pre_election: true
I20260811 08:11:10.799762 17908 raft_consensus.cc:3037] T ed3d950ee91e4483b70036aa1d029424 P 964e4a5333d447809aee3388a7bae907 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:11:10.799783 18032 leader_election.cc:302] T ed3d950ee91e4483b70036aa1d029424 P 34788ced6040463d9ed73f6333426f80 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34788ced6040463d9ed73f6333426f80, c610b818ba404da4b58b7616b721b868; no voters:
I20260811 08:11:10.799953 18514 raft_consensus.cc:2781] T ed3d950ee91e4483b70036aa1d029424 P 34788ced6040463d9ed73f6333426f80 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:11:10.800143 18514 raft_consensus.cc:686] T ed3d950ee91e4483b70036aa1d029424 P 34788ced6040463d9ed73f6333426f80 [term 1 LEADER]: Becoming Leader. State: Replica: 34788ced6040463d9ed73f6333426f80, State: Running, Role: LEADER
I20260811 08:11:10.800257 18514 consensus_queue.cc:237] T ed3d950ee91e4483b70036aa1d029424 P 34788ced6040463d9ed73f6333426f80 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c610b818ba404da4b58b7616b721b868" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 39967 } } peers { permanent_uuid: "34788ced6040463d9ed73f6333426f80" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 42941 } } peers { permanent_uuid: "964e4a5333d447809aee3388a7bae907" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 37485 } }
I20260811 08:11:10.800616 17908 raft_consensus.cc:2454] T ed3d950ee91e4483b70036aa1d029424 P 964e4a5333d447809aee3388a7bae907 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34788ced6040463d9ed73f6333426f80 in term 1.
W20260811 08:11:10.800786 17985 tablet.cc:2369] T ed3d950ee91e4483b70036aa1d029424 P 964e4a5333d447809aee3388a7bae907: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 08:11:10.801110 17653 catalog_manager.cc:5495] T ed3d950ee91e4483b70036aa1d029424 P 34788ced6040463d9ed73f6333426f80 reported cstate change: term changed from 0 to 1, leader changed from <none> to 34788ced6040463d9ed73f6333426f80 (127.27.243.194). New cstate: current_term: 1 leader_uuid: "34788ced6040463d9ed73f6333426f80" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c610b818ba404da4b58b7616b721b868" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 39967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34788ced6040463d9ed73f6333426f80" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 42941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "964e4a5333d447809aee3388a7bae907" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 37485 } health_report { overall_health: UNKNOWN } } }
I20260811 08:11:10.810915 18504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:10.807588 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59594 (local address 127.27.243.194:42941)
0811 08:11:10.807652 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0811 08:11:10.807654 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:11:10.807664 (+ 10us) server_negotiation.cc:407] Connection header received
0811 08:11:10.807702 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:11:10.807703 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:11:10.807723 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:11:10.807812 (+ 89us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:11:10.807950 (+ 138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:10.808680 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:10.809845 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:10.810152 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:10.810219 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:10.810396 (+ 177us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:11:10.810555 (+ 159us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:11:10.810652 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0811 08:11:10.810697 (+ 45us) server_negotiation.cc:299] Negotiation successful
0811 08:11:10.810725 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 08:11:10.813050 18359 raft_consensus.cc:1261] T ed3d950ee91e4483b70036aa1d029424 P c610b818ba404da4b58b7616b721b868 [term 1 FOLLOWER]: Refusing update from remote peer 34788ced6040463d9ed73f6333426f80: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:11:10.813059 17908 raft_consensus.cc:1261] T ed3d950ee91e4483b70036aa1d029424 P 964e4a5333d447809aee3388a7bae907 [term 1 FOLLOWER]: Refusing update from remote peer 34788ced6040463d9ed73f6333426f80: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:11:10.813463 18524 consensus_queue.cc:1035] T ed3d950ee91e4483b70036aa1d029424 P 34788ced6040463d9ed73f6333426f80 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c610b818ba404da4b58b7616b721b868" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 39967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:11:10.813689 18514 consensus_queue.cc:1035] T ed3d950ee91e4483b70036aa1d029424 P 34788ced6040463d9ed73f6333426f80 [LEADER]: Connected to new peer: Peer: permanent_uuid: "964e4a5333d447809aee3388a7bae907" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 37485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:11:10.816371 18529 mvcc.cc:205] Tried to move back new op lower bound from 7317241326847279104 to 7317241326798389248. Current Snapshot: MvccSnapshot[applied={T|T < 7317241326847279104}]
I20260811 08:11:10.817718 18531 mvcc.cc:205] Tried to move back new op lower bound from 7317241326847279104 to 7317241326798389248. Current Snapshot: MvccSnapshot[applied={T|T < 7317241326847279104}]
I20260811 08:11:10.819272 17653 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40864:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:11:10.819373 17653 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40864:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:11:10.820313 17653 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c1a8a0651c404143a4f831a827b9636c: Sending DeleteTablet for 3 replicas of tablet ed3d950ee91e4483b70036aa1d029424
I20260811 08:11:10.820647 17882 tablet_service.cc:1514] Processing DeleteTablet for tablet ed3d950ee91e4483b70036aa1d029424 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:11:10 UTC) from {username='kudu', principal='kudu/127.27.243.254@KRBTEST.COM'} at 127.0.0.1:58396
I20260811 08:11:10.820755 18333 tablet_service.cc:1514] Processing DeleteTablet for tablet ed3d950ee91e4483b70036aa1d029424 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:11:10 UTC) from {username='kudu', principal='kudu/127.27.243.254@KRBTEST.COM'} at 127.0.0.1:48992
I20260811 08:11:10.820971 18540 tablet_replica.cc:330] T ed3d950ee91e4483b70036aa1d029424 P 964e4a5333d447809aee3388a7bae907: stopping tablet replica
I20260811 08:11:10.820999 18069 tablet_service.cc:1514] Processing DeleteTablet for tablet ed3d950ee91e4483b70036aa1d029424 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:11:10 UTC) from {username='kudu', principal='kudu/127.27.243.254@KRBTEST.COM'} at 127.0.0.1:59590
I20260811 08:11:10.821161 18540 raft_consensus.cc:2229] T ed3d950ee91e4483b70036aa1d029424 P 964e4a5333d447809aee3388a7bae907 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:11:10.821312 18540 raft_consensus.cc:2258] T ed3d950ee91e4483b70036aa1d029424 P 964e4a5333d447809aee3388a7bae907 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:11:10.821684 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 17726
I20260811 08:11:10.826012 18541 tablet_replica.cc:330] T ed3d950ee91e4483b70036aa1d029424 P c610b818ba404da4b58b7616b721b868: stopping tablet replica
I20260811 08:11:10.826112 18541 raft_consensus.cc:2229] T ed3d950ee91e4483b70036aa1d029424 P c610b818ba404da4b58b7616b721b868 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:11:10.826195 18541 raft_consensus.cc:2258] T ed3d950ee91e4483b70036aa1d029424 P c610b818ba404da4b58b7616b721b868 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:11:10.832532 18541 ts_tablet_manager.cc:1905] T ed3d950ee91e4483b70036aa1d029424 P c610b818ba404da4b58b7616b721b868: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:11:10.836323 18541 ts_tablet_manager.cc:1918] T ed3d950ee91e4483b70036aa1d029424 P c610b818ba404da4b58b7616b721b868: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:11:10.836525 18541 log.cc:1196] T ed3d950ee91e4483b70036aa1d029424 P c610b818ba404da4b58b7616b721b868: Deleting WAL directory at /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/ts-2/wal/wals/ed3d950ee91e4483b70036aa1d029424
I20260811 08:11:10.837047 18541 ts_tablet_manager.cc:1939] T ed3d950ee91e4483b70036aa1d029424 P c610b818ba404da4b58b7616b721b868: Deleting consensus metadata
I20260811 08:11:10.837639 18542 tablet_replica.cc:330] T ed3d950ee91e4483b70036aa1d029424 P 34788ced6040463d9ed73f6333426f80: stopping tablet replica
I20260811 08:11:10.837774 18542 raft_consensus.cc:2229] T ed3d950ee91e4483b70036aa1d029424 P 34788ced6040463d9ed73f6333426f80 [term 1 LEADER]: Raft consensus shutting down.
I20260811 08:11:10.837868 18542 raft_consensus.cc:2258] T ed3d950ee91e4483b70036aa1d029424 P 34788ced6040463d9ed73f6333426f80 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:11:10.843698 18542 ts_tablet_manager.cc:1905] T ed3d950ee91e4483b70036aa1d029424 P 34788ced6040463d9ed73f6333426f80: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:11:10.845767 17633 catalog_manager.cc:4841] TS c610b818ba404da4b58b7616b721b868 (127.27.243.195:39967): tablet ed3d950ee91e4483b70036aa1d029424 (table test-table [id=3d78656d1e144e63859be96027e08ccf]) successfully deleted
I20260811 08:11:10.846491 18542 ts_tablet_manager.cc:1918] T ed3d950ee91e4483b70036aa1d029424 P 34788ced6040463d9ed73f6333426f80: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:11:10.846558 18542 log.cc:1196] T ed3d950ee91e4483b70036aa1d029424 P 34788ced6040463d9ed73f6333426f80: Deleting WAL directory at /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435717191469-28623-0/minicluster-data/ts-1/wal/wals/ed3d950ee91e4483b70036aa1d029424
I20260811 08:11:10.846778 18542 ts_tablet_manager.cc:1939] T ed3d950ee91e4483b70036aa1d029424 P 34788ced6040463d9ed73f6333426f80: Deleting consensus metadata
I20260811 08:11:10.847157 17633 catalog_manager.cc:4841] TS 34788ced6040463d9ed73f6333426f80 (127.27.243.194:42941): tablet ed3d950ee91e4483b70036aa1d029424 (table test-table [id=3d78656d1e144e63859be96027e08ccf]) successfully deleted
W20260811 08:11:10.874366 17631 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.27.243.193:37485 (error 108)
I20260811 08:11:10.875077 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 17987
I20260811 08:11:10.884898 18500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:10.884734 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.193:37485 (local address 127.0.0.1:58406)
0811 08:11:10.884796 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:10.884847 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.193:37485: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260811 08:11:10.885068 17631 catalog_manager.cc:4584] TS 964e4a5333d447809aee3388a7bae907 (127.27.243.193:37485): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet ed3d950ee91e4483b70036aa1d029424: Network error: Client connection negotiation failed: client connection to 127.27.243.193:37485: connect: Connection refused (error 111)
I20260811 08:11:10.889058 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 18208
I20260811 08:11:10.903242 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 17608
I20260811 08:11:10.916380 28623 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260811 08:11:11.261123 28623 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260811 08:11:11.261230 28623 mini_ranger.cc:66] Stopping Ranger...
I20260811 08:11:11.605149 28623 mini_ranger.cc:68] Stopped Ranger
2026-08-11 08:11:11.605 UTC [16101] LOG: received smart shutdown request
2026-08-11 08:11:11.609 UTC [16101] LOG: background worker "logical replication launcher" (PID 16116) exited with exit code 1
2026-08-11 08:11:11.610 UTC [16108] LOG: shutting down
2026-08-11 08:11:11.758 UTC [16101] LOG: database system is shut down
2026-08-11T08:11:11Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (47591 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435717191469-28623-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:11:11 dist-test-slave-7lbf krb5kdc[18556](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:11:11 dist-test-slave-7lbf krb5kdc[18556](info): set up 2 sockets
Aug 11 08:11:11 dist-test-slave-7lbf krb5kdc[18556](info): commencing operation
krb5kdc: starting...
W20260811 08:11:13.018567 28623 mini_kdc.cc:121] Time spent starting KDC: real 1.144s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435717191469-28623-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435717191469-28623-0/krb5kdc/test-user.keytab.
Aug 11 08:11:13 dist-test-slave-7lbf krb5kdc[18556](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435873, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:11:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:11:13Z Disabled control of system clock
WARNING: no policy specified for kudu/127.27.243.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.243.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.243.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab.
Entry for principal kudu/127.27.243.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab.
I20260811 08:11:13.140120 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435717191469-28623-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435717191469-28623-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435717191469-28623-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.243.254:34909
--webserver_interface=127.27.243.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab
--principal=kudu/127.27.243.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:41441
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.243.254:34909,127.27.243.253:38923,127.27.243.252:34861
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:11:13.221375 18579 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:11:13.221634 18579 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:11:13.221673 18579 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:11:13.222800 18579 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:11:13.222841 18579 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:11:13.222858 18579 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:11:13.222875 18579 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:11:13.222890 18579 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:11:13.224360 18579 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:41441
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435717191469-28623-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435717191469-28623-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.243.254:34909,127.27.243.253:38923,127.27.243.252:34861
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab
--principal=kudu/127.27.243.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.243.254:34909
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.243.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18579
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435717191469-28623-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:11:13.224601 18579 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:11:13.224825 18579 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:11:13.229367 18584 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:11:13.229368 18588 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:11:13.229401 18585 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:11:13.229615 18579 server_base.cc:1034] running on GCE node
I20260811 08:11:13.229897 18579 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:11:13.230165 18579 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:11:13.231303 18579 hybrid_clock.cc:648] HybridClock initialized: now 1786435873231285 us; error 36 us; skew 500 ppm
Aug 11 08:11:13 dist-test-slave-7lbf krb5kdc[18556](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435873, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:11:13.233691 18579 init.cc:377] Logged in from keytab as kudu/127.27.243.254@KRBTEST.COM (short username kudu)
I20260811 08:11:13.234122 18579 webserver.cc:460] Webserver started at http://127.27.243.254:36207/ using document root <none> and password file <none>
I20260811 08:11:13.234330 18579 fs_manager.cc:359] Metadata directory not provided
I20260811 08:11:13.234378 18579 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:11:13.234501 18579 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:11:13.235567 18579 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435717191469-28623-0/minicluster-data/master-0/data/instance:
uuid: "d5393b5229a7433f91fda4a172a65742"
format_stamp: "Formatted at 2026-08-11 08:11:13 on dist-test-slave-7lbf"
server_key: "f353cfa33db6eeeab01f29edc7ccbae9"
server_key_iv: "08af583b830fd77c3e13dd3a32e00074"
server_key_version: "encryptionkey@0"
I20260811 08:11:13.235906 18579 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435717191469-28623-0/minicluster-data/master-0/wal/instance:
uuid: "d5393b5229a7433f91fda4a172a65742"
format_stamp: "Formatted at 2026-08-11 08:11:13 on dist-test-slave-7lbf"
server_key: "f353cfa33db6eeeab01f29edc7ccbae9"
server_key_iv: "08af583b830fd77c3e13dd3a32e00074"
server_key_version: "encryptionkey@0"
I20260811 08:11:13.237141 18579 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 08:11:13.237829 18597 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:11:13.237995 18579 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 08:11:13.238075 18579 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435717191469-28623-0/minicluster-data/master-0/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435717191469-28623-0/minicluster-data/master-0/wal
uuid: "d5393b5229a7433f91fda4a172a65742"
format_stamp: "Formatted at 2026-08-11 08:11:13 on dist-test-slave-7lbf"
server_key: "f353cfa33db6eeeab01f29edc7ccbae9"
server_key_iv: "08af583b830fd77c3e13dd3a32e00074"
server_key_version: "encryptionkey@0"
I20260811 08:11:13.238139 18579 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435717191469-28623-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435717191469-28623-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435717191469-28623-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:11:13.271548 18579 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:11:13.273401 18579 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:11:13.273559 18579 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:11:13.277377 18579 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.254:34909
I20260811 08:11:13.277426 18696 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.254:34909 every 8 connection(s)
I20260811 08:11:13.277766 18579 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
I20260811 08:11:13.278674 18697 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:11:13.280248 18697 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.243.254" port: 34909 } has no permanent_uuid. Determining permanent_uuid...
I20260811 08:11:13.285418 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 18579
I20260811 08:11:13.285561 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435717191469-28623-0/minicluster-data/master-0/wal/instance
I20260811 08:11:13.285779 28623 external_mini_cluster.cc:1428] Setting key d979e589179cc4c09a3503c7ede690c3
Aug 11 08:11:13 dist-test-slave-7lbf krb5kdc[18556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435873, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.254@KRBTEST.COM for kudu/127.27.243.254@KRBTEST.COM
I20260811 08:11:13.289878 18701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:13.280936 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:34909 (local address 127.0.0.1:44464)
0811 08:11:13.281128 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:13.281162 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0811 08:11:13.281655 (+ 493us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:11:13.281930 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:11:13.281932 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:11:13.282181 (+ 249us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:11:13.282344 (+ 163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:11:13.282348 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:11:13.283368 (+ 1020us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:11:13.283368 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:11:13.284059 (+ 691us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:11:13.284061 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:11:13.284567 (+ 506us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:11:13.284567 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:11:13.284618 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:13.285073 (+ 455us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:11:13.285081 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:11:13.286634 (+ 1553us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:11:13.288386 (+ 1752us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:11:13.288392 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:11:13.288394 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:11:13.288594 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:11:13.288822 (+ 228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:11:13.288823 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:11:13.288823 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:11:13.288907 (+ 84us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:11:13.289240 (+ 333us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:11:13.289245 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:11:13.289311 (+ 66us) client_negotiation.cc:769] Sending connection context
0811 08:11:13.289400 (+ 89us) client_negotiation.cc:240] Negotiation successful
0811 08:11:13.289666 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"mutex_wait_us":113,"thread_start_us":101,"threads_started":1}
I20260811 08:11:13.289881 18700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:13.280969 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44464 (local address 127.27.243.254:34909)
0811 08:11:13.281153 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0811 08:11:13.281163 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 08:11:13.281245 (+ 82us) server_negotiation.cc:407] Connection header received
0811 08:11:13.281788 (+ 543us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:11:13.281791 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:11:13.281813 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:11:13.281895 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:11:13.282444 (+ 549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:13.283279 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:13.284154 (+ 875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:13.284495 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:13.284593 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:13.286720 (+ 2127us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:11:13.286728 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:11:13.286728 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:11:13.286736 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:11:13.288302 (+ 1566us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:11:13.288674 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:11:13.288677 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:11:13.288677 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:11:13.288756 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:11:13.288965 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:11:13.288966 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:11:13.288966 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:11:13.289172 (+ 206us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:11:13.289250 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 08:11:13.289431 (+ 181us) server_negotiation.cc:299] Negotiation successful
0811 08:11:13.289582 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":151,"thread_start_us":85,"threads_started":1}
I20260811 08:11:13.290609 18697 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.243.253" port: 38923 } has no permanent_uuid. Determining permanent_uuid...
I20260811 08:11:13.290956 18701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:13.290840 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.253:38923 (local address 127.0.0.1:41596)
0811 08:11:13.290884 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:13.290932 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.253:38923: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260811 08:11:13.291102 18602 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.27.243.253:38923: connect: Connection refused (error 111)
I20260811 08:11:13.291519 18701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:13.291426 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.253:38923 (local address 127.0.0.1:41604)
0811 08:11:13.291466 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:13.291492 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.253:38923: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260811 08:11:13.291621 18697 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.27.243.253:38923: Network error: Client connection negotiation failed: client connection to 127.27.243.253:38923: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.27.243.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.243.253@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.243.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.253.keytab.
Entry for principal kudu/127.27.243.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.253.keytab.
I20260811 08:11:13.309489 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435717191469-28623-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435717191469-28623-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435717191469-28623-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435717191469-28623-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.243.253:38923
--webserver_interface=127.27.243.253
--webserver_port=0
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.253.keytab
--principal=kudu/127.27.243.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:41441
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.243.254:34909,127.27.243.253:38923,127.27.243.252:34861
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 08:11:13.340860 18697 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.243.253" port: 38923 } attempt: 1
I20260811 08:11:13.341369 18701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:13.341229 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.253:38923 (local address 127.0.0.1:41606)
0811 08:11:13.341292 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:13.341338 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.253:38923: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260811 08:11:13.341830 18701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:13.341696 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.253:38923 (local address 127.0.0.1:41610)
0811 08:11:13.341772 (+ 76us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:13.341804 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.253:38923: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260811 08:11:13.341928 18697 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.27.243.253:38923: Network error: Client connection negotiation failed: client connection to 127.27.243.253:38923: connect: Connection refused (error 111)
W20260811 08:11:13.392438 18708 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:11:13.392648 18708 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:11:13.392670 18708 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:11:13.393824 18708 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:11:13.393865 18708 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:11:13.393878 18708 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:11:13.393890 18708 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:11:13.393901 18708 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:11:13.395363 18708 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:41441
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435717191469-28623-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435717191469-28623-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.27.243.254:34909,127.27.243.253:38923,127.27.243.252:34861
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.253.keytab
--principal=kudu/127.27.243.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.243.253:38923
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435717191469-28623-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.27.243.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18708
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435717191469-28623-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:11:13.395591 18708 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:11:13.395799 18708 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:11:13.400472 18715 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:11:13.400511 18723 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:11:13.400512 18721 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:11:13.400622 18708 server_base.cc:1034] running on GCE node
I20260811 08:11:13.400938 18708 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:11:13.401213 18708 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:11:13.402366 18708 hybrid_clock.cc:648] HybridClock initialized: now 1786435873402348 us; error 36 us; skew 500 ppm
Aug 11 08:11:13 dist-test-slave-7lbf krb5kdc[18556](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435873, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:11:13.404773 18708 init.cc:377] Logged in from keytab as kudu/127.27.243.253@KRBTEST.COM (short username kudu)
I20260811 08:11:13.405212 18708 webserver.cc:460] Webserver started at http://127.27.243.253:43089/ using document root <none> and password file <none>
I20260811 08:11:13.405417 18708 fs_manager.cc:359] Metadata directory not provided
I20260811 08:11:13.405465 18708 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:11:13.405615 18708 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:11:13.406718 18708 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435717191469-28623-0/minicluster-data/master-1/data/instance:
uuid: "7fccecccdcf3427b8237f3f83165a653"
format_stamp: "Formatted at 2026-08-11 08:11:13 on dist-test-slave-7lbf"
server_key: "5e67793b6c75ec2820166a7da7982eb9"
server_key_iv: "3d9e781e443d92f5b05842fafbaa3c31"
server_key_version: "encryptionkey@0"
I20260811 08:11:13.407058 18708 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435717191469-28623-0/minicluster-data/master-1/wal/instance:
uuid: "7fccecccdcf3427b8237f3f83165a653"
format_stamp: "Formatted at 2026-08-11 08:11:13 on dist-test-slave-7lbf"
server_key: "5e67793b6c75ec2820166a7da7982eb9"
server_key_iv: "3d9e781e443d92f5b05842fafbaa3c31"
server_key_version: "encryptionkey@0"
I20260811 08:11:13.408280 18708 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 08:11:13.408901 18733 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:11:13.409075 18708 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 08:11:13.409160 18708 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435717191469-28623-0/minicluster-data/master-1/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435717191469-28623-0/minicluster-data/master-1/wal
uuid: "7fccecccdcf3427b8237f3f83165a653"
format_stamp: "Formatted at 2026-08-11 08:11:13 on dist-test-slave-7lbf"
server_key: "5e67793b6c75ec2820166a7da7982eb9"
server_key_iv: "3d9e781e443d92f5b05842fafbaa3c31"
server_key_version: "encryptionkey@0"
I20260811 08:11:13.409220 18708 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435717191469-28623-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435717191469-28623-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435717191469-28623-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:11:13.410049 18697 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.243.253" port: 38923 } attempt: 2
I20260811 08:11:13.410405 18701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:13.410293 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.253:38923 (local address 127.0.0.1:41614)
0811 08:11:13.410343 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:13.410374 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.253:38923: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
I20260811 08:11:13.410717 18701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:13.410636 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.253:38923 (local address 127.0.0.1:41618)
0811 08:11:13.410670 (+ 34us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:13.410693 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.253:38923: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":21}
W20260811 08:11:13.410836 18697 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.27.243.253:38923: Network error: Client connection negotiation failed: client connection to 127.27.243.253:38923: connect: Connection refused (error 111)
I20260811 08:11:13.420838 18708 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:11:13.422698 18708 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:11:13.422829 18708 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:11:13.426690 18708 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.253:38923
I20260811 08:11:13.426723 18820 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.253:38923 every 8 connection(s)
I20260811 08:11:13.427048 18708 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435717191469-28623-0/minicluster-data/master-1/data/info.pb
I20260811 08:11:13.427841 18821 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:11:13.429358 18821 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.243.254" port: 34909 } has no permanent_uuid. Determining permanent_uuid...
I20260811 08:11:13.434648 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 18708
I20260811 08:11:13.434742 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435717191469-28623-0/minicluster-data/master-1/wal/instance
Aug 11 08:11:13 dist-test-slave-7lbf krb5kdc[18556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435873, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.253@KRBTEST.COM for kudu/127.27.243.254@KRBTEST.COM
I20260811 08:11:13.434918 28623 external_mini_cluster.cc:1428] Setting key 744d5311465fc6020a3c40578db20493
I20260811 08:11:13.437865 18700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:13.430027 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44478 (local address 127.27.243.254:34909)
0811 08:11:13.430103 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0811 08:11:13.430105 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:11:13.430283 (+ 178us) server_negotiation.cc:407] Connection header received
0811 08:11:13.430728 (+ 445us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:11:13.430729 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:11:13.430743 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:11:13.430847 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:11:13.431464 (+ 617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:13.432022 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:13.432967 (+ 945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:13.433178 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:13.433240 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:13.435324 (+ 2084us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:11:13.435326 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:11:13.435326 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:11:13.435333 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:11:13.436550 (+ 1217us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:11:13.436933 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:11:13.436934 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:11:13.436935 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:11:13.436989 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:11:13.437200 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:11:13.437201 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:11:13.437201 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:11:13.437314 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:11:13.437370 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 08:11:13.437676 (+ 306us) server_negotiation.cc:299] Negotiation successful
0811 08:11:13.437767 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 08:11:13.438004 18823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:13.430004 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:34909 (local address 127.0.0.1:44478)
0811 08:11:13.430148 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:13.430184 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 08:11:13.430645 (+ 461us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:11:13.430947 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:11:13.430950 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:11:13.431183 (+ 233us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:11:13.431375 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:11:13.431379 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:11:13.432112 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:11:13.432113 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:11:13.432889 (+ 776us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:11:13.432892 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:11:13.433244 (+ 352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:11:13.433245 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:11:13.433338 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:13.433802 (+ 464us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:11:13.433810 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:11:13.435222 (+ 1412us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:11:13.436624 (+ 1402us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:11:13.436631 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:11:13.436633 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:11:13.436861 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:11:13.437046 (+ 185us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:11:13.437046 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:11:13.437047 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:11:13.437144 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:11:13.437371 (+ 227us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:11:13.437378 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:11:13.437504 (+ 126us) client_negotiation.cc:769] Sending connection context
0811 08:11:13.437632 (+ 128us) client_negotiation.cc:240] Negotiation successful
0811 08:11:13.437798 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":74,"threads_started":1}
I20260811 08:11:13.438510 18821 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.243.253" port: 38923 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 08:11:13 dist-test-slave-7lbf krb5kdc[18556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435873, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.253@KRBTEST.COM for kudu/127.27.243.253@KRBTEST.COM
WARNING: no policy specified for kudu/127.27.243.252@KRBTEST.COM; defaulting to no policy
I20260811 08:11:13.445021 18826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:13.438782 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41620 (local address 127.27.243.253:38923)
0811 08:11:13.438912 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0811 08:11:13.438917 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 08:11:13.438935 (+ 18us) server_negotiation.cc:407] Connection header received
0811 08:11:13.438956 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:11:13.438958 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:11:13.438970 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:11:13.439037 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:11:13.439281 (+ 244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:13.439950 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:13.440615 (+ 665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:13.440960 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:13.441019 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:13.442749 (+ 1730us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:11:13.442756 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:11:13.442756 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:11:13.442762 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:11:13.444089 (+ 1327us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:11:13.444388 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:11:13.444389 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:11:13.444390 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:11:13.444434 (+ 44us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:11:13.444559 (+ 125us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:11:13.444560 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:11:13.444560 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:11:13.444676 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:11:13.444731 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 08:11:13.444872 (+ 141us) server_negotiation.cc:299] Negotiation successful
0811 08:11:13.444948 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":103,"thread_start_us":68,"threads_started":1}
I20260811 08:11:13.445088 18823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:13.438746 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.253:38923 (local address 127.0.0.1:41620)
0811 08:11:13.438800 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:13.438813 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 08:11:13.438860 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:11:13.439049 (+ 189us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:11:13.439050 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:11:13.439177 (+ 127us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:11:13.439220 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:11:13.439221 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:11:13.440026 (+ 805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:11:13.440026 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:11:13.440554 (+ 528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:11:13.440556 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:11:13.441023 (+ 467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:11:13.441024 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:11:13.441086 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:13.441448 (+ 362us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:11:13.441452 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:11:13.442640 (+ 1188us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:11:13.444163 (+ 1523us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:11:13.444164 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:11:13.444164 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:11:13.444322 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:11:13.444475 (+ 153us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:11:13.444476 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:11:13.444476 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:11:13.444520 (+ 44us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:11:13.444732 (+ 212us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:11:13.444733 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:11:13.444770 (+ 37us) client_negotiation.cc:769] Sending connection context
0811 08:11:13.444841 (+ 71us) client_negotiation.cc:240] Negotiation successful
0811 08:11:13.445013 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32,"mutex_wait_us":56}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.243.252@KRBTEST.COM" created.
I20260811 08:11:13.445636 18821 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.243.252" port: 34861 } has no permanent_uuid. Determining permanent_uuid...
I20260811 08:11:13.445962 18823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:13.445856 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.252:34861 (local address 127.0.0.1:39222)
0811 08:11:13.445900 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:13.445944 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.252:34861: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260811 08:11:13.446091 18735 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.27.243.252:34861: connect: Connection refused (error 111)
I20260811 08:11:13.446491 18823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:13.446413 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.252:34861 (local address 127.0.0.1:39234)
0811 08:11:13.446444 (+ 31us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:13.446469 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.252:34861: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":17}
W20260811 08:11:13.446590 18821 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.27.243.252:34861: Network error: Client connection negotiation failed: client connection to 127.27.243.252:34861: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.243.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.252.keytab.
Entry for principal kudu/127.27.243.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.252.keytab.
I20260811 08:11:13.458374 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435717191469-28623-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435717191469-28623-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435717191469-28623-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435717191469-28623-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.243.252:34861
--webserver_interface=127.27.243.252
--webserver_port=0
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.252.keytab
--principal=kudu/127.27.243.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:41441
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.243.254:34909,127.27.243.253:38923,127.27.243.252:34861
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 08:11:13.495831 18821 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.243.252" port: 34861 } attempt: 1
I20260811 08:11:13.496310 18823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:13.496188 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.252:34861 (local address 127.0.0.1:39238)
0811 08:11:13.496246 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:13.496278 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.252:34861: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260811 08:11:13.496626 18823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:13.496550 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.252:34861 (local address 127.0.0.1:39246)
0811 08:11:13.496584 (+ 34us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:13.496608 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.252:34861: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":21}
W20260811 08:11:13.496712 18821 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.27.243.252:34861: Network error: Client connection negotiation failed: client connection to 127.27.243.252:34861: connect: Connection refused (error 111)
I20260811 08:11:13.501965 18697 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.243.253" port: 38923 } attempt: 3
Aug 11 08:11:13 dist-test-slave-7lbf krb5kdc[18556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435873, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.254@KRBTEST.COM for kudu/127.27.243.253@KRBTEST.COM
I20260811 08:11:13.509111 18701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:13.502252 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.253:38923 (local address 127.0.0.1:41632)
0811 08:11:13.502302 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:13.502314 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 08:11:13.502374 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:11:13.502547 (+ 173us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:11:13.502548 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:11:13.502700 (+ 152us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:11:13.502768 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:11:13.502770 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:11:13.503723 (+ 953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:11:13.503725 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:11:13.504257 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:11:13.504259 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:11:13.504755 (+ 496us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:11:13.504757 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:11:13.504833 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:13.505278 (+ 445us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:11:13.505283 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:11:13.506696 (+ 1413us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:11:13.508265 (+ 1569us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:11:13.508266 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:11:13.508267 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:11:13.508431 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:11:13.508605 (+ 174us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:11:13.508605 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:11:13.508606 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:11:13.508652 (+ 46us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:11:13.508885 (+ 233us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:11:13.508885 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:11:13.508923 (+ 38us) client_negotiation.cc:769] Sending connection context
0811 08:11:13.508970 (+ 47us) client_negotiation.cc:240] Negotiation successful
0811 08:11:13.509045 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30}
I20260811 08:11:13.509183 18826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:13.502338 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41632 (local address 127.27.243.253:38923)
0811 08:11:13.502401 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0811 08:11:13.502403 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:11:13.502413 (+ 10us) server_negotiation.cc:407] Connection header received
0811 08:11:13.502443 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:11:13.502444 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:11:13.502458 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:11:13.502535 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:11:13.502832 (+ 297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:13.503617 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:13.504341 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:13.504659 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:13.504728 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:13.506781 (+ 2053us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:11:13.506783 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:11:13.506783 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:11:13.506791 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:11:13.508192 (+ 1401us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:11:13.508492 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:11:13.508493 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:11:13.508494 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:11:13.508551 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:11:13.508697 (+ 146us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:11:13.508698 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:11:13.508698 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:11:13.508822 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:11:13.508886 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0811 08:11:13.509008 (+ 122us) server_negotiation.cc:299] Negotiation successful
0811 08:11:13.509095 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 08:11:13.509577 18697 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.243.252" port: 34861 } has no permanent_uuid. Determining permanent_uuid...
I20260811 08:11:13.509888 18701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:13.509790 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.252:34861 (local address 127.0.0.1:39258)
0811 08:11:13.509832 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:13.509867 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.252:34861: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
I20260811 08:11:13.510164 18701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:13.510079 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.252:34861 (local address 127.0.0.1:39274)
0811 08:11:13.510116 (+ 37us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:13.510144 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.252:34861: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
W20260811 08:11:13.510243 18697 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.27.243.252:34861: Network error: Client connection negotiation failed: client connection to 127.27.243.252:34861: connect: Connection refused (error 111)
I20260811 08:11:13.541378 18697 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.243.252" port: 34861 } attempt: 1
I20260811 08:11:13.541868 18701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:13.541728 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.252:34861 (local address 127.0.0.1:39286)
0811 08:11:13.541802 (+ 74us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:13.541838 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.252:34861: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260811 08:11:13.542215 18701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:13.542131 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.252:34861 (local address 127.0.0.1:39298)
0811 08:11:13.542168 (+ 37us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:13.542195 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.252:34861: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
W20260811 08:11:13.542306 18697 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.27.243.252:34861: Network error: Client connection negotiation failed: client connection to 127.27.243.252:34861: connect: Connection refused (error 111)
W20260811 08:11:13.542327 18829 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:11:13.542553 18829 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:11:13.542589 18829 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:11:13.543720 18829 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:11:13.543761 18829 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:11:13.543779 18829 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:11:13.543795 18829 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:11:13.543812 18829 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:11:13.545303 18829 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:41441
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435717191469-28623-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435717191469-28623-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.27.243.254:34909,127.27.243.253:38923,127.27.243.252:34861
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.252.keytab
--principal=kudu/127.27.243.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.243.252:34861
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435717191469-28623-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.27.243.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18829
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435717191469-28623-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:11:13.545578 18829 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:11:13.545794 18829 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:11:13.550484 18842 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:11:13.550477 18837 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:11:13.550509 18829 server_base.cc:1034] running on GCE node
W20260811 08:11:13.550478 18836 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:11:13.550973 18829 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:11:13.551268 18829 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:11:13.552430 18829 hybrid_clock.cc:648] HybridClock initialized: now 1786435873552417 us; error 31 us; skew 500 ppm
Aug 11 08:11:13 dist-test-slave-7lbf krb5kdc[18556](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435873, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:11:13.554886 18829 init.cc:377] Logged in from keytab as kudu/127.27.243.252@KRBTEST.COM (short username kudu)
I20260811 08:11:13.555291 18829 webserver.cc:460] Webserver started at http://127.27.243.252:42457/ using document root <none> and password file <none>
I20260811 08:11:13.555492 18829 fs_manager.cc:359] Metadata directory not provided
I20260811 08:11:13.555540 18829 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:11:13.555663 18829 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:11:13.556686 18829 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435717191469-28623-0/minicluster-data/master-2/data/instance:
uuid: "5b06b995f7a34d15a8217fe8833c81f2"
format_stamp: "Formatted at 2026-08-11 08:11:13 on dist-test-slave-7lbf"
server_key: "43222f941f86652e0fa558514f92ae21"
server_key_iv: "9e3eb2e5e985a5d8d26e10ac3c3f9d7d"
server_key_version: "encryptionkey@0"
I20260811 08:11:13.557047 18829 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435717191469-28623-0/minicluster-data/master-2/wal/instance:
uuid: "5b06b995f7a34d15a8217fe8833c81f2"
format_stamp: "Formatted at 2026-08-11 08:11:13 on dist-test-slave-7lbf"
server_key: "43222f941f86652e0fa558514f92ae21"
server_key_iv: "9e3eb2e5e985a5d8d26e10ac3c3f9d7d"
server_key_version: "encryptionkey@0"
I20260811 08:11:13.558372 18829 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260811 08:11:13.559031 18852 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:11:13.559190 18829 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 08:11:13.559273 18829 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435717191469-28623-0/minicluster-data/master-2/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435717191469-28623-0/minicluster-data/master-2/wal
uuid: "5b06b995f7a34d15a8217fe8833c81f2"
format_stamp: "Formatted at 2026-08-11 08:11:13 on dist-test-slave-7lbf"
server_key: "43222f941f86652e0fa558514f92ae21"
server_key_iv: "9e3eb2e5e985a5d8d26e10ac3c3f9d7d"
server_key_version: "encryptionkey@0"
I20260811 08:11:13.559352 18829 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435717191469-28623-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435717191469-28623-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435717191469-28623-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:11:13.564857 18821 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.243.252" port: 34861 } attempt: 2
I20260811 08:11:13.565232 18823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:13.565122 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.252:34861 (local address 127.0.0.1:39310)
0811 08:11:13.565173 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:13.565202 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.252:34861: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
I20260811 08:11:13.565586 18823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:13.565475 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.252:34861 (local address 127.0.0.1:39324)
0811 08:11:13.565536 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:13.565564 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.252:34861: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
W20260811 08:11:13.565668 18821 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.27.243.252:34861: Network error: Client connection negotiation failed: client connection to 127.27.243.252:34861: connect: Connection refused (error 111)
I20260811 08:11:13.577241 18829 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:11:13.579332 18829 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:11:13.579455 18829 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:11:13.583387 18829 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.252:34861
I20260811 08:11:13.583429 18944 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.252:34861 every 8 connection(s)
I20260811 08:11:13.583758 18829 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435717191469-28623-0/minicluster-data/master-2/data/info.pb
I20260811 08:11:13.584625 18946 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:11:13.586222 18946 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.243.254" port: 34909 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 08:11:13 dist-test-slave-7lbf krb5kdc[18556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435873, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.252@KRBTEST.COM for kudu/127.27.243.254@KRBTEST.COM
I20260811 08:11:13.592934 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 18829
I20260811 08:11:13.593050 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435717191469-28623-0/minicluster-data/master-2/wal/instance
I20260811 08:11:13.593217 28623 external_mini_cluster.cc:1428] Setting key 690805be35ac4f04258f727b65b8840b
I20260811 08:11:13.594934 18700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:13.586916 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44494 (local address 127.27.243.254:34909)
0811 08:11:13.586973 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0811 08:11:13.586975 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:11:13.587135 (+ 160us) server_negotiation.cc:407] Connection header received
0811 08:11:13.587571 (+ 436us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:11:13.587572 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:11:13.587581 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:11:13.587635 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:11:13.588193 (+ 558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:13.588683 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:13.589731 (+ 1048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:13.589921 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:13.589971 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:13.591999 (+ 2028us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:11:13.592000 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:11:13.592001 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:11:13.592007 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:11:13.593444 (+ 1437us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:11:13.593927 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:11:13.593928 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:11:13.593928 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:11:13.593997 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:11:13.594261 (+ 264us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:11:13.594262 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:11:13.594262 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:11:13.594389 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:11:13.594441 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 08:11:13.594750 (+ 309us) server_negotiation.cc:299] Negotiation successful
0811 08:11:13.594842 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260811 08:11:13.595078 18949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:13.586868 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:34909 (local address 127.0.0.1:44494)
0811 08:11:13.587018 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:13.587057 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 08:11:13.587497 (+ 440us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:11:13.587697 (+ 200us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:11:13.587701 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:11:13.587939 (+ 238us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:11:13.588127 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:11:13.588131 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:11:13.588788 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:11:13.588790 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:11:13.589662 (+ 872us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:11:13.589665 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:11:13.589985 (+ 320us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:11:13.589986 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:11:13.590095 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:13.590514 (+ 419us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:11:13.590522 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:11:13.591916 (+ 1394us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:11:13.593562 (+ 1646us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:11:13.593567 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:11:13.593569 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:11:13.593832 (+ 263us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:11:13.594056 (+ 224us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:11:13.594057 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:11:13.594057 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:11:13.594196 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:11:13.594449 (+ 253us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:11:13.594455 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:11:13.594615 (+ 160us) client_negotiation.cc:769] Sending connection context
0811 08:11:13.594719 (+ 104us) client_negotiation.cc:240] Negotiation successful
0811 08:11:13.594851 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":78,"threads_started":1}
I20260811 08:11:13.595577 18946 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.243.253" port: 38923 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 08:11:13 dist-test-slave-7lbf krb5kdc[18556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435873, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.243.252@KRBTEST.COM
Aug 11 08:11:13 dist-test-slave-7lbf krb5kdc[18556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435873, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.252@KRBTEST.COM for kudu/127.27.243.253@KRBTEST.COM
I20260811 08:11:13.602180 18953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:13.593621 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39334 (local address 127.27.243.252:34861)
0811 08:11:13.593776 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0811 08:11:13.593781 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 08:11:13.593917 (+ 136us) server_negotiation.cc:407] Connection header received
0811 08:11:13.593958 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:11:13.593961 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:11:13.593975 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:11:13.594051 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:11:13.594671 (+ 620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:13.595845 (+ 1174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:13.596688 (+ 843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:13.597044 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:13.597112 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:13.599403 (+ 2291us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:11:13.599412 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:11:13.599412 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:11:13.599419 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:11:13.600940 (+ 1521us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:11:13.601324 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:11:13.601327 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:11:13.601328 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:11:13.601384 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:11:13.601591 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:11:13.601592 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:11:13.601592 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:11:13.601796 (+ 204us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:11:13.601922 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0811 08:11:13.602001 (+ 79us) server_negotiation.cc:299] Negotiation successful
0811 08:11:13.602081 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":127,"thread_start_us":76,"threads_started":1}
I20260811 08:11:13.602228 18826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:13.595908 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41634 (local address 127.27.243.253:38923)
0811 08:11:13.595953 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 08:11:13.595955 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:11:13.595962 (+ 7us) server_negotiation.cc:407] Connection header received
0811 08:11:13.595985 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:11:13.595986 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:11:13.595996 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:11:13.596033 (+ 37us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:11:13.596298 (+ 265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:13.596724 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:13.597460 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:13.597718 (+ 258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:13.597773 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:13.599783 (+ 2010us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:11:13.599784 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:11:13.599785 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:11:13.599792 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:11:13.601095 (+ 1303us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:11:13.601436 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:11:13.601438 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:11:13.601438 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:11:13.601509 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:11:13.601754 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:11:13.601754 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:11:13.601755 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:11:13.601873 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:11:13.601937 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0811 08:11:13.602083 (+ 146us) server_negotiation.cc:299] Negotiation successful
0811 08:11:13.602154 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 08:11:13.602303 18949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:13.595811 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.253:38923 (local address 127.0.0.1:41634)
0811 08:11:13.595849 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:13.595859 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 08:11:13.595898 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:11:13.596047 (+ 149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:11:13.596048 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:11:13.596184 (+ 136us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:11:13.596233 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:11:13.596234 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:11:13.596793 (+ 559us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:11:13.596795 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:11:13.597388 (+ 593us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:11:13.597391 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:11:13.597773 (+ 382us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:11:13.597773 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:11:13.597839 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:13.598168 (+ 329us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:11:13.598171 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:11:13.599697 (+ 1526us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:11:13.601175 (+ 1478us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:11:13.601176 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:11:13.601176 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:11:13.601361 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:11:13.601591 (+ 230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:11:13.601592 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:11:13.601592 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:11:13.601694 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:11:13.601942 (+ 248us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:11:13.601942 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:11:13.601983 (+ 41us) client_negotiation.cc:769] Sending connection context
0811 08:11:13.602050 (+ 67us) client_negotiation.cc:240] Negotiation successful
0811 08:11:13.602221 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":23,"mutex_wait_us":2}
I20260811 08:11:13.602761 18946 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.243.252" port: 34861 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 08:11:13 dist-test-slave-7lbf krb5kdc[18556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435873, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.252@KRBTEST.COM for kudu/127.27.243.252@KRBTEST.COM
Aug 11 08:11:13 dist-test-slave-7lbf krb5kdc[18556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435873, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.243.254@KRBTEST.COM
I20260811 08:11:13.609246 18949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:13.602992 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.252:34861 (local address 127.0.0.1:39336)
0811 08:11:13.603027 (+ 35us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:13.603036 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 08:11:13.603074 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:11:13.603198 (+ 124us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:11:13.603198 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:11:13.603335 (+ 137us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:11:13.603360 (+ 25us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:11:13.603362 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:11:13.603944 (+ 582us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:11:13.603945 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:11:13.604392 (+ 447us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:11:13.604393 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:11:13.604713 (+ 320us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:11:13.604714 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:11:13.604756 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:13.605125 (+ 369us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:11:13.605129 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:11:13.606480 (+ 1351us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:11:13.608184 (+ 1704us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:11:13.608185 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:11:13.608186 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:11:13.608391 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:11:13.608612 (+ 221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:11:13.608613 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:11:13.608613 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:11:13.608663 (+ 50us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:11:13.608930 (+ 267us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:11:13.608930 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:11:13.608982 (+ 52us) client_negotiation.cc:769] Sending connection context
0811 08:11:13.609041 (+ 59us) client_negotiation.cc:240] Negotiation successful
0811 08:11:13.609132 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":23}
I20260811 08:11:13.609308 18953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:13.603012 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39336 (local address 127.27.243.252:34861)
0811 08:11:13.603039 (+ 27us) server_negotiation.cc:206] Beginning negotiation
0811 08:11:13.603041 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:11:13.603063 (+ 22us) server_negotiation.cc:407] Connection header received
0811 08:11:13.603126 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:11:13.603127 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:11:13.603134 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:11:13.603168 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:11:13.603427 (+ 259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:13.603880 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:13.604454 (+ 574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:13.604659 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:13.604710 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:13.606558 (+ 1848us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:11:13.606559 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:11:13.606560 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:11:13.606565 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:11:13.608097 (+ 1532us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:11:13.608479 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:11:13.608480 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:11:13.608481 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:11:13.608543 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:11:13.608712 (+ 169us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:11:13.608713 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:11:13.608713 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:11:13.608864 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:11:13.608925 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 08:11:13.609074 (+ 149us) server_negotiation.cc:299] Negotiation successful
0811 08:11:13.609179 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":38,"server-negotiator.queue_time_us":16}
I20260811 08:11:13.609582 18700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:13.603074 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44496 (local address 127.27.243.254:34909)
0811 08:11:13.603116 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 08:11:13.603118 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:11:13.603126 (+ 8us) server_negotiation.cc:407] Connection header received
0811 08:11:13.603168 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:11:13.603169 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:11:13.603177 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:11:13.603232 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:11:13.603640 (+ 408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:13.604084 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:13.604705 (+ 621us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:13.604928 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:13.604990 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:13.607089 (+ 2099us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:11:13.607091 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:11:13.607091 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:11:13.607097 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:11:13.608427 (+ 1330us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:11:13.608766 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:11:13.608767 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:11:13.608767 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:11:13.608853 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:11:13.609033 (+ 180us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:11:13.609034 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:11:13.609034 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:11:13.609157 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:11:13.609354 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0811 08:11:13.609397 (+ 43us) server_negotiation.cc:299] Negotiation successful
0811 08:11:13.609475 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 08:11:13.611310 18946 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5b06b995f7a34d15a8217fe8833c81f2: Bootstrap starting.
I20260811 08:11:13.612280 18946 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5b06b995f7a34d15a8217fe8833c81f2: Neither blocks nor log segments found. Creating new log.
I20260811 08:11:13.612587 18946 log.cc:824] T 00000000000000000000000000000000 P 5b06b995f7a34d15a8217fe8833c81f2: Log is configured to *not* fsync() on all Append() calls
I20260811 08:11:13.613446 18946 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5b06b995f7a34d15a8217fe8833c81f2: No bootstrap required, opened a new log
Aug 11 08:11:13 dist-test-slave-7lbf krb5kdc[18556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435873, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.243.253@KRBTEST.COM
I20260811 08:11:13.615283 18946 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5b06b995f7a34d15a8217fe8833c81f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5393b5229a7433f91fda4a172a65742" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 34909 } } peers { permanent_uuid: "7fccecccdcf3427b8237f3f83165a653" member_type: VOTER last_known_addr { host: "127.27.243.253" port: 38923 } } peers { permanent_uuid: "5b06b995f7a34d15a8217fe8833c81f2" member_type: VOTER last_known_addr { host: "127.27.243.252" port: 34861 } }
I20260811 08:11:13.615450 18946 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5b06b995f7a34d15a8217fe8833c81f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:11:13.615499 18946 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5b06b995f7a34d15a8217fe8833c81f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b06b995f7a34d15a8217fe8833c81f2, State: Initialized, Role: FOLLOWER
I20260811 08:11:13.615628 18946 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5b06b995f7a34d15a8217fe8833c81f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5393b5229a7433f91fda4a172a65742" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 34909 } } peers { permanent_uuid: "7fccecccdcf3427b8237f3f83165a653" member_type: VOTER last_known_addr { host: "127.27.243.253" port: 38923 } } peers { permanent_uuid: "5b06b995f7a34d15a8217fe8833c81f2" member_type: VOTER last_known_addr { host: "127.27.243.252" port: 34861 } }
I20260811 08:11:13.615926 18958 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5b06b995f7a34d15a8217fe8833c81f2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5393b5229a7433f91fda4a172a65742" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 34909 } } peers { permanent_uuid: "7fccecccdcf3427b8237f3f83165a653" member_type: VOTER last_known_addr { host: "127.27.243.253" port: 38923 } } peers { permanent_uuid: "5b06b995f7a34d15a8217fe8833c81f2" member_type: VOTER last_known_addr { host: "127.27.243.252" port: 34861 } } }
I20260811 08:11:13.615980 18946 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5b06b995f7a34d15a8217fe8833c81f2 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:11:13.616004 18958 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5b06b995f7a34d15a8217fe8833c81f2 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 08:11:13.617178 18826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:13.610207 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41650 (local address 127.27.243.253:38923)
0811 08:11:13.610252 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 08:11:13.610254 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:11:13.610261 (+ 7us) server_negotiation.cc:407] Connection header received
0811 08:11:13.610280 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:11:13.610281 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:11:13.610291 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:11:13.610365 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:11:13.610769 (+ 404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:13.611410 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:13.612075 (+ 665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:13.612342 (+ 267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:13.612413 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:13.614464 (+ 2051us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:11:13.614466 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:11:13.614466 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:11:13.614473 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:11:13.615890 (+ 1417us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:11:13.616269 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:11:13.616270 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:11:13.616270 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:11:13.616336 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:11:13.616513 (+ 177us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:11:13.616514 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:11:13.616515 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:11:13.616647 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:11:13.616827 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0811 08:11:13.617012 (+ 185us) server_negotiation.cc:299] Negotiation successful
0811 08:11:13.617092 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 08:11:13.617437 18697 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.243.252" port: 34861 } attempt: 2
W20260811 08:11:13.618417 18978 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 5b06b995f7a34d15a8217fe8833c81f2: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 08:11:13.618532 18978 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 08:11:13.619005 28623 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
Aug 11 08:11:13 dist-test-slave-7lbf krb5kdc[18556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435873, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.254@KRBTEST.COM for kudu/127.27.243.252@KRBTEST.COM
I20260811 08:11:13.619038 18829 master_runner.cc:186] Error getting master registration for 127.27.243.254:34909: OK, instance_id { permanent_uuid: "d5393b5229a7433f91fda4a172a65742" instance_seqno: 1786435873276323 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 08:11:13.622210 18829 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 08:11:13.624604 18701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:13.617705 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.252:34861 (local address 127.0.0.1:39340)
0811 08:11:13.617754 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:13.617763 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 08:11:13.617799 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:11:13.617975 (+ 176us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:11:13.617977 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:11:13.618127 (+ 150us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:11:13.618169 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:11:13.618172 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:11:13.619007 (+ 835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:11:13.619008 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:11:13.619709 (+ 701us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:11:13.619711 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:11:13.620216 (+ 505us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:11:13.620217 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:11:13.620273 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:13.620637 (+ 364us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:11:13.620642 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:11:13.622041 (+ 1399us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:11:13.623623 (+ 1582us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:11:13.623624 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:11:13.623624 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:11:13.623832 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:11:13.624019 (+ 187us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:11:13.624020 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:11:13.624020 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:11:13.624071 (+ 51us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:11:13.624333 (+ 262us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:11:13.624334 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:11:13.624375 (+ 41us) client_negotiation.cc:769] Sending connection context
0811 08:11:13.624432 (+ 57us) client_negotiation.cc:240] Negotiation successful
0811 08:11:13.624511 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260811 08:11:13.625144 18953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:13.617780 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39340 (local address 127.27.243.252:34861)
0811 08:11:13.617832 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 08:11:13.617836 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 08:11:13.617844 (+ 8us) server_negotiation.cc:407] Connection header received
0811 08:11:13.617863 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:11:13.617864 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:11:13.617873 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:11:13.617928 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:11:13.618243 (+ 315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:13.618921 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:13.619802 (+ 881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:13.620102 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:13.620165 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:13.622128 (+ 1963us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:11:13.622129 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:11:13.622129 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:11:13.622136 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:11:13.623551 (+ 1415us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:11:13.623907 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:11:13.623908 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:11:13.623909 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:11:13.623962 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:11:13.624125 (+ 163us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:11:13.624126 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:11:13.624126 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:11:13.624256 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:11:13.624307 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 08:11:13.624985 (+ 678us) server_negotiation.cc:299] Negotiation successful
0811 08:11:13.625061 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260811 08:11:13.626847 18697 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d5393b5229a7433f91fda4a172a65742: Bootstrap starting.
I20260811 08:11:13.627589 18697 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d5393b5229a7433f91fda4a172a65742: Neither blocks nor log segments found. Creating new log.
I20260811 08:11:13.627915 18697 log.cc:824] T 00000000000000000000000000000000 P d5393b5229a7433f91fda4a172a65742: Log is configured to *not* fsync() on all Append() calls
I20260811 08:11:13.628886 18700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:13.620444 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44498 (local address 127.27.243.254:34909)
0811 08:11:13.620490 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 08:11:13.620492 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:11:13.621451 (+ 959us) server_negotiation.cc:407] Connection header received
0811 08:11:13.621615 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:11:13.621617 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:11:13.621627 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:11:13.621654 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:11:13.622549 (+ 895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:13.623437 (+ 888us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:13.624384 (+ 947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:13.624640 (+ 256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:13.624678 (+ 38us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:13.626069 (+ 1391us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:11:13.626070 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:11:13.626070 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:11:13.626076 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:11:13.627742 (+ 1666us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:11:13.628111 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:11:13.628112 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:11:13.628112 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:11:13.628165 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:11:13.628358 (+ 193us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:11:13.628359 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:11:13.628360 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:11:13.628459 (+ 99us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:11:13.628536 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 08:11:13.628719 (+ 183us) server_negotiation.cc:299] Negotiation successful
0811 08:11:13.628789 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 08:11:13.632320 18826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:13.620762 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41660 (local address 127.27.243.253:38923)
0811 08:11:13.620794 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0811 08:11:13.620796 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:11:13.622438 (+ 1642us) server_negotiation.cc:407] Connection header received
0811 08:11:13.622528 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:11:13.622529 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:11:13.622538 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:11:13.622565 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:11:13.623221 (+ 656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:13.623901 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:13.626614 (+ 2713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:13.626900 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:13.626941 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:13.629581 (+ 2640us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:11:13.629582 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:11:13.629582 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:11:13.629589 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:11:13.631045 (+ 1456us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:11:13.631493 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:11:13.631494 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:11:13.631494 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:11:13.631551 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:11:13.631720 (+ 169us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:11:13.631721 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:11:13.631721 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:11:13.631916 (+ 195us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:11:13.632014 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0811 08:11:13.632166 (+ 152us) server_negotiation.cc:299] Negotiation successful
0811 08:11:13.632231 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260811 08:11:13.632709 18991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:13.621057 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39344 (local address 127.27.243.252:34861)
0811 08:11:13.621312 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0811 08:11:13.621314 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:11:13.624997 (+ 3683us) server_negotiation.cc:407] Connection header received
0811 08:11:13.625018 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:11:13.625018 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:11:13.625040 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:11:13.625094 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:11:13.625774 (+ 680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:13.626503 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:13.628106 (+ 1603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:13.628443 (+ 337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:13.628510 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:13.629761 (+ 1251us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:11:13.629762 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:11:13.629762 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:11:13.629768 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:11:13.631060 (+ 1292us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:11:13.631642 (+ 582us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:11:13.631643 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:11:13.631644 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:11:13.631698 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:11:13.631855 (+ 157us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:11:13.631855 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:11:13.631856 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:11:13.632011 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:11:13.632108 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0811 08:11:13.632573 (+ 465us) server_negotiation.cc:299] Negotiation successful
0811 08:11:13.632637 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":222,"thread_start_us":61,"threads_started":1}
I20260811 08:11:13.634135 18697 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d5393b5229a7433f91fda4a172a65742: No bootstrap required, opened a new log
I20260811 08:11:13.636135 18697 raft_consensus.cc:348] T 00000000000000000000000000000000 P d5393b5229a7433f91fda4a172a65742 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5393b5229a7433f91fda4a172a65742" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 34909 } } peers { permanent_uuid: "7fccecccdcf3427b8237f3f83165a653" member_type: VOTER last_known_addr { host: "127.27.243.253" port: 38923 } } peers { permanent_uuid: "5b06b995f7a34d15a8217fe8833c81f2" member_type: VOTER last_known_addr { host: "127.27.243.252" port: 34861 } }
I20260811 08:11:13.636277 18697 raft_consensus.cc:374] T 00000000000000000000000000000000 P d5393b5229a7433f91fda4a172a65742 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:11:13.636319 18697 raft_consensus.cc:729] T 00000000000000000000000000000000 P d5393b5229a7433f91fda4a172a65742 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5393b5229a7433f91fda4a172a65742, State: Initialized, Role: FOLLOWER
I20260811 08:11:13.636438 18697 consensus_queue.cc:260] T 00000000000000000000000000000000 P d5393b5229a7433f91fda4a172a65742 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5393b5229a7433f91fda4a172a65742" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 34909 } } peers { permanent_uuid: "7fccecccdcf3427b8237f3f83165a653" member_type: VOTER last_known_addr { host: "127.27.243.253" port: 38923 } } peers { permanent_uuid: "5b06b995f7a34d15a8217fe8833c81f2" member_type: VOTER last_known_addr { host: "127.27.243.252" port: 34861 } }
I20260811 08:11:13.636687 18995 sys_catalog.cc:455] T 00000000000000000000000000000000 P d5393b5229a7433f91fda4a172a65742 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5393b5229a7433f91fda4a172a65742" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 34909 } } peers { permanent_uuid: "7fccecccdcf3427b8237f3f83165a653" member_type: VOTER last_known_addr { host: "127.27.243.253" port: 38923 } } peers { permanent_uuid: "5b06b995f7a34d15a8217fe8833c81f2" member_type: VOTER last_known_addr { host: "127.27.243.252" port: 34861 } } }
I20260811 08:11:13.636744 18697 sys_catalog.cc:564] T 00000000000000000000000000000000 P d5393b5229a7433f91fda4a172a65742 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:11:13.636770 18995 sys_catalog.cc:458] T 00000000000000000000000000000000 P d5393b5229a7433f91fda4a172a65742 [sys.catalog]: This master's current role is: FOLLOWER
W20260811 08:11:13.638896 19013 catalog_manager.cc:1558] T 00000000000000000000000000000000 P d5393b5229a7433f91fda4a172a65742: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 08:11:13.639003 19013 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 08:11:13.639566 18579 master_runner.cc:186] Error getting master registration for 127.27.243.253:38923: OK, instance_id { permanent_uuid: "7fccecccdcf3427b8237f3f83165a653" instance_seqno: 1786435873425561 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 08:11:13.641904 18579 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 08:11:13.656813 18821 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.243.252" port: 34861 } attempt: 3
Aug 11 08:11:13 dist-test-slave-7lbf krb5kdc[18556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435873, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.253@KRBTEST.COM for kudu/127.27.243.252@KRBTEST.COM
I20260811 08:11:13.665186 18823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:13.657119 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.252:34861 (local address 127.0.0.1:39354)
0811 08:11:13.657173 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:13.657184 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 08:11:13.657221 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:11:13.657367 (+ 146us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:11:13.657368 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:11:13.657587 (+ 219us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:11:13.657644 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:11:13.657646 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:11:13.658611 (+ 965us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:11:13.658612 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:11:13.659435 (+ 823us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:11:13.659437 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:11:13.659955 (+ 518us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:11:13.659956 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:11:13.660021 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:13.660579 (+ 558us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:11:13.660584 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:11:13.662175 (+ 1591us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:11:13.664098 (+ 1923us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:11:13.664099 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:11:13.664100 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:11:13.664339 (+ 239us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:11:13.664543 (+ 204us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:11:13.664544 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:11:13.664544 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:11:13.664609 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:11:13.664860 (+ 251us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:11:13.664861 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:11:13.664911 (+ 50us) client_negotiation.cc:769] Sending connection context
0811 08:11:13.664979 (+ 68us) client_negotiation.cc:240] Negotiation successful
0811 08:11:13.665081 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260811 08:11:13.665205 18991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:13.657181 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39354 (local address 127.27.243.252:34861)
0811 08:11:13.657225 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 08:11:13.657227 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:11:13.657263 (+ 36us) server_negotiation.cc:407] Connection header received
0811 08:11:13.657287 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:11:13.657288 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:11:13.657299 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:11:13.657360 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:11:13.657721 (+ 361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:13.658526 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:13.659518 (+ 992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:13.659887 (+ 369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:13.659955 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:13.662262 (+ 2307us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:11:13.662264 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:11:13.662264 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:11:13.662272 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:11:13.664008 (+ 1736us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:11:13.664415 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:11:13.664416 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:11:13.664417 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:11:13.664480 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:11:13.664666 (+ 186us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:11:13.664667 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:11:13.664667 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:11:13.664800 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:11:13.664867 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 08:11:13.665021 (+ 154us) server_negotiation.cc:299] Negotiation successful
0811 08:11:13.665107 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 08:11:13.667444 18821 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7fccecccdcf3427b8237f3f83165a653: Bootstrap starting.
I20260811 08:11:13.668205 18821 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7fccecccdcf3427b8237f3f83165a653: Neither blocks nor log segments found. Creating new log.
I20260811 08:11:13.668552 18821 log.cc:824] T 00000000000000000000000000000000 P 7fccecccdcf3427b8237f3f83165a653: Log is configured to *not* fsync() on all Append() calls
I20260811 08:11:13.669674 18821 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7fccecccdcf3427b8237f3f83165a653: No bootstrap required, opened a new log
I20260811 08:11:13.671756 18821 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7fccecccdcf3427b8237f3f83165a653 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5393b5229a7433f91fda4a172a65742" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 34909 } } peers { permanent_uuid: "7fccecccdcf3427b8237f3f83165a653" member_type: VOTER last_known_addr { host: "127.27.243.253" port: 38923 } } peers { permanent_uuid: "5b06b995f7a34d15a8217fe8833c81f2" member_type: VOTER last_known_addr { host: "127.27.243.252" port: 34861 } }
I20260811 08:11:13.671902 18821 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7fccecccdcf3427b8237f3f83165a653 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:11:13.671936 18821 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7fccecccdcf3427b8237f3f83165a653 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fccecccdcf3427b8237f3f83165a653, State: Initialized, Role: FOLLOWER
I20260811 08:11:13.672108 18821 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7fccecccdcf3427b8237f3f83165a653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5393b5229a7433f91fda4a172a65742" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 34909 } } peers { permanent_uuid: "7fccecccdcf3427b8237f3f83165a653" member_type: VOTER last_known_addr { host: "127.27.243.253" port: 38923 } } peers { permanent_uuid: "5b06b995f7a34d15a8217fe8833c81f2" member_type: VOTER last_known_addr { host: "127.27.243.252" port: 34861 } }
I20260811 08:11:13.672439 18821 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7fccecccdcf3427b8237f3f83165a653 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:11:13.672390 19020 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7fccecccdcf3427b8237f3f83165a653 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5393b5229a7433f91fda4a172a65742" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 34909 } } peers { permanent_uuid: "7fccecccdcf3427b8237f3f83165a653" member_type: VOTER last_known_addr { host: "127.27.243.253" port: 38923 } } peers { permanent_uuid: "5b06b995f7a34d15a8217fe8833c81f2" member_type: VOTER last_known_addr { host: "127.27.243.252" port: 34861 } } }
I20260811 08:11:13.672595 19020 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7fccecccdcf3427b8237f3f83165a653 [sys.catalog]: This master's current role is: FOLLOWER
W20260811 08:11:13.673389 18743 tablet.cc:2369] T 00000000000000000000000000000000 P 7fccecccdcf3427b8237f3f83165a653: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 08:11:13.674309 19036 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 7fccecccdcf3427b8237f3f83165a653: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 08:11:13.674445 19036 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 08:11:13.676625 18708 master_runner.cc:263] No leader master found from master 7fccecccdcf3427b8237f3f83165a653
I20260811 08:11:13.676676 18708 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 08:11:13.771178 18958 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5b06b995f7a34d15a8217fe8833c81f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:11:13.771332 18958 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5b06b995f7a34d15a8217fe8833c81f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5393b5229a7433f91fda4a172a65742" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 34909 } } peers { permanent_uuid: "7fccecccdcf3427b8237f3f83165a653" member_type: VOTER last_known_addr { host: "127.27.243.253" port: 38923 } } peers { permanent_uuid: "5b06b995f7a34d15a8217fe8833c81f2" member_type: VOTER last_known_addr { host: "127.27.243.252" port: 34861 } }
I20260811 08:11:13.771579 18958 leader_election.cc:288] T 00000000000000000000000000000000 P 5b06b995f7a34d15a8217fe8833c81f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5393b5229a7433f91fda4a172a65742 (127.27.243.254:34909), 7fccecccdcf3427b8237f3f83165a653 (127.27.243.253:38923)
I20260811 08:11:13.771826 18647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5b06b995f7a34d15a8217fe8833c81f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5393b5229a7433f91fda4a172a65742" is_pre_election: true
I20260811 08:11:13.771937 18779 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5b06b995f7a34d15a8217fe8833c81f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fccecccdcf3427b8237f3f83165a653" is_pre_election: true
I20260811 08:11:13.772014 18647 raft_consensus.cc:2454] T 00000000000000000000000000000000 P d5393b5229a7433f91fda4a172a65742 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b06b995f7a34d15a8217fe8833c81f2 in term 0.
I20260811 08:11:13.772059 18779 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 7fccecccdcf3427b8237f3f83165a653 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b06b995f7a34d15a8217fe8833c81f2 in term 0.
I20260811 08:11:13.772240 18856 leader_election.cc:302] T 00000000000000000000000000000000 P 5b06b995f7a34d15a8217fe8833c81f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b06b995f7a34d15a8217fe8833c81f2, 7fccecccdcf3427b8237f3f83165a653; no voters:
I20260811 08:11:13.772415 18958 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5b06b995f7a34d15a8217fe8833c81f2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 08:11:13.772464 18958 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5b06b995f7a34d15a8217fe8833c81f2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 08:11:13.772485 18958 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5b06b995f7a34d15a8217fe8833c81f2 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:11:13.773296 18958 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5b06b995f7a34d15a8217fe8833c81f2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5393b5229a7433f91fda4a172a65742" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 34909 } } peers { permanent_uuid: "7fccecccdcf3427b8237f3f83165a653" member_type: VOTER last_known_addr { host: "127.27.243.253" port: 38923 } } peers { permanent_uuid: "5b06b995f7a34d15a8217fe8833c81f2" member_type: VOTER last_known_addr { host: "127.27.243.252" port: 34861 } }
I20260811 08:11:13.773442 18958 leader_election.cc:288] T 00000000000000000000000000000000 P 5b06b995f7a34d15a8217fe8833c81f2 [CANDIDATE]: Term 1 election: Requested vote from peers d5393b5229a7433f91fda4a172a65742 (127.27.243.254:34909), 7fccecccdcf3427b8237f3f83165a653 (127.27.243.253:38923)
I20260811 08:11:13.773613 18647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5b06b995f7a34d15a8217fe8833c81f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5393b5229a7433f91fda4a172a65742"
I20260811 08:11:13.773641 18779 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5b06b995f7a34d15a8217fe8833c81f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fccecccdcf3427b8237f3f83165a653"
I20260811 08:11:13.773699 18779 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7fccecccdcf3427b8237f3f83165a653 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:11:13.773692 18647 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d5393b5229a7433f91fda4a172a65742 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:11:13.774531 18647 raft_consensus.cc:2454] T 00000000000000000000000000000000 P d5393b5229a7433f91fda4a172a65742 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b06b995f7a34d15a8217fe8833c81f2 in term 1.
I20260811 08:11:13.774531 18779 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 7fccecccdcf3427b8237f3f83165a653 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b06b995f7a34d15a8217fe8833c81f2 in term 1.
W20260811 08:11:13.774673 18609 tablet.cc:2369] T 00000000000000000000000000000000 P d5393b5229a7433f91fda4a172a65742: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 08:11:13.774858 18858 leader_election.cc:302] T 00000000000000000000000000000000 P 5b06b995f7a34d15a8217fe8833c81f2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b06b995f7a34d15a8217fe8833c81f2, d5393b5229a7433f91fda4a172a65742; no voters:
I20260811 08:11:13.774988 18958 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5b06b995f7a34d15a8217fe8833c81f2 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:11:13.775154 18958 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5b06b995f7a34d15a8217fe8833c81f2 [term 1 LEADER]: Becoming Leader. State: Replica: 5b06b995f7a34d15a8217fe8833c81f2, State: Running, Role: LEADER
I20260811 08:11:13.775245 18958 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5b06b995f7a34d15a8217fe8833c81f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5393b5229a7433f91fda4a172a65742" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 34909 } } peers { permanent_uuid: "7fccecccdcf3427b8237f3f83165a653" member_type: VOTER last_known_addr { host: "127.27.243.253" port: 38923 } } peers { permanent_uuid: "5b06b995f7a34d15a8217fe8833c81f2" member_type: VOTER last_known_addr { host: "127.27.243.252" port: 34861 } }
I20260811 08:11:13.775646 19038 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5b06b995f7a34d15a8217fe8833c81f2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5b06b995f7a34d15a8217fe8833c81f2. Latest consensus state: current_term: 1 leader_uuid: "5b06b995f7a34d15a8217fe8833c81f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5393b5229a7433f91fda4a172a65742" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 34909 } } peers { permanent_uuid: "7fccecccdcf3427b8237f3f83165a653" member_type: VOTER last_known_addr { host: "127.27.243.253" port: 38923 } } peers { permanent_uuid: "5b06b995f7a34d15a8217fe8833c81f2" member_type: VOTER last_known_addr { host: "127.27.243.252" port: 34861 } } }
I20260811 08:11:13.775787 19038 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5b06b995f7a34d15a8217fe8833c81f2 [sys.catalog]: This master's current role is: LEADER
I20260811 08:11:13.776041 19041 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:11:13.776227 19041 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:11:13.777814 18779 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 7fccecccdcf3427b8237f3f83165a653 [term 1 FOLLOWER]: Refusing update from remote peer 5b06b995f7a34d15a8217fe8833c81f2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:11:13.777844 18647 raft_consensus.cc:1261] T 00000000000000000000000000000000 P d5393b5229a7433f91fda4a172a65742 [term 1 FOLLOWER]: Refusing update from remote peer 5b06b995f7a34d15a8217fe8833c81f2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:11:13.778148 18958 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 5b06b995f7a34d15a8217fe8833c81f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5393b5229a7433f91fda4a172a65742" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 34909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:11:13.778322 19038 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 5b06b995f7a34d15a8217fe8833c81f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fccecccdcf3427b8237f3f83165a653" member_type: VOTER last_known_addr { host: "127.27.243.253" port: 38923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:11:13.779305 18995 sys_catalog.cc:455] T 00000000000000000000000000000000 P d5393b5229a7433f91fda4a172a65742 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5b06b995f7a34d15a8217fe8833c81f2. Latest consensus state: current_term: 1 leader_uuid: "5b06b995f7a34d15a8217fe8833c81f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5393b5229a7433f91fda4a172a65742" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 34909 } } peers { permanent_uuid: "7fccecccdcf3427b8237f3f83165a653" member_type: VOTER last_known_addr { host: "127.27.243.253" port: 38923 } } peers { permanent_uuid: "5b06b995f7a34d15a8217fe8833c81f2" member_type: VOTER last_known_addr { host: "127.27.243.252" port: 34861 } } }
I20260811 08:11:13.779392 18995 sys_catalog.cc:458] T 00000000000000000000000000000000 P d5393b5229a7433f91fda4a172a65742 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 08:11:13.779495 19020 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7fccecccdcf3427b8237f3f83165a653 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5b06b995f7a34d15a8217fe8833c81f2. Latest consensus state: current_term: 1 leader_uuid: "5b06b995f7a34d15a8217fe8833c81f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5393b5229a7433f91fda4a172a65742" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 34909 } } peers { permanent_uuid: "7fccecccdcf3427b8237f3f83165a653" member_type: VOTER last_known_addr { host: "127.27.243.253" port: 38923 } } peers { permanent_uuid: "5b06b995f7a34d15a8217fe8833c81f2" member_type: VOTER last_known_addr { host: "127.27.243.252" port: 34861 } } }
I20260811 08:11:13.779570 19020 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7fccecccdcf3427b8237f3f83165a653 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 08:11:13.780331 19038 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5b06b995f7a34d15a8217fe8833c81f2 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "5b06b995f7a34d15a8217fe8833c81f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5393b5229a7433f91fda4a172a65742" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 34909 } } peers { permanent_uuid: "7fccecccdcf3427b8237f3f83165a653" member_type: VOTER last_known_addr { host: "127.27.243.253" port: 38923 } } peers { permanent_uuid: "5b06b995f7a34d15a8217fe8833c81f2" member_type: VOTER last_known_addr { host: "127.27.243.252" port: 34861 } } }
I20260811 08:11:13.780411 19038 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5b06b995f7a34d15a8217fe8833c81f2 [sys.catalog]: This master's current role is: LEADER
I20260811 08:11:13.780838 18958 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5b06b995f7a34d15a8217fe8833c81f2 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "5b06b995f7a34d15a8217fe8833c81f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5393b5229a7433f91fda4a172a65742" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 34909 } } peers { permanent_uuid: "7fccecccdcf3427b8237f3f83165a653" member_type: VOTER last_known_addr { host: "127.27.243.253" port: 38923 } } peers { permanent_uuid: "5b06b995f7a34d15a8217fe8833c81f2" member_type: VOTER last_known_addr { host: "127.27.243.252" port: 34861 } } }
I20260811 08:11:13.780915 18958 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5b06b995f7a34d15a8217fe8833c81f2 [sys.catalog]: This master's current role is: LEADER
I20260811 08:11:13.781042 19020 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7fccecccdcf3427b8237f3f83165a653 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "5b06b995f7a34d15a8217fe8833c81f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5393b5229a7433f91fda4a172a65742" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 34909 } } peers { permanent_uuid: "7fccecccdcf3427b8237f3f83165a653" member_type: VOTER last_known_addr { host: "127.27.243.253" port: 38923 } } peers { permanent_uuid: "5b06b995f7a34d15a8217fe8833c81f2" member_type: VOTER last_known_addr { host: "127.27.243.252" port: 34861 } } }
I20260811 08:11:13.781114 19020 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7fccecccdcf3427b8237f3f83165a653 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 08:11:13.781214 19050 mvcc.cc:205] Tried to move back new op lower bound from 7317241338991869952 to 7317241338983960576. Current Snapshot: MvccSnapshot[applied={T|T < 7317241338991869952}]
I20260811 08:11:13.781385 18995 sys_catalog.cc:455] T 00000000000000000000000000000000 P d5393b5229a7433f91fda4a172a65742 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "5b06b995f7a34d15a8217fe8833c81f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5393b5229a7433f91fda4a172a65742" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 34909 } } peers { permanent_uuid: "7fccecccdcf3427b8237f3f83165a653" member_type: VOTER last_known_addr { host: "127.27.243.253" port: 38923 } } peers { permanent_uuid: "5b06b995f7a34d15a8217fe8833c81f2" member_type: VOTER last_known_addr { host: "127.27.243.252" port: 34861 } } }
I20260811 08:11:13.781462 18995 sys_catalog.cc:458] T 00000000000000000000000000000000 P d5393b5229a7433f91fda4a172a65742 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 08:11:13.781630 19045 mvcc.cc:205] Tried to move back new op lower bound from 7317241338991869952 to 7317241338983960576. Current Snapshot: MvccSnapshot[applied={T|T < 7317241338991869952}]
I20260811 08:11:13.782588 19041 catalog_manager.cc:1347] Generated new cluster ID: 297c65e5e6a64083ad05294dad23540b
I20260811 08:11:13.782634 19041 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:11:13.793395 19041 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:11:13.794015 19041 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:11:13.804507 19041 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5b06b995f7a34d15a8217fe8833c81f2: Generated new TSK 0
I20260811 08:11:13.804798 19041 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 08:11:14.639503 19013 catalog_manager.cc:1259] Loaded cluster ID: 297c65e5e6a64083ad05294dad23540b
I20260811 08:11:14.639585 19013 catalog_manager.cc:1552] T 00000000000000000000000000000000 P d5393b5229a7433f91fda4a172a65742: loading cluster ID for follower catalog manager: success
I20260811 08:11:14.640496 19013 catalog_manager.cc:1574] T 00000000000000000000000000000000 P d5393b5229a7433f91fda4a172a65742: acquiring CA information for follower catalog manager: success
I20260811 08:11:14.640816 19013 catalog_manager.cc:1602] T 00000000000000000000000000000000 P d5393b5229a7433f91fda4a172a65742: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 08:11:14.674916 19036 catalog_manager.cc:1259] Loaded cluster ID: 297c65e5e6a64083ad05294dad23540b
I20260811 08:11:14.674999 19036 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 7fccecccdcf3427b8237f3f83165a653: loading cluster ID for follower catalog manager: success
I20260811 08:11:14.675851 19036 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 7fccecccdcf3427b8237f3f83165a653: acquiring CA information for follower catalog manager: success
I20260811 08:11:14.676170 19036 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 7fccecccdcf3427b8237f3f83165a653: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 08:11:14.849789 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 18579
I20260811 08:11:14.862286 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 18708
W20260811 08:11:14.876839 18856 connection.cc:535] client connection to 127.27.243.253:38923 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260811 08:11:14.876993 18856 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260811 08:11:14.877136 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 18829
2026-08-11T08:11:14Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (3025 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786435717191469-28623-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:11:14 dist-test-slave-7lbf krb5kdc[19077](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:11:14 dist-test-slave-7lbf krb5kdc[19077](info): set up 2 sockets
Aug 11 08:11:14 dist-test-slave-7lbf krb5kdc[19077](info): commencing operation
krb5kdc: starting...
W20260811 08:11:16.072034 28623 mini_kdc.cc:121] Time spent starting KDC: real 1.172s user 0.003s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786435717191469-28623-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786435717191469-28623-0/krb5kdc/test-user.keytab.
Aug 11 08:11:16 dist-test-slave-7lbf krb5kdc[19077](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435876, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:11:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:11:16Z Disabled control of system clock
WARNING: no policy specified for kudu/127.27.243.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.243.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.243.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab.
Entry for principal kudu/127.27.243.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab.
I20260811 08:11:16.191403 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786435717191469-28623-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786435717191469-28623-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786435717191469-28623-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.243.254:44691
--webserver_interface=127.27.243.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab
--principal=kudu/127.27.243.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:44061
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.243.254:44691
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:11:16.274792 19096 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:11:16.275004 19096 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:11:16.275027 19096 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:11:16.276190 19096 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:11:16.276237 19096 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:11:16.276252 19096 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:11:16.276265 19096 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:11:16.276280 19096 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:11:16.277838 19096 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:44061
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786435717191469-28623-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786435717191469-28623-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.243.254:44691
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab
--principal=kudu/127.27.243.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.243.254:44691
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.243.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19096
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786435717191469-28623-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:11:16.278077 19096 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:11:16.278296 19096 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:11:16.283016 19111 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:11:16.283130 19096 server_base.cc:1034] running on GCE node
W20260811 08:11:16.283030 19108 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:11:16.283033 19107 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:11:16.283463 19096 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:11:16.283725 19096 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:11:16.284879 19096 hybrid_clock.cc:648] HybridClock initialized: now 1786435876284881 us; error 56 us; skew 500 ppm
Aug 11 08:11:16 dist-test-slave-7lbf krb5kdc[19077](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435876, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:11:16.287339 19096 init.cc:377] Logged in from keytab as kudu/127.27.243.254@KRBTEST.COM (short username kudu)
I20260811 08:11:16.287765 19096 webserver.cc:460] Webserver started at http://127.27.243.254:34919/ using document root <none> and password file <none>
I20260811 08:11:16.287961 19096 fs_manager.cc:359] Metadata directory not provided
I20260811 08:11:16.288000 19096 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:11:16.288089 19096 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:11:16.289054 19096 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786435717191469-28623-0/minicluster-data/master-0/data/instance:
uuid: "9e1c082f21c2481188b00c25c1e97326"
format_stamp: "Formatted at 2026-08-11 08:11:16 on dist-test-slave-7lbf"
server_key: "18c38dee19c47e4d632195c1c1afe940"
server_key_iv: "a72a639f1616e5ec2cf76ee91ac2add3"
server_key_version: "encryptionkey@0"
I20260811 08:11:16.289350 19096 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786435717191469-28623-0/minicluster-data/master-0/wal/instance:
uuid: "9e1c082f21c2481188b00c25c1e97326"
format_stamp: "Formatted at 2026-08-11 08:11:16 on dist-test-slave-7lbf"
server_key: "18c38dee19c47e4d632195c1c1afe940"
server_key_iv: "a72a639f1616e5ec2cf76ee91ac2add3"
server_key_version: "encryptionkey@0"
I20260811 08:11:16.290575 19096 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 08:11:16.291214 19124 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:11:16.291366 19096 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 08:11:16.291446 19096 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786435717191469-28623-0/minicluster-data/master-0/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786435717191469-28623-0/minicluster-data/master-0/wal
uuid: "9e1c082f21c2481188b00c25c1e97326"
format_stamp: "Formatted at 2026-08-11 08:11:16 on dist-test-slave-7lbf"
server_key: "18c38dee19c47e4d632195c1c1afe940"
server_key_iv: "a72a639f1616e5ec2cf76ee91ac2add3"
server_key_version: "encryptionkey@0"
I20260811 08:11:16.291507 19096 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786435717191469-28623-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786435717191469-28623-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786435717191469-28623-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:11:16.306067 19096 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:11:16.308123 19096 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:11:16.308262 19096 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:11:16.312362 19096 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.254:44691
I20260811 08:11:16.312417 19219 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.254:44691 every 8 connection(s)
I20260811 08:11:16.312731 19096 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
I20260811 08:11:16.313616 19220 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:11:16.315927 19220 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9e1c082f21c2481188b00c25c1e97326: Bootstrap starting.
I20260811 08:11:16.316553 19220 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9e1c082f21c2481188b00c25c1e97326: Neither blocks nor log segments found. Creating new log.
I20260811 08:11:16.316543 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 19096
I20260811 08:11:16.316641 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786435717191469-28623-0/minicluster-data/master-0/wal/instance
I20260811 08:11:16.316834 28623 external_mini_cluster.cc:1428] Setting key 32e9a7c433ee5467490bbfebeb85c36a
I20260811 08:11:16.316892 19220 log.cc:824] T 00000000000000000000000000000000 P 9e1c082f21c2481188b00c25c1e97326: Log is configured to *not* fsync() on all Append() calls
I20260811 08:11:16.317689 19220 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9e1c082f21c2481188b00c25c1e97326: No bootstrap required, opened a new log
I20260811 08:11:16.319892 19220 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9e1c082f21c2481188b00c25c1e97326 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e1c082f21c2481188b00c25c1e97326" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 44691 } }
I20260811 08:11:16.320067 19220 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9e1c082f21c2481188b00c25c1e97326 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:11:16.320102 19220 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9e1c082f21c2481188b00c25c1e97326 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e1c082f21c2481188b00c25c1e97326, State: Initialized, Role: FOLLOWER
I20260811 08:11:16.320226 19220 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9e1c082f21c2481188b00c25c1e97326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e1c082f21c2481188b00c25c1e97326" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 44691 } }
I20260811 08:11:16.320303 19220 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9e1c082f21c2481188b00c25c1e97326 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:11:16.320348 19220 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9e1c082f21c2481188b00c25c1e97326 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:11:16.320384 19220 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9e1c082f21c2481188b00c25c1e97326 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:11:16.321020 19220 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9e1c082f21c2481188b00c25c1e97326 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e1c082f21c2481188b00c25c1e97326" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 44691 } }
I20260811 08:11:16.321121 19220 leader_election.cc:302] T 00000000000000000000000000000000 P 9e1c082f21c2481188b00c25c1e97326 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9e1c082f21c2481188b00c25c1e97326; no voters:
I20260811 08:11:16.321282 19220 leader_election.cc:288] T 00000000000000000000000000000000 P 9e1c082f21c2481188b00c25c1e97326 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:11:16.321316 19228 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9e1c082f21c2481188b00c25c1e97326 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:11:16.321425 19228 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9e1c082f21c2481188b00c25c1e97326 [term 1 LEADER]: Becoming Leader. State: Replica: 9e1c082f21c2481188b00c25c1e97326, State: Running, Role: LEADER
I20260811 08:11:16.321575 19220 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9e1c082f21c2481188b00c25c1e97326 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:11:16.321602 19228 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9e1c082f21c2481188b00c25c1e97326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e1c082f21c2481188b00c25c1e97326" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 44691 } }
I20260811 08:11:16.322286 19230 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9e1c082f21c2481188b00c25c1e97326 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9e1c082f21c2481188b00c25c1e97326" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e1c082f21c2481188b00c25c1e97326" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 44691 } } }
I20260811 08:11:16.322372 19230 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9e1c082f21c2481188b00c25c1e97326 [sys.catalog]: This master's current role is: LEADER
I20260811 08:11:16.322485 19230 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9e1c082f21c2481188b00c25c1e97326 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9e1c082f21c2481188b00c25c1e97326. Latest consensus state: current_term: 1 leader_uuid: "9e1c082f21c2481188b00c25c1e97326" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e1c082f21c2481188b00c25c1e97326" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 44691 } } }
I20260811 08:11:16.322525 19230 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9e1c082f21c2481188b00c25c1e97326 [sys.catalog]: This master's current role is: LEADER
I20260811 08:11:16.322899 19252 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:11:16.323423 19252 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 11 08:11:16 dist-test-slave-7lbf krb5kdc[19077](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435876, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.243.254@KRBTEST.COM
I20260811 08:11:16.324982 19252 catalog_manager.cc:1347] Generated new cluster ID: 3f6926f147e04511867e2634b47420c7
I20260811 08:11:16.325037 19252 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:11:16.327314 19224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:16.317298 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54262 (local address 127.27.243.254:44691)
0811 08:11:16.317453 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0811 08:11:16.317463 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 08:11:16.317492 (+ 29us) server_negotiation.cc:407] Connection header received
0811 08:11:16.317985 (+ 493us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:11:16.317993 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:11:16.318043 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:11:16.318160 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:11:16.318917 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:16.319780 (+ 863us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:16.320818 (+ 1038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:16.321299 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:16.321781 (+ 482us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:16.324085 (+ 2304us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:11:16.324089 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:11:16.324090 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:11:16.324102 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:11:16.325908 (+ 1806us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:11:16.326235 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:11:16.326238 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:11:16.326238 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:11:16.326324 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:11:16.326500 (+ 176us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:11:16.326500 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:11:16.326501 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:11:16.326737 (+ 236us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:11:16.326902 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0811 08:11:16.327000 (+ 98us) server_negotiation.cc:299] Negotiation successful
0811 08:11:16.327135 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":107,"thread_start_us":70,"threads_started":1}
I20260811 08:11:16.328190 28623 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 08:11:16.348032 19252 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:11:16.348793 19252 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:11:16.353343 19252 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9e1c082f21c2481188b00c25c1e97326: Generated new TSK 0
I20260811 08:11:16.353561 19252 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 08:11:16.381889 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 19096
2026-08-11T08:11:16Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (1512 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:11:16 dist-test-slave-7lbf krb5kdc[19274](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:11:16 dist-test-slave-7lbf krb5kdc[19274](info): set up 2 sockets
Aug 11 08:11:16 dist-test-slave-7lbf krb5kdc[19274](info): commencing operation
krb5kdc: starting...
W20260811 08:11:17.552140 28623 mini_kdc.cc:121] Time spent starting KDC: real 1.140s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/krb5kdc/test-user.keytab.
Aug 11 08:11:17 dist-test-slave-7lbf krb5kdc[19274](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435877, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:11:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:11:17Z Disabled control of system clock
WARNING: no policy specified for kudu/127.27.243.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.243.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.243.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab.
Entry for principal kudu/127.27.243.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab.
I20260811 08:11:17.674221 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.243.254:36983
--webserver_interface=127.27.243.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab
--principal=kudu/127.27.243.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:42189
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.243.254:36983
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:11:17.759344 19300 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:11:17.759577 19300 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:11:17.759611 19300 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:11:17.760757 19300 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:11:17.760810 19300 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:11:17.760833 19300 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:11:17.760852 19300 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:11:17.760872 19300 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:11:17.762444 19300 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:42189
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.243.254:36983
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab
--principal=kudu/127.27.243.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.243.254:36983
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.243.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19300
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:11:17.762707 19300 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:11:17.762946 19300 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:11:17.767733 19310 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:11:17.767733 19309 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:11:17.768153 19300 server_base.cc:1034] running on GCE node
W20260811 08:11:17.768205 19312 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:11:17.768489 19300 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:11:17.768766 19300 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:11:17.769923 19300 hybrid_clock.cc:648] HybridClock initialized: now 1786435877769901 us; error 41 us; skew 500 ppm
Aug 11 08:11:17 dist-test-slave-7lbf krb5kdc[19274](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435877, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:11:17.772424 19300 init.cc:377] Logged in from keytab as kudu/127.27.243.254@KRBTEST.COM (short username kudu)
I20260811 08:11:17.772874 19300 webserver.cc:460] Webserver started at http://127.27.243.254:34105/ using document root <none> and password file <none>
I20260811 08:11:17.773092 19300 fs_manager.cc:359] Metadata directory not provided
I20260811 08:11:17.773140 19300 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:11:17.773267 19300 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:11:17.774399 19300 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/master-0/data/instance:
uuid: "bd73426cb34b437a86d301635b77f500"
format_stamp: "Formatted at 2026-08-11 08:11:17 on dist-test-slave-7lbf"
server_key: "a7731215e900a0fd7eb920c5751fb10c"
server_key_iv: "38f49e16ab948135b39bcf47749bfb31"
server_key_version: "encryptionkey@0"
I20260811 08:11:17.774736 19300 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/master-0/wal/instance:
uuid: "bd73426cb34b437a86d301635b77f500"
format_stamp: "Formatted at 2026-08-11 08:11:17 on dist-test-slave-7lbf"
server_key: "a7731215e900a0fd7eb920c5751fb10c"
server_key_iv: "38f49e16ab948135b39bcf47749bfb31"
server_key_version: "encryptionkey@0"
I20260811 08:11:17.776018 19300 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 08:11:17.776703 19323 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:11:17.776875 19300 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 08:11:17.776964 19300 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/master-0/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/master-0/wal
uuid: "bd73426cb34b437a86d301635b77f500"
format_stamp: "Formatted at 2026-08-11 08:11:17 on dist-test-slave-7lbf"
server_key: "a7731215e900a0fd7eb920c5751fb10c"
server_key_iv: "38f49e16ab948135b39bcf47749bfb31"
server_key_version: "encryptionkey@0"
I20260811 08:11:17.777024 19300 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:11:17.787545 19300 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:11:17.789227 19300 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:11:17.789364 19300 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:11:17.793388 19300 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.254:36983
I20260811 08:11:17.793424 19418 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.254:36983 every 8 connection(s)
I20260811 08:11:17.793787 19300 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
I20260811 08:11:17.794781 19420 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:11:17.797022 19420 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bd73426cb34b437a86d301635b77f500: Bootstrap starting.
I20260811 08:11:17.797585 19420 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bd73426cb34b437a86d301635b77f500: Neither blocks nor log segments found. Creating new log.
I20260811 08:11:17.797814 19420 log.cc:824] T 00000000000000000000000000000000 P bd73426cb34b437a86d301635b77f500: Log is configured to *not* fsync() on all Append() calls
I20260811 08:11:17.798434 19420 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bd73426cb34b437a86d301635b77f500: No bootstrap required, opened a new log
I20260811 08:11:17.799655 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 19300
I20260811 08:11:17.799768 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/master-0/wal/instance
I20260811 08:11:17.799975 28623 external_mini_cluster.cc:1428] Setting key 8d59383fc32a8ad754930aef5f359b26
I20260811 08:11:17.800030 19420 raft_consensus.cc:348] T 00000000000000000000000000000000 P bd73426cb34b437a86d301635b77f500 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd73426cb34b437a86d301635b77f500" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 36983 } }
I20260811 08:11:17.800200 19420 raft_consensus.cc:374] T 00000000000000000000000000000000 P bd73426cb34b437a86d301635b77f500 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:11:17.800243 19420 raft_consensus.cc:729] T 00000000000000000000000000000000 P bd73426cb34b437a86d301635b77f500 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd73426cb34b437a86d301635b77f500, State: Initialized, Role: FOLLOWER
I20260811 08:11:17.800398 19420 consensus_queue.cc:260] T 00000000000000000000000000000000 P bd73426cb34b437a86d301635b77f500 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd73426cb34b437a86d301635b77f500" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 36983 } }
I20260811 08:11:17.800490 19420 raft_consensus.cc:388] T 00000000000000000000000000000000 P bd73426cb34b437a86d301635b77f500 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:11:17.800521 19420 raft_consensus.cc:482] T 00000000000000000000000000000000 P bd73426cb34b437a86d301635b77f500 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:11:17.800618 19420 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bd73426cb34b437a86d301635b77f500 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:11:17.801138 19420 raft_consensus.cc:504] T 00000000000000000000000000000000 P bd73426cb34b437a86d301635b77f500 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd73426cb34b437a86d301635b77f500" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 36983 } }
I20260811 08:11:17.801225 19420 leader_election.cc:302] T 00000000000000000000000000000000 P bd73426cb34b437a86d301635b77f500 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bd73426cb34b437a86d301635b77f500; no voters:
I20260811 08:11:17.801380 19420 leader_election.cc:288] T 00000000000000000000000000000000 P bd73426cb34b437a86d301635b77f500 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:11:17.801417 19430 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bd73426cb34b437a86d301635b77f500 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:11:17.801609 19430 raft_consensus.cc:686] T 00000000000000000000000000000000 P bd73426cb34b437a86d301635b77f500 [term 1 LEADER]: Becoming Leader. State: Replica: bd73426cb34b437a86d301635b77f500, State: Running, Role: LEADER
I20260811 08:11:17.801723 19420 sys_catalog.cc:564] T 00000000000000000000000000000000 P bd73426cb34b437a86d301635b77f500 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:11:17.801740 19430 consensus_queue.cc:237] T 00000000000000000000000000000000 P bd73426cb34b437a86d301635b77f500 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd73426cb34b437a86d301635b77f500" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 36983 } }
I20260811 08:11:17.802138 19432 sys_catalog.cc:455] T 00000000000000000000000000000000 P bd73426cb34b437a86d301635b77f500 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bd73426cb34b437a86d301635b77f500. Latest consensus state: current_term: 1 leader_uuid: "bd73426cb34b437a86d301635b77f500" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd73426cb34b437a86d301635b77f500" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 36983 } } }
I20260811 08:11:17.802170 19431 sys_catalog.cc:455] T 00000000000000000000000000000000 P bd73426cb34b437a86d301635b77f500 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bd73426cb34b437a86d301635b77f500" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd73426cb34b437a86d301635b77f500" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 36983 } } }
I20260811 08:11:17.802225 19432 sys_catalog.cc:458] T 00000000000000000000000000000000 P bd73426cb34b437a86d301635b77f500 [sys.catalog]: This master's current role is: LEADER
I20260811 08:11:17.802249 19431 sys_catalog.cc:458] T 00000000000000000000000000000000 P bd73426cb34b437a86d301635b77f500 [sys.catalog]: This master's current role is: LEADER
I20260811 08:11:17.802553 19438 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:11:17.803143 19438 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:11:17.804708 19438 catalog_manager.cc:1347] Generated new cluster ID: 247c66e5453342528ccf00e3d0280724
I20260811 08:11:17.804773 19438 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 08:11:17 dist-test-slave-7lbf krb5kdc[19274](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435877, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.243.254@KRBTEST.COM
I20260811 08:11:17.810312 19427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:17.800622 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60954 (local address 127.27.243.254:36983)
0811 08:11:17.800794 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0811 08:11:17.800803 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 08:11:17.800828 (+ 25us) server_negotiation.cc:407] Connection header received
0811 08:11:17.801146 (+ 318us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:11:17.801152 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:11:17.801199 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:11:17.801397 (+ 198us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:11:17.802131 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:17.803525 (+ 1394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:17.804499 (+ 974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:17.805030 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:17.805128 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:17.807282 (+ 2154us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:11:17.807286 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:11:17.807287 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:11:17.807299 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:11:17.808821 (+ 1522us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:11:17.809168 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:11:17.809171 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:11:17.809171 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:11:17.809280 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:11:17.809466 (+ 186us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:11:17.809467 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:11:17.809467 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:11:17.809737 (+ 270us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:11:17.809921 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0811 08:11:17.809989 (+ 68us) server_negotiation.cc:299] Negotiation successful
0811 08:11:17.810126 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":112,"thread_start_us":76,"threads_started":1}
I20260811 08:11:17.817955 19438 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:11:17.818676 19438 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:11:17.826211 19438 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bd73426cb34b437a86d301635b77f500: Generated new TSK 0
I20260811 08:11:17.826409 19438 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.27.243.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.243.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.243.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.193.keytab.
Entry for principal kudu/127.27.243.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.193.keytab.
I20260811 08:11:17.862574 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.243.193:0
--local_ip_for_outbound_sockets=127.27.243.193
--webserver_interface=127.27.243.193
--webserver_port=0
--tserver_master_addrs=127.27.243.254:36983
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.193.keytab
--principal=kudu/127.27.243.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:42189
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:11:17.959522 19464 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:11:17.959712 19464 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:11:17.959733 19464 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:11:17.960871 19464 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:11:17.960913 19464 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:11:17.960937 19464 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.243.193
I20260811 08:11:17.962379 19464 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:42189
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.193.keytab
--principal=kudu/127.27.243.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.243.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.243.193
--webserver_port=0
--tserver_master_addrs=127.27.243.254:36983
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19464
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.243.193
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:11:17.962591 19464 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:11:17.962797 19464 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:11:17.967463 19474 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:11:17.967471 19475 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:11:17.967576 19464 server_base.cc:1034] running on GCE node
W20260811 08:11:17.967517 19478 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:11:17.967896 19464 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:11:17.968122 19464 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:11:17.969288 19464 hybrid_clock.cc:648] HybridClock initialized: now 1786435877969267 us; error 33 us; skew 500 ppm
Aug 11 08:11:17 dist-test-slave-7lbf krb5kdc[19274](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435877, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:11:17.971812 19464 init.cc:377] Logged in from keytab as kudu/127.27.243.193@KRBTEST.COM (short username kudu)
I20260811 08:11:17.972183 19464 webserver.cc:460] Webserver started at http://127.27.243.193:38457/ using document root <none> and password file <none>
I20260811 08:11:17.972359 19464 fs_manager.cc:359] Metadata directory not provided
I20260811 08:11:17.972397 19464 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:11:17.972483 19464 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:11:17.973439 19464 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-0/data/instance:
uuid: "df7cef473a184c09b626be720c32fbd3"
format_stamp: "Formatted at 2026-08-11 08:11:17 on dist-test-slave-7lbf"
server_key: "009aabc7e264d21f6a56743046dd70d1"
server_key_iv: "8be0cd46d25a4424c53d90dd1f906451"
server_key_version: "encryptionkey@0"
I20260811 08:11:17.973773 19464 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-0/wal/instance:
uuid: "df7cef473a184c09b626be720c32fbd3"
format_stamp: "Formatted at 2026-08-11 08:11:17 on dist-test-slave-7lbf"
server_key: "009aabc7e264d21f6a56743046dd70d1"
server_key_iv: "8be0cd46d25a4424c53d90dd1f906451"
server_key_version: "encryptionkey@0"
I20260811 08:11:17.974992 19464 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:11:17.975639 19485 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:11:17.975836 19464 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 08:11:17.975927 19464 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-0/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-0/wal
uuid: "df7cef473a184c09b626be720c32fbd3"
format_stamp: "Formatted at 2026-08-11 08:11:17 on dist-test-slave-7lbf"
server_key: "009aabc7e264d21f6a56743046dd70d1"
server_key_iv: "8be0cd46d25a4424c53d90dd1f906451"
server_key_version: "encryptionkey@0"
I20260811 08:11:17.975996 19464 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:11:17.989063 19464 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:11:17.991076 19464 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:11:17.991202 19464 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:11:17.991415 19464 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:11:17.991703 19464 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:11:17.991735 19464 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:11:17.991756 19464 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:11:17.991780 19464 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:11:17.997324 19464 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.193:46141
I20260811 08:11:17.997385 19685 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.193:46141 every 8 connection(s)
I20260811 08:11:17.997699 19464 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-0/data/info.pb
I20260811 08:11:17.998054 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 19464
I20260811 08:11:17.998173 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-0/wal/instance
I20260811 08:11:17.998379 28623 external_mini_cluster.cc:1428] Setting key 2ab081edc84ef835407c5e1a6cf75afb
Aug 11 08:11:17 dist-test-slave-7lbf krb5kdc[19274](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435877, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.193@KRBTEST.COM for kudu/127.27.243.254@KRBTEST.COM
I20260811 08:11:18.007997 19427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:17.998381 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.193:38491 (local address 127.27.243.254:36983)
0811 08:11:17.998427 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 08:11:17.998429 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:11:17.998711 (+ 282us) server_negotiation.cc:407] Connection header received
0811 08:11:17.999323 (+ 612us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:11:17.999324 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:11:17.999340 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:11:17.999417 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:11:18.000290 (+ 873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:18.000964 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:18.002320 (+ 1356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:18.002643 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:18.002714 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:18.005104 (+ 2390us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:11:18.005106 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:11:18.005106 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:11:18.005113 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:11:18.006581 (+ 1468us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:11:18.007055 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:11:18.007056 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:11:18.007057 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:11:18.007115 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:11:18.007378 (+ 263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:11:18.007379 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:11:18.007379 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:11:18.007481 (+ 102us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:11:18.007533 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 08:11:18.007853 (+ 320us) server_negotiation.cc:299] Negotiation successful
0811 08:11:18.007929 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
WARNING: no policy specified for kudu/127.27.243.194@KRBTEST.COM; defaulting to no policy
I20260811 08:11:18.008224 19693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:17.998378 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36983 (local address 127.27.243.193:38491)
0811 08:11:17.998554 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:17.998638 (+ 84us) client_negotiation.cc:174] Beginning negotiation
0811 08:11:17.999223 (+ 585us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:11:17.999468 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:11:17.999472 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:11:18.000020 (+ 548us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:11:18.000200 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:11:18.000204 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:11:18.001055 (+ 851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:11:18.001056 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:11:18.002236 (+ 1180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:11:18.002240 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:11:18.002721 (+ 481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:11:18.002722 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:11:18.002855 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:18.003320 (+ 465us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:11:18.003330 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:11:18.005002 (+ 1672us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:11:18.006671 (+ 1669us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:11:18.006679 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:11:18.006682 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:11:18.006980 (+ 298us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:11:18.007182 (+ 202us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:11:18.007182 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:11:18.007183 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:11:18.007319 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:11:18.007544 (+ 225us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:11:18.007551 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:11:18.007714 (+ 163us) client_negotiation.cc:769] Sending connection context
0811 08:11:18.007829 (+ 115us) client_negotiation.cc:240] Negotiation successful
0811 08:11:18.007999 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":98,"threads_started":1}
I20260811 08:11:18.008728 19688 heartbeater.cc:347] Connected to a master server at 127.27.243.254:36983
I20260811 08:11:18.008867 19688 heartbeater.cc:464] Registering TS with master...
I20260811 08:11:18.009057 19688 heartbeater.cc:511] Master 127.27.243.254:36983 requested a full tablet report, sending...
I20260811 08:11:18.009653 19350 ts_manager.cc:194] Registered new tserver with Master: df7cef473a184c09b626be720c32fbd3 (127.27.243.193:46141)
I20260811 08:11:18.010262 19350 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.243.193@KRBTEST.COM'} at 127.27.243.193:38491
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.243.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.243.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.194.keytab.
Entry for principal kudu/127.27.243.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.194.keytab.
I20260811 08:11:18.023928 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.243.194:0
--local_ip_for_outbound_sockets=127.27.243.194
--webserver_interface=127.27.243.194
--webserver_port=0
--tserver_master_addrs=127.27.243.254:36983
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.194.keytab
--principal=kudu/127.27.243.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:42189
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:11:18.105187 19698 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:11:18.105407 19698 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:11:18.105439 19698 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:11:18.106578 19698 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:11:18.106621 19698 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:11:18.106655 19698 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.243.194
I20260811 08:11:18.108080 19698 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:42189
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.194.keytab
--principal=kudu/127.27.243.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.243.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.243.194
--webserver_port=0
--tserver_master_addrs=127.27.243.254:36983
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19698
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.243.194
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:11:18.108315 19698 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:11:18.108531 19698 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:11:18.113850 19704 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:11:18.113901 19708 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:11:18.114009 19698 server_base.cc:1034] running on GCE node
W20260811 08:11:18.113910 19706 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:11:18.114342 19698 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:11:18.114596 19698 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:11:18.115756 19698 hybrid_clock.cc:648] HybridClock initialized: now 1786435878115741 us; error 30 us; skew 500 ppm
Aug 11 08:11:18 dist-test-slave-7lbf krb5kdc[19274](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435878, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:11:18.118394 19698 init.cc:377] Logged in from keytab as kudu/127.27.243.194@KRBTEST.COM (short username kudu)
I20260811 08:11:18.118825 19698 webserver.cc:460] Webserver started at http://127.27.243.194:36931/ using document root <none> and password file <none>
I20260811 08:11:18.119026 19698 fs_manager.cc:359] Metadata directory not provided
I20260811 08:11:18.119071 19698 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:11:18.119181 19698 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:11:18.120234 19698 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-1/data/instance:
uuid: "d49051f047a54cd9b735792f5afa5f89"
format_stamp: "Formatted at 2026-08-11 08:11:18 on dist-test-slave-7lbf"
server_key: "d58cbd06d96b4f4ce0e65b6494e7f726"
server_key_iv: "bd421cfde3debe9a3b0ae3cc28e33e31"
server_key_version: "encryptionkey@0"
I20260811 08:11:18.120563 19698 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-1/wal/instance:
uuid: "d49051f047a54cd9b735792f5afa5f89"
format_stamp: "Formatted at 2026-08-11 08:11:18 on dist-test-slave-7lbf"
server_key: "d58cbd06d96b4f4ce0e65b6494e7f726"
server_key_iv: "bd421cfde3debe9a3b0ae3cc28e33e31"
server_key_version: "encryptionkey@0"
I20260811 08:11:18.121878 19698 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 08:11:18.122642 19721 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:11:18.122828 19698 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 08:11:18.122915 19698 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-1/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-1/wal
uuid: "d49051f047a54cd9b735792f5afa5f89"
format_stamp: "Formatted at 2026-08-11 08:11:18 on dist-test-slave-7lbf"
server_key: "d58cbd06d96b4f4ce0e65b6494e7f726"
server_key_iv: "bd421cfde3debe9a3b0ae3cc28e33e31"
server_key_version: "encryptionkey@0"
I20260811 08:11:18.122982 19698 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:11:18.151947 19698 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:11:18.153887 19698 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:11:18.154016 19698 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:11:18.154258 19698 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:11:18.154577 19698 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:11:18.154613 19698 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:11:18.154644 19698 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:11:18.154660 19698 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:11:18.160211 19698 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.194:44397
I20260811 08:11:18.160270 19915 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.194:44397 every 8 connection(s)
I20260811 08:11:18.160563 19698 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-1/data/info.pb
Aug 11 08:11:18 dist-test-slave-7lbf krb5kdc[19274](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435878, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.194@KRBTEST.COM for kudu/127.27.243.254@KRBTEST.COM
I20260811 08:11:18.168977 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 19698
I20260811 08:11:18.169086 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-1/wal/instance
I20260811 08:11:18.169260 28623 external_mini_cluster.cc:1428] Setting key ffa6972cf3416566cacc714ebecddd0c
I20260811 08:11:18.169389 19427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:18.161252 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.194:54675 (local address 127.27.243.254:36983)
0811 08:11:18.161328 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0811 08:11:18.161331 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:11:18.161502 (+ 171us) server_negotiation.cc:407] Connection header received
0811 08:11:18.162026 (+ 524us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:11:18.162027 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:11:18.162038 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:11:18.162086 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:11:18.162961 (+ 875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:18.163465 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:18.164389 (+ 924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:18.164592 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:18.164643 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:18.166597 (+ 1954us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:11:18.166598 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:11:18.166599 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:11:18.166605 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:11:18.167845 (+ 1240us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:11:18.168220 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:11:18.168222 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:11:18.168222 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:11:18.168286 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:11:18.168693 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:11:18.168694 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:11:18.168694 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:11:18.168858 (+ 164us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:11:18.168941 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0811 08:11:18.169205 (+ 264us) server_negotiation.cc:299] Negotiation successful
0811 08:11:18.169298 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 08:11:18.169889 19921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:18.161221 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36983 (local address 127.27.243.194:54675)
0811 08:11:18.161385 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:18.161422 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 08:11:18.161942 (+ 520us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:11:18.162143 (+ 201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:11:18.162147 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:11:18.162699 (+ 552us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:11:18.162897 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:11:18.162901 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:11:18.163524 (+ 623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:11:18.163524 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:11:18.164297 (+ 773us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:11:18.164299 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:11:18.164658 (+ 359us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:11:18.164658 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:11:18.164765 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:18.165167 (+ 402us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:11:18.165175 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:11:18.166513 (+ 1338us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:11:18.167922 (+ 1409us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:11:18.167929 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:11:18.167931 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:11:18.168135 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:11:18.168463 (+ 328us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:11:18.168464 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:11:18.168465 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:11:18.168586 (+ 121us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:11:18.168927 (+ 341us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:11:18.168930 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:11:18.169042 (+ 112us) client_negotiation.cc:769] Sending connection context
0811 08:11:18.169482 (+ 440us) client_negotiation.cc:240] Negotiation successful
0811 08:11:18.169688 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":86,"threads_started":1}
I20260811 08:11:18.170423 19917 heartbeater.cc:347] Connected to a master server at 127.27.243.254:36983
I20260811 08:11:18.170509 19917 heartbeater.cc:464] Registering TS with master...
I20260811 08:11:18.170687 19917 heartbeater.cc:511] Master 127.27.243.254:36983 requested a full tablet report, sending...
I20260811 08:11:18.171027 19350 ts_manager.cc:194] Registered new tserver with Master: d49051f047a54cd9b735792f5afa5f89 (127.27.243.194:44397)
I20260811 08:11:18.171355 19350 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.243.194@KRBTEST.COM'} at 127.27.243.194:54675
WARNING: no policy specified for kudu/127.27.243.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.243.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.243.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.195.keytab.
Entry for principal kudu/127.27.243.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.195.keytab.
I20260811 08:11:18.196063 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.243.195:0
--local_ip_for_outbound_sockets=127.27.243.195
--webserver_interface=127.27.243.195
--webserver_port=0
--tserver_master_addrs=127.27.243.254:36983
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.195.keytab
--principal=kudu/127.27.243.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:42189
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:11:18.278460 19924 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:11:18.278669 19924 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:11:18.278702 19924 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:11:18.279888 19924 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:11:18.279935 19924 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:11:18.279969 19924 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.243.195
I20260811 08:11:18.281411 19924 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:42189
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.195.keytab
--principal=kudu/127.27.243.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.243.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.243.195
--webserver_port=0
--tserver_master_addrs=127.27.243.254:36983
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19924
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.243.195
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:11:18.281658 19924 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:11:18.281884 19924 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:11:18.286633 19932 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:11:18.286645 19934 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:11:18.286643 19937 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:11:18.286937 19924 server_base.cc:1034] running on GCE node
I20260811 08:11:18.287097 19924 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:11:18.287300 19924 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:11:18.288435 19924 hybrid_clock.cc:648] HybridClock initialized: now 1786435878288424 us; error 24 us; skew 500 ppm
Aug 11 08:11:18 dist-test-slave-7lbf krb5kdc[19274](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435878, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:11:18.290921 19924 init.cc:377] Logged in from keytab as kudu/127.27.243.195@KRBTEST.COM (short username kudu)
I20260811 08:11:18.291380 19924 webserver.cc:460] Webserver started at http://127.27.243.195:39019/ using document root <none> and password file <none>
I20260811 08:11:18.291581 19924 fs_manager.cc:359] Metadata directory not provided
I20260811 08:11:18.291625 19924 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:11:18.291746 19924 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:11:18.292765 19924 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-2/data/instance:
uuid: "614d9a0fbdbd41a6ba0c6f13d34ee134"
format_stamp: "Formatted at 2026-08-11 08:11:18 on dist-test-slave-7lbf"
server_key: "fadded36b81c57c4cae32c21164d8ed8"
server_key_iv: "def5b0a493b6d893ab36423df8f0f2b1"
server_key_version: "encryptionkey@0"
I20260811 08:11:18.293092 19924 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-2/wal/instance:
uuid: "614d9a0fbdbd41a6ba0c6f13d34ee134"
format_stamp: "Formatted at 2026-08-11 08:11:18 on dist-test-slave-7lbf"
server_key: "fadded36b81c57c4cae32c21164d8ed8"
server_key_iv: "def5b0a493b6d893ab36423df8f0f2b1"
server_key_version: "encryptionkey@0"
I20260811 08:11:18.294413 19924 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 08:11:18.295122 19952 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:11:18.295248 19924 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 08:11:18.295328 19924 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-2/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-2/wal
uuid: "614d9a0fbdbd41a6ba0c6f13d34ee134"
format_stamp: "Formatted at 2026-08-11 08:11:18 on dist-test-slave-7lbf"
server_key: "fadded36b81c57c4cae32c21164d8ed8"
server_key_iv: "def5b0a493b6d893ab36423df8f0f2b1"
server_key_version: "encryptionkey@0"
I20260811 08:11:18.295413 19924 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:11:18.314632 19924 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:11:18.316699 19924 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:11:18.316820 19924 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:11:18.317040 19924 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:11:18.317353 19924 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:11:18.317387 19924 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:11:18.317409 19924 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:11:18.317432 19924 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:11:18.323427 19924 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.195:42441
I20260811 08:11:18.323480 20149 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.195:42441 every 8 connection(s)
I20260811 08:11:18.323799 19924 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-2/data/info.pb
Aug 11 08:11:18 dist-test-slave-7lbf krb5kdc[19274](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435878, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.195@KRBTEST.COM for kudu/127.27.243.254@KRBTEST.COM
I20260811 08:11:18.331871 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 19924
I20260811 08:11:18.331964 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-2/wal/instance
I20260811 08:11:18.332146 28623 external_mini_cluster.cc:1428] Setting key d0f7c71c92367deee0c9060b3c67a4f2
I20260811 08:11:18.333678 19427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:18.324517 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.195:45205 (local address 127.27.243.254:36983)
0811 08:11:18.324574 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0811 08:11:18.324576 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:11:18.324777 (+ 201us) server_negotiation.cc:407] Connection header received
0811 08:11:18.325330 (+ 553us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:11:18.325332 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:11:18.325345 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:11:18.325411 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:11:18.326615 (+ 1204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:18.327211 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:18.328223 (+ 1012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:18.328427 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:18.328489 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:18.330673 (+ 2184us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:11:18.330675 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:11:18.330675 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:11:18.330682 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:11:18.332079 (+ 1397us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:11:18.332509 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:11:18.332510 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:11:18.332511 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:11:18.332579 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:11:18.332957 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:11:18.332959 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:11:18.332959 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:11:18.333114 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:11:18.333184 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 08:11:18.333498 (+ 314us) server_negotiation.cc:299] Negotiation successful
0811 08:11:18.333612 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 08:11:18.333837 20154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:18.324488 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36983 (local address 127.27.243.195:45205)
0811 08:11:18.324653 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:18.324691 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 08:11:18.325208 (+ 517us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:11:18.325510 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:11:18.325564 (+ 54us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:11:18.326255 (+ 691us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:11:18.326503 (+ 248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:11:18.326509 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:11:18.327303 (+ 794us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:11:18.327304 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:11:18.328122 (+ 818us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:11:18.328125 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:11:18.328524 (+ 399us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:11:18.328526 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:11:18.328651 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:18.329142 (+ 491us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:11:18.329151 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:11:18.330566 (+ 1415us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:11:18.332156 (+ 1590us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:11:18.332166 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:11:18.332169 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:11:18.332438 (+ 269us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:11:18.332707 (+ 269us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:11:18.332709 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:11:18.332709 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:11:18.332859 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:11:18.333184 (+ 325us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:11:18.333190 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:11:18.333365 (+ 175us) client_negotiation.cc:769] Sending connection context
0811 08:11:18.333454 (+ 89us) client_negotiation.cc:240] Negotiation successful
0811 08:11:18.333638 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":90,"threads_started":1}
I20260811 08:11:18.334246 20150 heartbeater.cc:347] Connected to a master server at 127.27.243.254:36983
I20260811 08:11:18.334342 20150 heartbeater.cc:464] Registering TS with master...
I20260811 08:11:18.334502 20150 heartbeater.cc:511] Master 127.27.243.254:36983 requested a full tablet report, sending...
I20260811 08:11:18.334832 19350 ts_manager.cc:194] Registered new tserver with Master: 614d9a0fbdbd41a6ba0c6f13d34ee134 (127.27.243.195:42441)
I20260811 08:11:18.335175 19350 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.243.195@KRBTEST.COM'} at 127.27.243.195:45205
I20260811 08:11:18.344208 28623 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 08:11:18.351289 19427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:18.345595 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60970 (local address 127.27.243.254:36983)
0811 08:11:18.345651 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0811 08:11:18.345653 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:11:18.345726 (+ 73us) server_negotiation.cc:407] Connection header received
0811 08:11:18.345801 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:11:18.345802 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:11:18.345813 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:11:18.345869 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:11:18.346435 (+ 566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:18.346920 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:18.347633 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:18.347844 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:18.347900 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:18.349038 (+ 1138us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:11:18.349039 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:11:18.349040 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:11:18.349047 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:11:18.350230 (+ 1183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:11:18.350548 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:11:18.350549 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:11:18.350549 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:11:18.350604 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:11:18.350768 (+ 164us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:11:18.350769 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:11:18.350769 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:11:18.350921 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:11:18.351016 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0811 08:11:18.351121 (+ 105us) server_negotiation.cc:299] Negotiation successful
0811 08:11:18.351201 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260811 08:11:18.352694 19350 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60970:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 08:11:18.354298 19350 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 08:11:18.360926 20165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:18.356494 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.194:44397 (local address 127.0.0.1:51594)
0811 08:11:18.356791 (+ 297us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:18.356832 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 08:11:18.356910 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:11:18.357253 (+ 343us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:11:18.357256 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:11:18.357259 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:11:18.357333 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:11:18.357335 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:11:18.358792 (+ 1457us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:11:18.358793 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:11:18.359866 (+ 1073us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:11:18.359869 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:11:18.360680 (+ 811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:11:18.360680 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:11:18.360740 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:18.360751 (+ 11us) client_negotiation.cc:769] Sending connection context
0811 08:11:18.360807 (+ 56us) client_negotiation.cc:240] Negotiation successful
0811 08:11:18.360846 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":270,"mutex_wait_us":53,"thread_start_us":47,"threads_started":1}
I20260811 08:11:18.360944 20167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:18.356594 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51594 (local address 127.27.243.194:44397)
0811 08:11:18.356775 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0811 08:11:18.356780 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 08:11:18.356900 (+ 120us) server_negotiation.cc:407] Connection header received
0811 08:11:18.357046 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:11:18.357049 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:11:18.357066 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:11:18.357115 (+ 49us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:11:18.357494 (+ 379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:18.358675 (+ 1181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:18.359941 (+ 1266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:18.360594 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:18.360676 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:18.360732 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 08:11:18.360822 (+ 90us) server_negotiation.cc:299] Negotiation successful
0811 08:11:18.360860 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":144,"thread_start_us":100,"threads_started":1}
I20260811 08:11:18.361140 20169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:18.356652 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.193:46141 (local address 127.0.0.1:37548)
0811 08:11:18.356949 (+ 297us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:18.356957 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 08:11:18.356998 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:11:18.357274 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:11:18.357275 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:11:18.357276 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:11:18.357383 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:11:18.357385 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:11:18.358797 (+ 1412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:11:18.358798 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:11:18.360063 (+ 1265us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:11:18.360067 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:11:18.360926 (+ 859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:11:18.360927 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:11:18.360987 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:18.360991 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 08:11:18.361042 (+ 51us) client_negotiation.cc:240] Negotiation successful
0811 08:11:18.361081 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":278,"mutex_wait_us":86,"thread_start_us":73,"threads_started":1}
I20260811 08:11:18.361542 20170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:18.356800 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37548 (local address 127.27.243.193:46141)
0811 08:11:18.357068 (+ 268us) server_negotiation.cc:206] Beginning negotiation
0811 08:11:18.357077 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 08:11:18.357088 (+ 11us) server_negotiation.cc:407] Connection header received
0811 08:11:18.357133 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:11:18.357135 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:11:18.357151 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:11:18.357278 (+ 127us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:11:18.357492 (+ 214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:18.358675 (+ 1183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:18.360150 (+ 1475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:18.360834 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:18.360897 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:18.360956 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0811 08:11:18.361408 (+ 452us) server_negotiation.cc:299] Negotiation successful
0811 08:11:18.361445 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":221,"thread_start_us":131,"threads_started":1}
I20260811 08:11:18.361976 19802 tablet_service.cc:1467] Processing CreateTablet for tablet 733a10e34ef249d1bee8d2a86ec08949 (DEFAULT_TABLE table=test-table [id=8dac9399ce6d4641ae7c5147ff762cad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:11:18.362147 20168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:18.356806 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.195:42441 (local address 127.0.0.1:47014)
0811 08:11:18.357389 (+ 583us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:18.357400 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 08:11:18.357455 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:11:18.357757 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:11:18.357758 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:11:18.357760 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:11:18.357809 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:11:18.357811 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:11:18.358798 (+ 987us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:11:18.358799 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:11:18.360063 (+ 1264us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:11:18.360067 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:11:18.361972 (+ 1905us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:11:18.361973 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:11:18.362039 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:18.362043 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 08:11:18.362067 (+ 24us) client_negotiation.cc:240] Negotiation successful
0811 08:11:18.362097 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":563,"mutex_wait_us":47,"thread_start_us":77,"threads_started":1}
I20260811 08:11:18.362111 19568 tablet_service.cc:1467] Processing CreateTablet for tablet 733a10e34ef249d1bee8d2a86ec08949 (DEFAULT_TABLE table=test-table [id=8dac9399ce6d4641ae7c5147ff762cad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:11:18.362393 19802 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 733a10e34ef249d1bee8d2a86ec08949. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:11:18.362389 19568 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 733a10e34ef249d1bee8d2a86ec08949. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:11:18.362510 20172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:18.357017 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47014 (local address 127.27.243.195:42441)
0811 08:11:18.357187 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0811 08:11:18.357192 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 08:11:18.357535 (+ 343us) server_negotiation.cc:407] Connection header received
0811 08:11:18.357583 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:11:18.357586 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:11:18.357603 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:11:18.357674 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:11:18.357920 (+ 246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:18.358699 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:18.360996 (+ 2297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:18.361765 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:18.362300 (+ 535us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:18.362364 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0811 08:11:18.362389 (+ 25us) server_negotiation.cc:299] Negotiation successful
0811 08:11:18.362431 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130,"thread_start_us":85,"threads_started":1}
I20260811 08:11:18.363061 20046 tablet_service.cc:1467] Processing CreateTablet for tablet 733a10e34ef249d1bee8d2a86ec08949 (DEFAULT_TABLE table=test-table [id=8dac9399ce6d4641ae7c5147ff762cad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:11:18.363348 20046 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 733a10e34ef249d1bee8d2a86ec08949. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:11:18.365837 20177 tablet_bootstrap.cc:492] T 733a10e34ef249d1bee8d2a86ec08949 P df7cef473a184c09b626be720c32fbd3: Bootstrap starting.
I20260811 08:11:18.366134 20178 tablet_bootstrap.cc:492] T 733a10e34ef249d1bee8d2a86ec08949 P 614d9a0fbdbd41a6ba0c6f13d34ee134: Bootstrap starting.
I20260811 08:11:18.366439 20177 tablet_bootstrap.cc:654] T 733a10e34ef249d1bee8d2a86ec08949 P df7cef473a184c09b626be720c32fbd3: Neither blocks nor log segments found. Creating new log.
I20260811 08:11:18.366663 20178 tablet_bootstrap.cc:654] T 733a10e34ef249d1bee8d2a86ec08949 P 614d9a0fbdbd41a6ba0c6f13d34ee134: Neither blocks nor log segments found. Creating new log.
I20260811 08:11:18.366935 20177 log.cc:824] T 733a10e34ef249d1bee8d2a86ec08949 P df7cef473a184c09b626be720c32fbd3: Log is configured to *not* fsync() on all Append() calls
I20260811 08:11:18.367166 20178 log.cc:824] T 733a10e34ef249d1bee8d2a86ec08949 P 614d9a0fbdbd41a6ba0c6f13d34ee134: Log is configured to *not* fsync() on all Append() calls
I20260811 08:11:18.367254 20175 tablet_bootstrap.cc:492] T 733a10e34ef249d1bee8d2a86ec08949 P d49051f047a54cd9b735792f5afa5f89: Bootstrap starting.
I20260811 08:11:18.367641 20177 tablet_bootstrap.cc:492] T 733a10e34ef249d1bee8d2a86ec08949 P df7cef473a184c09b626be720c32fbd3: No bootstrap required, opened a new log
I20260811 08:11:18.367719 20177 ts_tablet_manager.cc:1397] T 733a10e34ef249d1bee8d2a86ec08949 P df7cef473a184c09b626be720c32fbd3: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 08:11:18.367888 20175 tablet_bootstrap.cc:654] T 733a10e34ef249d1bee8d2a86ec08949 P d49051f047a54cd9b735792f5afa5f89: Neither blocks nor log segments found. Creating new log.
I20260811 08:11:18.368307 20178 tablet_bootstrap.cc:492] T 733a10e34ef249d1bee8d2a86ec08949 P 614d9a0fbdbd41a6ba0c6f13d34ee134: No bootstrap required, opened a new log
I20260811 08:11:18.368337 20175 log.cc:824] T 733a10e34ef249d1bee8d2a86ec08949 P d49051f047a54cd9b735792f5afa5f89: Log is configured to *not* fsync() on all Append() calls
I20260811 08:11:18.368388 20178 ts_tablet_manager.cc:1397] T 733a10e34ef249d1bee8d2a86ec08949 P 614d9a0fbdbd41a6ba0c6f13d34ee134: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 08:11:18.368983 20175 tablet_bootstrap.cc:492] T 733a10e34ef249d1bee8d2a86ec08949 P d49051f047a54cd9b735792f5afa5f89: No bootstrap required, opened a new log
I20260811 08:11:18.369045 20175 ts_tablet_manager.cc:1397] T 733a10e34ef249d1bee8d2a86ec08949 P d49051f047a54cd9b735792f5afa5f89: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 08:11:18.369700 20177 raft_consensus.cc:348] T 733a10e34ef249d1bee8d2a86ec08949 P df7cef473a184c09b626be720c32fbd3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d49051f047a54cd9b735792f5afa5f89" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 44397 } } peers { permanent_uuid: "df7cef473a184c09b626be720c32fbd3" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 46141 } } peers { permanent_uuid: "614d9a0fbdbd41a6ba0c6f13d34ee134" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 42441 } }
I20260811 08:11:18.369879 20177 raft_consensus.cc:374] T 733a10e34ef249d1bee8d2a86ec08949 P df7cef473a184c09b626be720c32fbd3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:11:18.369915 20177 raft_consensus.cc:729] T 733a10e34ef249d1bee8d2a86ec08949 P df7cef473a184c09b626be720c32fbd3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df7cef473a184c09b626be720c32fbd3, State: Initialized, Role: FOLLOWER
I20260811 08:11:18.370077 20177 consensus_queue.cc:260] T 733a10e34ef249d1bee8d2a86ec08949 P df7cef473a184c09b626be720c32fbd3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d49051f047a54cd9b735792f5afa5f89" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 44397 } } peers { permanent_uuid: "df7cef473a184c09b626be720c32fbd3" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 46141 } } peers { permanent_uuid: "614d9a0fbdbd41a6ba0c6f13d34ee134" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 42441 } }
I20260811 08:11:18.370370 20177 ts_tablet_manager.cc:1428] T 733a10e34ef249d1bee8d2a86ec08949 P df7cef473a184c09b626be720c32fbd3: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260811 08:11:18.370410 19688 heartbeater.cc:503] Master 127.27.243.254:36983 was elected leader, sending a full tablet report...
I20260811 08:11:18.370313 20178 raft_consensus.cc:348] T 733a10e34ef249d1bee8d2a86ec08949 P 614d9a0fbdbd41a6ba0c6f13d34ee134 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d49051f047a54cd9b735792f5afa5f89" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 44397 } } peers { permanent_uuid: "df7cef473a184c09b626be720c32fbd3" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 46141 } } peers { permanent_uuid: "614d9a0fbdbd41a6ba0c6f13d34ee134" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 42441 } }
I20260811 08:11:18.370460 20178 raft_consensus.cc:374] T 733a10e34ef249d1bee8d2a86ec08949 P 614d9a0fbdbd41a6ba0c6f13d34ee134 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:11:18.370493 20178 raft_consensus.cc:729] T 733a10e34ef249d1bee8d2a86ec08949 P 614d9a0fbdbd41a6ba0c6f13d34ee134 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 614d9a0fbdbd41a6ba0c6f13d34ee134, State: Initialized, Role: FOLLOWER
I20260811 08:11:18.370611 20178 consensus_queue.cc:260] T 733a10e34ef249d1bee8d2a86ec08949 P 614d9a0fbdbd41a6ba0c6f13d34ee134 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d49051f047a54cd9b735792f5afa5f89" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 44397 } } peers { permanent_uuid: "df7cef473a184c09b626be720c32fbd3" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 46141 } } peers { permanent_uuid: "614d9a0fbdbd41a6ba0c6f13d34ee134" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 42441 } }
I20260811 08:11:18.370677 20175 raft_consensus.cc:348] T 733a10e34ef249d1bee8d2a86ec08949 P d49051f047a54cd9b735792f5afa5f89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d49051f047a54cd9b735792f5afa5f89" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 44397 } } peers { permanent_uuid: "df7cef473a184c09b626be720c32fbd3" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 46141 } } peers { permanent_uuid: "614d9a0fbdbd41a6ba0c6f13d34ee134" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 42441 } }
I20260811 08:11:18.370836 20175 raft_consensus.cc:374] T 733a10e34ef249d1bee8d2a86ec08949 P d49051f047a54cd9b735792f5afa5f89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:11:18.370888 20175 raft_consensus.cc:729] T 733a10e34ef249d1bee8d2a86ec08949 P d49051f047a54cd9b735792f5afa5f89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d49051f047a54cd9b735792f5afa5f89, State: Initialized, Role: FOLLOWER
I20260811 08:11:18.370993 20175 consensus_queue.cc:260] T 733a10e34ef249d1bee8d2a86ec08949 P d49051f047a54cd9b735792f5afa5f89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d49051f047a54cd9b735792f5afa5f89" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 44397 } } peers { permanent_uuid: "df7cef473a184c09b626be720c32fbd3" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 46141 } } peers { permanent_uuid: "614d9a0fbdbd41a6ba0c6f13d34ee134" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 42441 } }
I20260811 08:11:18.371259 20178 ts_tablet_manager.cc:1428] T 733a10e34ef249d1bee8d2a86ec08949 P 614d9a0fbdbd41a6ba0c6f13d34ee134: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 08:11:18.371263 19917 heartbeater.cc:503] Master 127.27.243.254:36983 was elected leader, sending a full tablet report...
I20260811 08:11:18.371377 20150 heartbeater.cc:503] Master 127.27.243.254:36983 was elected leader, sending a full tablet report...
I20260811 08:11:18.371248 20175 ts_tablet_manager.cc:1428] T 733a10e34ef249d1bee8d2a86ec08949 P d49051f047a54cd9b735792f5afa5f89: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
W20260811 08:11:18.411180 19920 tablet.cc:2369] T 733a10e34ef249d1bee8d2a86ec08949 P d49051f047a54cd9b735792f5afa5f89: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 08:11:18.435621 20187 raft_consensus.cc:482] T 733a10e34ef249d1bee8d2a86ec08949 P df7cef473a184c09b626be720c32fbd3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:11:18.435765 20187 raft_consensus.cc:504] T 733a10e34ef249d1bee8d2a86ec08949 P df7cef473a184c09b626be720c32fbd3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d49051f047a54cd9b735792f5afa5f89" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 44397 } } peers { permanent_uuid: "df7cef473a184c09b626be720c32fbd3" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 46141 } } peers { permanent_uuid: "614d9a0fbdbd41a6ba0c6f13d34ee134" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 42441 } }
I20260811 08:11:18.436240 20187 leader_election.cc:288] T 733a10e34ef249d1bee8d2a86ec08949 P df7cef473a184c09b626be720c32fbd3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d49051f047a54cd9b735792f5afa5f89 (127.27.243.194:44397), 614d9a0fbdbd41a6ba0c6f13d34ee134 (127.27.243.195:42441)
I20260811 08:11:18.439042 20167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:18.436524 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.193:39905 (local address 127.27.243.194:44397)
0811 08:11:18.436592 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0811 08:11:18.436594 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:11:18.436604 (+ 10us) server_negotiation.cc:407] Connection header received
0811 08:11:18.436635 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:11:18.436636 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:11:18.436647 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:11:18.436714 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:11:18.436888 (+ 174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:18.437358 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:18.438343 (+ 985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:18.438718 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:18.438787 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:18.438796 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 08:11:18.438945 (+ 149us) server_negotiation.cc:299] Negotiation successful
0811 08:11:18.438978 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260811 08:11:18.439043 19693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:18.436451 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.194:44397 (local address 127.27.243.193:39905)
0811 08:11:18.436506 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:18.436519 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 08:11:18.436564 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:11:18.436732 (+ 168us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:11:18.436733 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:11:18.436735 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:11:18.436809 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:11:18.436811 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:11:18.437436 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:11:18.437437 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:11:18.438248 (+ 811us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:11:18.438251 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:11:18.438797 (+ 546us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:11:18.438798 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:11:18.438881 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:18.438884 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 08:11:18.438929 (+ 45us) client_negotiation.cc:240] Negotiation successful
0811 08:11:18.438971 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31,"mutex_wait_us":32}
I20260811 08:11:18.439123 20172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:18.436678 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.193:37275 (local address 127.27.243.195:42441)
0811 08:11:18.436727 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 08:11:18.436729 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:11:18.436822 (+ 93us) server_negotiation.cc:407] Connection header received
0811 08:11:18.436864 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:11:18.436865 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:11:18.436874 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:11:18.436920 (+ 46us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:11:18.437057 (+ 137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:18.437509 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:18.438446 (+ 937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:18.438807 (+ 361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:18.438877 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:18.438885 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 08:11:18.439018 (+ 133us) server_negotiation.cc:299] Negotiation successful
0811 08:11:18.439052 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 08:11:18.439160 20191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:18.436557 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.195:42441 (local address 127.27.243.193:37275)
0811 08:11:18.436753 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:18.436762 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 08:11:18.436815 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:11:18.436929 (+ 114us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:11:18.436930 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:11:18.436931 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:11:18.437002 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:11:18.437003 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:11:18.437601 (+ 598us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:11:18.437602 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:11:18.438356 (+ 754us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:11:18.438359 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:11:18.438886 (+ 527us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:11:18.438887 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:11:18.438955 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:18.438959 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 08:11:18.439005 (+ 46us) client_negotiation.cc:240] Negotiation successful
0811 08:11:18.439041 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":119,"threads_started":1}
I20260811 08:11:18.439484 20078 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "733a10e34ef249d1bee8d2a86ec08949" candidate_uuid: "df7cef473a184c09b626be720c32fbd3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "614d9a0fbdbd41a6ba0c6f13d34ee134" is_pre_election: true
I20260811 08:11:18.439476 19832 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "733a10e34ef249d1bee8d2a86ec08949" candidate_uuid: "df7cef473a184c09b626be720c32fbd3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d49051f047a54cd9b735792f5afa5f89" is_pre_election: true
I20260811 08:11:18.439623 19832 raft_consensus.cc:2454] T 733a10e34ef249d1bee8d2a86ec08949 P d49051f047a54cd9b735792f5afa5f89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df7cef473a184c09b626be720c32fbd3 in term 0.
I20260811 08:11:18.439631 20078 raft_consensus.cc:2454] T 733a10e34ef249d1bee8d2a86ec08949 P 614d9a0fbdbd41a6ba0c6f13d34ee134 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df7cef473a184c09b626be720c32fbd3 in term 0.
I20260811 08:11:18.439864 19492 leader_election.cc:302] T 733a10e34ef249d1bee8d2a86ec08949 P df7cef473a184c09b626be720c32fbd3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d49051f047a54cd9b735792f5afa5f89, df7cef473a184c09b626be720c32fbd3; no voters:
I20260811 08:11:18.439992 20187 raft_consensus.cc:2781] T 733a10e34ef249d1bee8d2a86ec08949 P df7cef473a184c09b626be720c32fbd3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 08:11:18.440052 20187 raft_consensus.cc:482] T 733a10e34ef249d1bee8d2a86ec08949 P df7cef473a184c09b626be720c32fbd3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 08:11:18.440074 20187 raft_consensus.cc:3037] T 733a10e34ef249d1bee8d2a86ec08949 P df7cef473a184c09b626be720c32fbd3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:11:18.440764 20187 raft_consensus.cc:504] T 733a10e34ef249d1bee8d2a86ec08949 P df7cef473a184c09b626be720c32fbd3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d49051f047a54cd9b735792f5afa5f89" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 44397 } } peers { permanent_uuid: "df7cef473a184c09b626be720c32fbd3" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 46141 } } peers { permanent_uuid: "614d9a0fbdbd41a6ba0c6f13d34ee134" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 42441 } }
I20260811 08:11:18.440881 20187 leader_election.cc:288] T 733a10e34ef249d1bee8d2a86ec08949 P df7cef473a184c09b626be720c32fbd3 [CANDIDATE]: Term 1 election: Requested vote from peers d49051f047a54cd9b735792f5afa5f89 (127.27.243.194:44397), 614d9a0fbdbd41a6ba0c6f13d34ee134 (127.27.243.195:42441)
I20260811 08:11:18.441053 19832 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "733a10e34ef249d1bee8d2a86ec08949" candidate_uuid: "df7cef473a184c09b626be720c32fbd3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d49051f047a54cd9b735792f5afa5f89"
I20260811 08:11:18.441100 20078 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "733a10e34ef249d1bee8d2a86ec08949" candidate_uuid: "df7cef473a184c09b626be720c32fbd3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "614d9a0fbdbd41a6ba0c6f13d34ee134"
I20260811 08:11:18.441143 19832 raft_consensus.cc:3037] T 733a10e34ef249d1bee8d2a86ec08949 P d49051f047a54cd9b735792f5afa5f89 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:11:18.441164 20078 raft_consensus.cc:3037] T 733a10e34ef249d1bee8d2a86ec08949 P 614d9a0fbdbd41a6ba0c6f13d34ee134 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:11:18.442065 19832 raft_consensus.cc:2454] T 733a10e34ef249d1bee8d2a86ec08949 P d49051f047a54cd9b735792f5afa5f89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df7cef473a184c09b626be720c32fbd3 in term 1.
I20260811 08:11:18.442065 20078 raft_consensus.cc:2454] T 733a10e34ef249d1bee8d2a86ec08949 P 614d9a0fbdbd41a6ba0c6f13d34ee134 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df7cef473a184c09b626be720c32fbd3 in term 1.
I20260811 08:11:18.442239 19492 leader_election.cc:302] T 733a10e34ef249d1bee8d2a86ec08949 P df7cef473a184c09b626be720c32fbd3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d49051f047a54cd9b735792f5afa5f89, df7cef473a184c09b626be720c32fbd3; no voters:
I20260811 08:11:18.442340 20187 raft_consensus.cc:2781] T 733a10e34ef249d1bee8d2a86ec08949 P df7cef473a184c09b626be720c32fbd3 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:11:18.442488 20187 raft_consensus.cc:686] T 733a10e34ef249d1bee8d2a86ec08949 P df7cef473a184c09b626be720c32fbd3 [term 1 LEADER]: Becoming Leader. State: Replica: df7cef473a184c09b626be720c32fbd3, State: Running, Role: LEADER
I20260811 08:11:18.442593 20187 consensus_queue.cc:237] T 733a10e34ef249d1bee8d2a86ec08949 P df7cef473a184c09b626be720c32fbd3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d49051f047a54cd9b735792f5afa5f89" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 44397 } } peers { permanent_uuid: "df7cef473a184c09b626be720c32fbd3" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 46141 } } peers { permanent_uuid: "614d9a0fbdbd41a6ba0c6f13d34ee134" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 42441 } }
I20260811 08:11:18.443452 19350 catalog_manager.cc:5495] T 733a10e34ef249d1bee8d2a86ec08949 P df7cef473a184c09b626be720c32fbd3 reported cstate change: term changed from 0 to 1, leader changed from <none> to df7cef473a184c09b626be720c32fbd3 (127.27.243.193). New cstate: current_term: 1 leader_uuid: "df7cef473a184c09b626be720c32fbd3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d49051f047a54cd9b735792f5afa5f89" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 44397 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df7cef473a184c09b626be720c32fbd3" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 46141 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "614d9a0fbdbd41a6ba0c6f13d34ee134" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 42441 } health_report { overall_health: UNKNOWN } } }
I20260811 08:11:18.452255 20170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:18.449961 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37556 (local address 127.27.243.193:46141)
0811 08:11:18.450003 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 08:11:18.450005 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:11:18.450050 (+ 45us) server_negotiation.cc:407] Connection header received
0811 08:11:18.450121 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:11:18.450122 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:11:18.450140 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:11:18.450199 (+ 59us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:11:18.450329 (+ 130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:18.450799 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:18.451549 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:18.451734 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:18.451787 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:18.451931 (+ 144us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:11:18.452037 (+ 106us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:11:18.452106 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 08:11:18.452142 (+ 36us) server_negotiation.cc:299] Negotiation successful
0811 08:11:18.452162 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 08:11:18.454010 19832 raft_consensus.cc:1261] T 733a10e34ef249d1bee8d2a86ec08949 P d49051f047a54cd9b735792f5afa5f89 [term 1 FOLLOWER]: Refusing update from remote peer df7cef473a184c09b626be720c32fbd3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:11:18.454000 20078 raft_consensus.cc:1261] T 733a10e34ef249d1bee8d2a86ec08949 P 614d9a0fbdbd41a6ba0c6f13d34ee134 [term 1 FOLLOWER]: Refusing update from remote peer df7cef473a184c09b626be720c32fbd3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:11:18.454336 20187 consensus_queue.cc:1035] T 733a10e34ef249d1bee8d2a86ec08949 P df7cef473a184c09b626be720c32fbd3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "614d9a0fbdbd41a6ba0c6f13d34ee134" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 42441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:11:18.454478 20192 consensus_queue.cc:1035] T 733a10e34ef249d1bee8d2a86ec08949 P df7cef473a184c09b626be720c32fbd3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d49051f047a54cd9b735792f5afa5f89" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 44397 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:11:18.456641 20198 mvcc.cc:205] Tried to move back new op lower bound from 7317241358144905216 to 7317241358101442560. Current Snapshot: MvccSnapshot[applied={T|T < 7317241358144905216}]
I20260811 08:11:18.457222 20200 mvcc.cc:205] Tried to move back new op lower bound from 7317241358144905216 to 7317241358101442560. Current Snapshot: MvccSnapshot[applied={T|T < 7317241358144905216}]
I20260811 08:11:18.459348 19349 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60970:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:11:18.459437 19349 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60970:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:11:18.460131 19349 catalog_manager.cc:5782] T 00000000000000000000000000000000 P bd73426cb34b437a86d301635b77f500: Sending DeleteTablet for 3 replicas of tablet 733a10e34ef249d1bee8d2a86ec08949
I20260811 08:11:18.460467 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 19464
I20260811 08:11:18.460511 19802 tablet_service.cc:1514] Processing DeleteTablet for tablet 733a10e34ef249d1bee8d2a86ec08949 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:11:18 UTC) from {username='kudu', principal='kudu/127.27.243.254@KRBTEST.COM'} at 127.0.0.1:51594
I20260811 08:11:18.460552 20046 tablet_service.cc:1514] Processing DeleteTablet for tablet 733a10e34ef249d1bee8d2a86ec08949 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:11:18 UTC) from {username='kudu', principal='kudu/127.27.243.254@KRBTEST.COM'} at 127.0.0.1:47014
I20260811 08:11:18.473052 20221 tablet_replica.cc:330] T 733a10e34ef249d1bee8d2a86ec08949 P d49051f047a54cd9b735792f5afa5f89: stopping tablet replica
I20260811 08:11:18.473201 20221 raft_consensus.cc:2229] T 733a10e34ef249d1bee8d2a86ec08949 P d49051f047a54cd9b735792f5afa5f89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:11:18.473372 20221 raft_consensus.cc:2258] T 733a10e34ef249d1bee8d2a86ec08949 P d49051f047a54cd9b735792f5afa5f89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:11:18.481381 20223 tablet_replica.cc:330] T 733a10e34ef249d1bee8d2a86ec08949 P 614d9a0fbdbd41a6ba0c6f13d34ee134: stopping tablet replica
I20260811 08:11:18.481559 20223 raft_consensus.cc:2229] T 733a10e34ef249d1bee8d2a86ec08949 P 614d9a0fbdbd41a6ba0c6f13d34ee134 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:11:18.481690 20223 raft_consensus.cc:2258] T 733a10e34ef249d1bee8d2a86ec08949 P 614d9a0fbdbd41a6ba0c6f13d34ee134 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:11:18.481664 20221 ts_tablet_manager.cc:1905] T 733a10e34ef249d1bee8d2a86ec08949 P d49051f047a54cd9b735792f5afa5f89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:11:18.482116 20223 ts_tablet_manager.cc:1905] T 733a10e34ef249d1bee8d2a86ec08949 P 614d9a0fbdbd41a6ba0c6f13d34ee134: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:11:18.483362 20221 ts_tablet_manager.cc:1918] T 733a10e34ef249d1bee8d2a86ec08949 P d49051f047a54cd9b735792f5afa5f89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:11:18.483444 20221 log.cc:1196] T 733a10e34ef249d1bee8d2a86ec08949 P d49051f047a54cd9b735792f5afa5f89: Deleting WAL directory at /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-1/wal/wals/733a10e34ef249d1bee8d2a86ec08949
I20260811 08:11:18.483625 20223 ts_tablet_manager.cc:1918] T 733a10e34ef249d1bee8d2a86ec08949 P 614d9a0fbdbd41a6ba0c6f13d34ee134: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:11:18.483705 20223 log.cc:1196] T 733a10e34ef249d1bee8d2a86ec08949 P 614d9a0fbdbd41a6ba0c6f13d34ee134: Deleting WAL directory at /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-2/wal/wals/733a10e34ef249d1bee8d2a86ec08949
I20260811 08:11:18.483709 20221 ts_tablet_manager.cc:1939] T 733a10e34ef249d1bee8d2a86ec08949 P d49051f047a54cd9b735792f5afa5f89: Deleting consensus metadata
I20260811 08:11:18.483974 20223 ts_tablet_manager.cc:1939] T 733a10e34ef249d1bee8d2a86ec08949 P 614d9a0fbdbd41a6ba0c6f13d34ee134: Deleting consensus metadata
I20260811 08:11:18.484144 19331 catalog_manager.cc:4841] TS d49051f047a54cd9b735792f5afa5f89 (127.27.243.194:44397): tablet 733a10e34ef249d1bee8d2a86ec08949 (table test-table [id=8dac9399ce6d4641ae7c5147ff762cad]) successfully deleted
I20260811 08:11:18.484372 19331 catalog_manager.cc:4841] TS 614d9a0fbdbd41a6ba0c6f13d34ee134 (127.27.243.195:42441): tablet 733a10e34ef249d1bee8d2a86ec08949 (table test-table [id=8dac9399ce6d4641ae7c5147ff762cad]) successfully deleted
W20260811 08:11:18.486222 19331 connection.cc:535] client connection to 127.27.243.193:46141 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260811 08:11:18.486317 19331 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260811 08:11:18.486414 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 19698
I20260811 08:11:18.492187 20168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:18.492051 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.193:46141 (local address 127.0.0.1:37570)
0811 08:11:18.492110 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:18.492153 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.193:46141: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260811 08:11:18.492323 19331 catalog_manager.cc:4584] TS df7cef473a184c09b626be720c32fbd3 (127.27.243.193:46141): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 733a10e34ef249d1bee8d2a86ec08949: Network error: Client connection negotiation failed: client connection to 127.27.243.193:46141: connect: Connection refused (error 111)
I20260811 08:11:18.495370 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 19924
I20260811 08:11:18.507548 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 19300
I20260811 08:11:18.521730 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.243.254:36983
--webserver_interface=127.27.243.254
--webserver_port=34105
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab
--principal=kudu/127.27.243.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:42189
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.243.254:36983
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:11:18.605587 20226 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:11:18.605811 20226 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:11:18.605846 20226 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:11:18.607004 20226 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:11:18.607051 20226 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:11:18.607074 20226 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:11:18.607091 20226 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:11:18.607111 20226 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:11:18.608592 20226 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:42189
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.27.243.254:36983
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab
--principal=kudu/127.27.243.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.243.254:36983
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.243.254
--webserver_port=34105
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20226
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:11:18.608850 20226 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:11:18.609064 20226 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:11:18.618577 20235 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:11:18.618647 20238 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:11:18.618577 20234 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:11:18.618927 20226 server_base.cc:1034] running on GCE node
I20260811 08:11:18.619248 20226 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:11:18.619643 20226 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:11:18.620811 20226 hybrid_clock.cc:648] HybridClock initialized: now 1786435878620773 us; error 51 us; skew 500 ppm
Aug 11 08:11:18 dist-test-slave-7lbf krb5kdc[19274](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435878, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:11:18.623366 20226 init.cc:377] Logged in from keytab as kudu/127.27.243.254@KRBTEST.COM (short username kudu)
I20260811 08:11:18.623860 20226 webserver.cc:460] Webserver started at http://127.27.243.254:34105/ using document root <none> and password file <none>
I20260811 08:11:18.624089 20226 fs_manager.cc:359] Metadata directory not provided
I20260811 08:11:18.624161 20226 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:11:18.625587 20226 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:11:18.626235 20253 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:11:18.626394 20226 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 08:11:18.626487 20226 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/master-0/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/master-0/wal
uuid: "bd73426cb34b437a86d301635b77f500"
format_stamp: "Formatted at 2026-08-11 08:11:17 on dist-test-slave-7lbf"
server_key: "a7731215e900a0fd7eb920c5751fb10c"
server_key_iv: "38f49e16ab948135b39bcf47749bfb31"
server_key_version: "encryptionkey@0"
I20260811 08:11:18.626893 20226 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:11:18.637598 20226 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:11:18.639495 20226 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:11:18.639647 20226 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:11:18.644059 20226 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.254:36983
I20260811 08:11:18.644100 20336 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.254:36983 every 8 connection(s)
I20260811 08:11:18.644526 20226 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
I20260811 08:11:18.646402 20337 sys_catalog.cc:263] Verifying existing consensus state
I20260811 08:11:18.647018 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 20226
I20260811 08:11:18.647053 20337 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bd73426cb34b437a86d301635b77f500: Bootstrap starting.
I20260811 08:11:18.647275 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.243.193:46141
--local_ip_for_outbound_sockets=127.27.243.193
--tserver_master_addrs=127.27.243.254:36983
--webserver_port=38457
--webserver_interface=127.27.243.193
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.193.keytab
--principal=kudu/127.27.243.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:42189
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 08:11:18.656081 20337 log.cc:824] T 00000000000000000000000000000000 P bd73426cb34b437a86d301635b77f500: Log is configured to *not* fsync() on all Append() calls
I20260811 08:11:18.658198 20337 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bd73426cb34b437a86d301635b77f500: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 08:11:18.658512 20337 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bd73426cb34b437a86d301635b77f500: Bootstrap complete.
I20260811 08:11:18.660779 20337 raft_consensus.cc:348] T 00000000000000000000000000000000 P bd73426cb34b437a86d301635b77f500 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd73426cb34b437a86d301635b77f500" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 36983 } }
I20260811 08:11:18.661017 20337 raft_consensus.cc:729] T 00000000000000000000000000000000 P bd73426cb34b437a86d301635b77f500 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd73426cb34b437a86d301635b77f500, State: Initialized, Role: FOLLOWER
I20260811 08:11:18.661167 20337 consensus_queue.cc:260] T 00000000000000000000000000000000 P bd73426cb34b437a86d301635b77f500 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd73426cb34b437a86d301635b77f500" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 36983 } }
I20260811 08:11:18.661237 20337 raft_consensus.cc:388] T 00000000000000000000000000000000 P bd73426cb34b437a86d301635b77f500 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:11:18.661273 20337 raft_consensus.cc:482] T 00000000000000000000000000000000 P bd73426cb34b437a86d301635b77f500 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:11:18.661321 20337 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bd73426cb34b437a86d301635b77f500 [term 1 FOLLOWER]: Advancing to term 2
I20260811 08:11:18.662420 20337 raft_consensus.cc:504] T 00000000000000000000000000000000 P bd73426cb34b437a86d301635b77f500 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd73426cb34b437a86d301635b77f500" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 36983 } }
I20260811 08:11:18.662515 20337 leader_election.cc:302] T 00000000000000000000000000000000 P bd73426cb34b437a86d301635b77f500 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bd73426cb34b437a86d301635b77f500; no voters:
I20260811 08:11:18.662681 20337 leader_election.cc:288] T 00000000000000000000000000000000 P bd73426cb34b437a86d301635b77f500 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 08:11:18.662736 20342 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bd73426cb34b437a86d301635b77f500 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 08:11:18.662911 20342 raft_consensus.cc:686] T 00000000000000000000000000000000 P bd73426cb34b437a86d301635b77f500 [term 2 LEADER]: Becoming Leader. State: Replica: bd73426cb34b437a86d301635b77f500, State: Running, Role: LEADER
I20260811 08:11:18.662998 20337 sys_catalog.cc:564] T 00000000000000000000000000000000 P bd73426cb34b437a86d301635b77f500 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:11:18.663074 20342 consensus_queue.cc:237] T 00000000000000000000000000000000 P bd73426cb34b437a86d301635b77f500 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd73426cb34b437a86d301635b77f500" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 36983 } }
I20260811 08:11:18.663406 20342 sys_catalog.cc:455] T 00000000000000000000000000000000 P bd73426cb34b437a86d301635b77f500 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bd73426cb34b437a86d301635b77f500. Latest consensus state: current_term: 2 leader_uuid: "bd73426cb34b437a86d301635b77f500" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd73426cb34b437a86d301635b77f500" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 36983 } } }
I20260811 08:11:18.663494 20342 sys_catalog.cc:458] T 00000000000000000000000000000000 P bd73426cb34b437a86d301635b77f500 [sys.catalog]: This master's current role is: LEADER
I20260811 08:11:18.663383 20343 sys_catalog.cc:455] T 00000000000000000000000000000000 P bd73426cb34b437a86d301635b77f500 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "bd73426cb34b437a86d301635b77f500" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd73426cb34b437a86d301635b77f500" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 36983 } } }
I20260811 08:11:18.663937 20343 sys_catalog.cc:458] T 00000000000000000000000000000000 P bd73426cb34b437a86d301635b77f500 [sys.catalog]: This master's current role is: LEADER
I20260811 08:11:18.664094 20357 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:11:18.664953 20357 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:11:18.665058 20357 catalog_manager.cc:1259] Loaded cluster ID: 247c66e5453342528ccf00e3d0280724
I20260811 08:11:18.665130 20357 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:11:18.665563 20357 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260811 08:11:18.668260 20357 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260811 08:11:18.670468 20357 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:11:18.670694 20357 catalog_manager.cc:5879] T 00000000000000000000000000000000 P bd73426cb34b437a86d301635b77f500: Loaded TSK: 0
I20260811 08:11:18.670964 20357 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 08:11:18.739117 20340 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:11:18.739346 20340 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:11:18.739382 20340 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:11:18.740550 20340 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:11:18.740598 20340 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:11:18.740636 20340 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.243.193
I20260811 08:11:18.742197 20340 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:42189
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.193.keytab
--principal=kudu/127.27.243.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.243.193:46141
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.243.193
--webserver_port=38457
--tserver_master_addrs=127.27.243.254:36983
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20340
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.243.193
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:11:18.742457 20340 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:11:18.742697 20340 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:11:18.748908 20398 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:11:18.749013 20400 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:11:18.749020 20340 server_base.cc:1034] running on GCE node
W20260811 08:11:18.748914 20396 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:11:18.749336 20340 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:11:18.749610 20340 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:11:18.750763 20340 hybrid_clock.cc:648] HybridClock initialized: now 1786435878750749 us; error 32 us; skew 500 ppm
Aug 11 08:11:18 dist-test-slave-7lbf krb5kdc[19274](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435878, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:11:18.753240 20340 init.cc:377] Logged in from keytab as kudu/127.27.243.193@KRBTEST.COM (short username kudu)
I20260811 08:11:18.753695 20340 webserver.cc:460] Webserver started at http://127.27.243.193:38457/ using document root <none> and password file <none>
I20260811 08:11:18.753921 20340 fs_manager.cc:359] Metadata directory not provided
I20260811 08:11:18.753988 20340 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:11:18.755412 20340 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:11:18.756103 20413 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:11:18.756284 20340 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:11:18.756373 20340 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-0/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-0/wal
uuid: "df7cef473a184c09b626be720c32fbd3"
format_stamp: "Formatted at 2026-08-11 08:11:17 on dist-test-slave-7lbf"
server_key: "009aabc7e264d21f6a56743046dd70d1"
server_key_iv: "8be0cd46d25a4424c53d90dd1f906451"
server_key_version: "encryptionkey@0"
I20260811 08:11:18.756744 20340 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:11:18.794639 20340 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:11:18.796845 20340 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:11:18.796995 20340 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:11:18.797226 20340 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:11:18.797818 20424 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260811 08:11:18.799276 20340 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260811 08:11:18.799327 20340 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260811 08:11:18.799353 20340 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260811 08:11:18.799999 20340 ts_tablet_manager.cc:610] Registered 1 tablets
I20260811 08:11:18.800043 20340 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260811 08:11:18.800109 20424 tablet_bootstrap.cc:492] T 733a10e34ef249d1bee8d2a86ec08949 P df7cef473a184c09b626be720c32fbd3: Bootstrap starting.
I20260811 08:11:18.807555 20340 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.193:46141
I20260811 08:11:18.807605 20615 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.193:46141 every 8 connection(s)
I20260811 08:11:18.808075 20340 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-0/data/info.pb
I20260811 08:11:18.811430 20424 log.cc:824] T 733a10e34ef249d1bee8d2a86ec08949 P df7cef473a184c09b626be720c32fbd3: Log is configured to *not* fsync() on all Append() calls
I20260811 08:11:18.814033 20424 tablet_bootstrap.cc:492] T 733a10e34ef249d1bee8d2a86ec08949 P df7cef473a184c09b626be720c32fbd3: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 08:11:18.814049 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 20340
I20260811 08:11:18.814317 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.243.194:44397
--local_ip_for_outbound_sockets=127.27.243.194
--tserver_master_addrs=127.27.243.254:36983
--webserver_port=36931
--webserver_interface=127.27.243.194
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.194.keytab
--principal=kudu/127.27.243.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:42189
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 08:11:18.814638 20424 tablet_bootstrap.cc:492] T 733a10e34ef249d1bee8d2a86ec08949 P df7cef473a184c09b626be720c32fbd3: Bootstrap complete.
I20260811 08:11:18.815683 20424 ts_tablet_manager.cc:1397] T 733a10e34ef249d1bee8d2a86ec08949 P df7cef473a184c09b626be720c32fbd3: Time spent bootstrapping tablet: real 0.016s user 0.002s sys 0.012s
Aug 11 08:11:18 dist-test-slave-7lbf krb5kdc[19274](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435878, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.193@KRBTEST.COM for kudu/127.27.243.254@KRBTEST.COM
I20260811 08:11:18.816968 20424 raft_consensus.cc:348] T 733a10e34ef249d1bee8d2a86ec08949 P df7cef473a184c09b626be720c32fbd3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d49051f047a54cd9b735792f5afa5f89" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 44397 } } peers { permanent_uuid: "df7cef473a184c09b626be720c32fbd3" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 46141 } } peers { permanent_uuid: "614d9a0fbdbd41a6ba0c6f13d34ee134" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 42441 } }
I20260811 08:11:18.817224 20424 raft_consensus.cc:729] T 733a10e34ef249d1bee8d2a86ec08949 P df7cef473a184c09b626be720c32fbd3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: df7cef473a184c09b626be720c32fbd3, State: Initialized, Role: FOLLOWER
I20260811 08:11:18.817356 20424 consensus_queue.cc:260] T 733a10e34ef249d1bee8d2a86ec08949 P df7cef473a184c09b626be720c32fbd3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d49051f047a54cd9b735792f5afa5f89" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 44397 } } peers { permanent_uuid: "df7cef473a184c09b626be720c32fbd3" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 46141 } } peers { permanent_uuid: "614d9a0fbdbd41a6ba0c6f13d34ee134" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 42441 } }
I20260811 08:11:18.817656 20424 ts_tablet_manager.cc:1428] T 733a10e34ef249d1bee8d2a86ec08949 P df7cef473a184c09b626be720c32fbd3: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260811 08:11:18.820218 20623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:18.809017 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.193:57023 (local address 127.27.243.254:36983)
0811 08:11:18.809248 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0811 08:11:18.809256 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 08:11:18.809293 (+ 37us) server_negotiation.cc:407] Connection header received
0811 08:11:18.809974 (+ 681us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:11:18.809979 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:11:18.810028 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:11:18.810150 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:11:18.810830 (+ 680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:18.811798 (+ 968us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:18.813279 (+ 1481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:18.813730 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:18.813894 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:18.816386 (+ 2492us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:11:18.816392 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:11:18.816392 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:11:18.816406 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:11:18.818273 (+ 1867us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:11:18.818759 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:11:18.818763 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:11:18.818763 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:11:18.818917 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:11:18.819220 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:11:18.819221 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:11:18.819221 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:11:18.819508 (+ 287us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:11:18.819587 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 08:11:18.819965 (+ 378us) server_negotiation.cc:299] Negotiation successful
0811 08:11:18.820082 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":185,"thread_start_us":98,"threads_started":1}
I20260811 08:11:18.820271 20621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:18.808899 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36983 (local address 127.27.243.193:57023)
0811 08:11:18.809127 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:18.809177 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0811 08:11:18.809737 (+ 560us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:11:18.810192 (+ 455us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:11:18.810196 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:11:18.810494 (+ 298us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:11:18.810706 (+ 212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:11:18.810712 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:11:18.811938 (+ 1226us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:11:18.811940 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:11:18.813178 (+ 1238us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:11:18.813181 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:11:18.813836 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:11:18.813838 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:11:18.813985 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:18.814551 (+ 566us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:11:18.814561 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:11:18.816256 (+ 1695us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:11:18.818357 (+ 2101us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:11:18.818365 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:11:18.818367 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:11:18.818652 (+ 285us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:11:18.819004 (+ 352us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:11:18.819005 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:11:18.819005 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:11:18.819154 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:11:18.819585 (+ 431us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:11:18.819594 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:11:18.819764 (+ 170us) client_negotiation.cc:769] Sending connection context
0811 08:11:18.819888 (+ 124us) client_negotiation.cc:240] Negotiation successful
0811 08:11:18.820071 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":114,"threads_started":1}
I20260811 08:11:18.821012 20616 heartbeater.cc:347] Connected to a master server at 127.27.243.254:36983
I20260811 08:11:18.821110 20616 heartbeater.cc:464] Registering TS with master...
I20260811 08:11:18.821275 20616 heartbeater.cc:511] Master 127.27.243.254:36983 requested a full tablet report, sending...
I20260811 08:11:18.822075 20274 ts_manager.cc:194] Registered new tserver with Master: df7cef473a184c09b626be720c32fbd3 (127.27.243.193:46141)
I20260811 08:11:18.823274 20274 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.243.193@KRBTEST.COM'} at 127.27.243.193:57023
I20260811 08:11:18.825321 20616 heartbeater.cc:503] Master 127.27.243.254:36983 was elected leader, sending a full tablet report...
Aug 11 08:11:18 dist-test-slave-7lbf krb5kdc[19274](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435878, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.254@KRBTEST.COM for kudu/127.27.243.193@KRBTEST.COM
I20260811 08:11:18.831548 20633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:18.822751 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37576 (local address 127.27.243.193:46141)
0811 08:11:18.823105 (+ 354us) server_negotiation.cc:206] Beginning negotiation
0811 08:11:18.823108 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:11:18.823115 (+ 7us) server_negotiation.cc:407] Connection header received
0811 08:11:18.823141 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:11:18.823143 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:11:18.823153 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:11:18.823205 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:11:18.823794 (+ 589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:18.824885 (+ 1091us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:18.826014 (+ 1129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:18.826501 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:18.826563 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:18.828621 (+ 2058us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:11:18.828628 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:11:18.828628 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:11:18.828635 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:11:18.830104 (+ 1469us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:11:18.830608 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:11:18.830611 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:11:18.830612 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:11:18.830693 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:11:18.830924 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:11:18.830925 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:11:18.830925 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:11:18.831078 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:11:18.831159 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 08:11:18.831351 (+ 192us) server_negotiation.cc:299] Negotiation successful
0811 08:11:18.831444 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":330,"thread_start_us":64,"threads_started":1}
I20260811 08:11:18.831549 20632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:18.822691 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.193:46141 (local address 127.0.0.1:37576)
0811 08:11:18.822941 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:18.822965 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0811 08:11:18.823016 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:11:18.823304 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:11:18.823320 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:11:18.823638 (+ 318us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:11:18.823697 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:11:18.823700 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:11:18.824984 (+ 1284us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:11:18.824985 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:11:18.825911 (+ 926us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:11:18.825915 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:11:18.826568 (+ 653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:11:18.826569 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:11:18.826649 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:18.827095 (+ 446us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:11:18.827100 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:11:18.828541 (+ 1441us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:11:18.830192 (+ 1651us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:11:18.830199 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:11:18.830201 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:11:18.830412 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:11:18.830776 (+ 364us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:11:18.830777 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:11:18.830778 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:11:18.830862 (+ 84us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:11:18.831158 (+ 296us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:11:18.831166 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:11:18.831222 (+ 56us) client_negotiation.cc:769] Sending connection context
0811 08:11:18.831312 (+ 90us) client_negotiation.cc:240] Negotiation successful
0811 08:11:18.831444 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":227,"thread_start_us":79,"threads_started":1}
I20260811 08:11:18.832235 20503 tablet_service.cc:1514] Processing DeleteTablet for tablet 733a10e34ef249d1bee8d2a86ec08949 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:11:18 UTC) from {username='kudu', principal='kudu/127.27.243.254@KRBTEST.COM'} at 127.0.0.1:37576
I20260811 08:11:18.832746 20635 tablet_replica.cc:330] stopping tablet replica
I20260811 08:11:18.832849 20635 raft_consensus.cc:2229] T 733a10e34ef249d1bee8d2a86ec08949 P df7cef473a184c09b626be720c32fbd3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:11:18.832923 20635 raft_consensus.cc:2258] T 733a10e34ef249d1bee8d2a86ec08949 P df7cef473a184c09b626be720c32fbd3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:11:18.833249 20635 ts_tablet_manager.cc:1905] T 733a10e34ef249d1bee8d2a86ec08949 P df7cef473a184c09b626be720c32fbd3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:11:18.835444 20635 ts_tablet_manager.cc:1918] T 733a10e34ef249d1bee8d2a86ec08949 P df7cef473a184c09b626be720c32fbd3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:11:18.835517 20635 log.cc:1196] T 733a10e34ef249d1bee8d2a86ec08949 P df7cef473a184c09b626be720c32fbd3: Deleting WAL directory at /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-0/wal/wals/733a10e34ef249d1bee8d2a86ec08949
I20260811 08:11:18.835757 20635 ts_tablet_manager.cc:1939] T 733a10e34ef249d1bee8d2a86ec08949 P df7cef473a184c09b626be720c32fbd3: Deleting consensus metadata
I20260811 08:11:18.836247 20258 catalog_manager.cc:4841] TS df7cef473a184c09b626be720c32fbd3 (127.27.243.193:46141): tablet 733a10e34ef249d1bee8d2a86ec08949 (table test-table [id=8dac9399ce6d4641ae7c5147ff762cad]) successfully deleted
W20260811 08:11:18.901573 20630 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:11:18.901793 20630 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:11:18.901827 20630 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:11:18.903033 20630 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:11:18.903080 20630 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:11:18.903116 20630 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.243.194
I20260811 08:11:18.904644 20630 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:42189
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.194.keytab
--principal=kudu/127.27.243.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.243.194:44397
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.243.194
--webserver_port=36931
--tserver_master_addrs=127.27.243.254:36983
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20630
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.243.194
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:11:18.904891 20630 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:11:18.905121 20630 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:11:18.909989 20643 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:11:18.910019 20648 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:11:18.910028 20644 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:11:18.910211 20630 server_base.cc:1034] running on GCE node
I20260811 08:11:18.910399 20630 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:11:18.910645 20630 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:11:18.911800 20630 hybrid_clock.cc:648] HybridClock initialized: now 1786435878911786 us; error 29 us; skew 500 ppm
Aug 11 08:11:18 dist-test-slave-7lbf krb5kdc[19274](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435878, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:11:18.914273 20630 init.cc:377] Logged in from keytab as kudu/127.27.243.194@KRBTEST.COM (short username kudu)
I20260811 08:11:18.914671 20630 webserver.cc:460] Webserver started at http://127.27.243.194:36931/ using document root <none> and password file <none>
I20260811 08:11:18.914861 20630 fs_manager.cc:359] Metadata directory not provided
I20260811 08:11:18.914920 20630 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:11:18.916306 20630 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:11:18.916854 20658 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:11:18.917023 20630 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 08:11:18.917104 20630 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-1/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-1/wal
uuid: "d49051f047a54cd9b735792f5afa5f89"
format_stamp: "Formatted at 2026-08-11 08:11:18 on dist-test-slave-7lbf"
server_key: "d58cbd06d96b4f4ce0e65b6494e7f726"
server_key_iv: "bd421cfde3debe9a3b0ae3cc28e33e31"
server_key_version: "encryptionkey@0"
I20260811 08:11:18.917447 20630 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:11:18.932140 20630 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:11:18.934039 20630 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:11:18.934161 20630 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:11:18.934365 20630 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:11:18.934659 20630 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:11:18.934690 20630 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:11:18.934712 20630 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:11:18.934736 20630 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:11:18.940569 20630 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.194:44397
I20260811 08:11:18.940658 20844 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.194:44397 every 8 connection(s)
I20260811 08:11:18.940961 20630 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-1/data/info.pb
I20260811 08:11:18.941229 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 20630
I20260811 08:11:18.941571 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.243.195:42441
--local_ip_for_outbound_sockets=127.27.243.195
--tserver_master_addrs=127.27.243.254:36983
--webserver_port=39019
--webserver_interface=127.27.243.195
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.195.keytab
--principal=kudu/127.27.243.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:42189
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 08:11:18 dist-test-slave-7lbf krb5kdc[19274](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435878, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.194@KRBTEST.COM for kudu/127.27.243.254@KRBTEST.COM
I20260811 08:11:18.950954 20623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:18.942045 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.194:58295 (local address 127.27.243.254:36983)
0811 08:11:18.942119 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0811 08:11:18.942121 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:11:18.942133 (+ 12us) server_negotiation.cc:407] Connection header received
0811 08:11:18.942568 (+ 435us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:11:18.942570 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:11:18.942586 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:11:18.942655 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:11:18.943629 (+ 974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:18.944175 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:18.945638 (+ 1463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:18.945863 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:18.945925 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:18.948267 (+ 2342us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:11:18.948269 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:11:18.948269 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:11:18.948277 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:11:18.949649 (+ 1372us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:11:18.950032 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:11:18.950034 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:11:18.950034 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:11:18.950091 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:11:18.950308 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:11:18.950309 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:11:18.950310 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:11:18.950429 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:11:18.950485 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 08:11:18.950764 (+ 279us) server_negotiation.cc:299] Negotiation successful
0811 08:11:18.950861 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260811 08:11:18.951131 20850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:18.941725 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36983 (local address 127.27.243.194:58295)
0811 08:11:18.941922 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:18.941959 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 08:11:18.942465 (+ 506us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:11:18.942712 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:11:18.942715 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:11:18.943321 (+ 606us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:11:18.943520 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:11:18.943526 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:11:18.944283 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:11:18.944285 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:11:18.945487 (+ 1202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:11:18.945490 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:11:18.945958 (+ 468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:11:18.945959 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:11:18.946125 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:18.946650 (+ 525us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:11:18.946662 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:11:18.948171 (+ 1509us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:11:18.949725 (+ 1554us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:11:18.949732 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:11:18.949734 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:11:18.949965 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:11:18.950146 (+ 181us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:11:18.950147 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:11:18.950147 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:11:18.950253 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:11:18.950486 (+ 233us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:11:18.950494 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:11:18.950639 (+ 145us) client_negotiation.cc:769] Sending connection context
0811 08:11:18.950734 (+ 95us) client_negotiation.cc:240] Negotiation successful
0811 08:11:18.950894 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":84,"threads_started":1}
I20260811 08:11:18.951615 20846 heartbeater.cc:347] Connected to a master server at 127.27.243.254:36983
I20260811 08:11:18.951711 20846 heartbeater.cc:464] Registering TS with master...
I20260811 08:11:18.951887 20846 heartbeater.cc:511] Master 127.27.243.254:36983 requested a full tablet report, sending...
I20260811 08:11:18.952309 20274 ts_manager.cc:194] Registered new tserver with Master: d49051f047a54cd9b735792f5afa5f89 (127.27.243.194:44397)
I20260811 08:11:18.952684 20274 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.243.194@KRBTEST.COM'} at 127.27.243.194:58295
W20260811 08:11:19.024904 20853 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:11:19.025106 20853 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:11:19.025130 20853 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:11:19.026305 20853 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:11:19.026345 20853 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:11:19.026371 20853 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.243.195
I20260811 08:11:19.027799 20853 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:42189
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.195.keytab
--principal=kudu/127.27.243.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.243.195:42441
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.243.195
--webserver_port=39019
--tserver_master_addrs=127.27.243.254:36983
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20853
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.243.195
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:11:19.028024 20853 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:11:19.028235 20853 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:11:19.032909 20872 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:11:19.032913 20869 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:11:19.032923 20867 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:11:19.033142 20853 server_base.cc:1034] running on GCE node
I20260811 08:11:19.033350 20853 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:11:19.033586 20853 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:11:19.034742 20853 hybrid_clock.cc:648] HybridClock initialized: now 1786435879034724 us; error 27 us; skew 500 ppm
Aug 11 08:11:19 dist-test-slave-7lbf krb5kdc[19274](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435879, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:11:19.037112 20853 init.cc:377] Logged in from keytab as kudu/127.27.243.195@KRBTEST.COM (short username kudu)
I20260811 08:11:19.037493 20853 webserver.cc:460] Webserver started at http://127.27.243.195:39019/ using document root <none> and password file <none>
I20260811 08:11:19.037724 20853 fs_manager.cc:359] Metadata directory not provided
I20260811 08:11:19.037781 20853 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:11:19.039026 20853 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:11:19.039546 20883 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:11:19.039686 20853 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 08:11:19.039769 20853 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-2/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-2/wal
uuid: "614d9a0fbdbd41a6ba0c6f13d34ee134"
format_stamp: "Formatted at 2026-08-11 08:11:18 on dist-test-slave-7lbf"
server_key: "fadded36b81c57c4cae32c21164d8ed8"
server_key_iv: "def5b0a493b6d893ab36423df8f0f2b1"
server_key_version: "encryptionkey@0"
I20260811 08:11:19.040107 20853 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:11:19.069454 20853 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:11:19.071393 20853 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:11:19.071507 20853 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:11:19.071700 20853 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:11:19.072021 20853 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:11:19.072062 20853 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:11:19.072083 20853 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:11:19.072095 20853 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:11:19.077651 20853 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.195:42441
I20260811 08:11:19.077724 21080 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.195:42441 every 8 connection(s)
I20260811 08:11:19.078056 20853 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-2/data/info.pb
I20260811 08:11:19.078202 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 20853
Aug 11 08:11:19 dist-test-slave-7lbf krb5kdc[19274](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435879, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.195@KRBTEST.COM for kudu/127.27.243.254@KRBTEST.COM
I20260811 08:11:19.085319 20623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:19.078662 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60976 (local address 127.27.243.254:36983)
0811 08:11:19.078715 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 08:11:19.078717 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:11:19.078787 (+ 70us) server_negotiation.cc:407] Connection header received
0811 08:11:19.078955 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:11:19.078957 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:11:19.078970 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:11:19.079026 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:11:19.079747 (+ 721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:19.080278 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:19.081189 (+ 911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:19.081467 (+ 278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:19.081538 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:19.082818 (+ 1280us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:11:19.082819 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:11:19.082820 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:11:19.082826 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:11:19.084243 (+ 1417us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:11:19.084592 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:11:19.084593 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:11:19.084593 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:11:19.084637 (+ 44us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:11:19.084803 (+ 166us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:11:19.084804 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:11:19.084804 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:11:19.084887 (+ 83us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:11:19.085047 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0811 08:11:19.085143 (+ 96us) server_negotiation.cc:299] Negotiation successful
0811 08:11:19.085225 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 08:11:19.087729 21085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:19.078732 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.195:50555 (local address 127.27.243.254:36983)
0811 08:11:19.078863 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0811 08:11:19.078865 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:11:19.079106 (+ 241us) server_negotiation.cc:407] Connection header received
0811 08:11:19.079771 (+ 665us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:11:19.079771 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:11:19.079783 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:11:19.079844 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:11:19.080866 (+ 1022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:19.081444 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:19.082842 (+ 1398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:19.083114 (+ 272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:19.083178 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:19.085457 (+ 2279us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:11:19.085458 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:11:19.085459 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:11:19.085465 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:11:19.086734 (+ 1269us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:11:19.087087 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:11:19.087087 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:11:19.087088 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:11:19.087132 (+ 44us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:11:19.087297 (+ 165us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:11:19.087297 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:11:19.087298 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:11:19.087379 (+ 81us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:11:19.087419 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0811 08:11:19.087616 (+ 197us) server_negotiation.cc:299] Negotiation successful
0811 08:11:19.087670 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":114,"thread_start_us":54,"threads_started":1}
I20260811 08:11:19.087919 21090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:19.078723 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36983 (local address 127.27.243.195:50555)
0811 08:11:19.078968 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:19.079015 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 08:11:19.079686 (+ 671us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:11:19.079901 (+ 215us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:11:19.079904 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:11:19.080515 (+ 611us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:11:19.080775 (+ 260us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:11:19.080782 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:11:19.081555 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:11:19.081556 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:11:19.082772 (+ 1216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:11:19.082775 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:11:19.083199 (+ 424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:11:19.083200 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:11:19.083352 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:19.083753 (+ 401us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:11:19.083764 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:11:19.085331 (+ 1567us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:11:19.086798 (+ 1467us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:11:19.086805 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:11:19.086807 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:11:19.087032 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:11:19.087173 (+ 141us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:11:19.087174 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:11:19.087174 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:11:19.087258 (+ 84us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:11:19.087418 (+ 160us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:11:19.087420 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:11:19.087525 (+ 105us) client_negotiation.cc:769] Sending connection context
0811 08:11:19.087599 (+ 74us) client_negotiation.cc:240] Negotiation successful
0811 08:11:19.087708 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":78,"threads_started":1}
I20260811 08:11:19.088352 21081 heartbeater.cc:347] Connected to a master server at 127.27.243.254:36983
I20260811 08:11:19.088435 21081 heartbeater.cc:464] Registering TS with master...
I20260811 08:11:19.088599 21081 heartbeater.cc:511] Master 127.27.243.254:36983 requested a full tablet report, sending...
I20260811 08:11:19.088930 20274 ts_manager.cc:194] Registered new tserver with Master: 614d9a0fbdbd41a6ba0c6f13d34ee134 (127.27.243.195:42441)
I20260811 08:11:19.089263 20274 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.243.195@KRBTEST.COM'} at 127.27.243.195:50555
I20260811 08:11:19.096764 28623 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 08:11:19.099253 21085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:19.097086 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60982 (local address 127.27.243.254:36983)
0811 08:11:19.097131 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 08:11:19.097133 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:11:19.097217 (+ 84us) server_negotiation.cc:407] Connection header received
0811 08:11:19.097270 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:11:19.097270 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:11:19.097305 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:11:19.097365 (+ 60us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:11:19.097454 (+ 89us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:19.097986 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:19.098668 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:19.098880 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:19.098928 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:19.099030 (+ 102us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:11:19.099118 (+ 88us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:11:19.099170 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 08:11:19.099185 (+ 15us) server_negotiation.cc:299] Negotiation successful
0811 08:11:19.099203 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 08:11:19.099525 20274 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:60982:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 08:11:19.101038 20274 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 08:11:19.103317 20503 tablet_service.cc:1467] Processing CreateTablet for tablet 4db47c347b1d4fb59edc9cb84276424b (DEFAULT_TABLE table=test-table [id=0f1794d16ab04ecfb1ac130095dad692]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:11:19.103530 20503 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4db47c347b1d4fb59edc9cb84276424b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:11:19.105013 20424 tablet_bootstrap.cc:492] T 4db47c347b1d4fb59edc9cb84276424b P df7cef473a184c09b626be720c32fbd3: Bootstrap starting.
I20260811 08:11:19.105288 20424 tablet_bootstrap.cc:654] T 4db47c347b1d4fb59edc9cb84276424b P df7cef473a184c09b626be720c32fbd3: Neither blocks nor log segments found. Creating new log.
I20260811 08:11:19.106119 20424 tablet_bootstrap.cc:492] T 4db47c347b1d4fb59edc9cb84276424b P df7cef473a184c09b626be720c32fbd3: No bootstrap required, opened a new log
I20260811 08:11:19.106165 20424 ts_tablet_manager.cc:1397] T 4db47c347b1d4fb59edc9cb84276424b P df7cef473a184c09b626be720c32fbd3: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 08:11:19.106317 20424 raft_consensus.cc:348] T 4db47c347b1d4fb59edc9cb84276424b P df7cef473a184c09b626be720c32fbd3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d49051f047a54cd9b735792f5afa5f89" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 44397 } } peers { permanent_uuid: "614d9a0fbdbd41a6ba0c6f13d34ee134" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 42441 } } peers { permanent_uuid: "df7cef473a184c09b626be720c32fbd3" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 46141 } }
I20260811 08:11:19.106379 20424 raft_consensus.cc:374] T 4db47c347b1d4fb59edc9cb84276424b P df7cef473a184c09b626be720c32fbd3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:11:19.106426 20424 raft_consensus.cc:729] T 4db47c347b1d4fb59edc9cb84276424b P df7cef473a184c09b626be720c32fbd3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df7cef473a184c09b626be720c32fbd3, State: Initialized, Role: FOLLOWER
I20260811 08:11:19.106467 20424 consensus_queue.cc:260] T 4db47c347b1d4fb59edc9cb84276424b P df7cef473a184c09b626be720c32fbd3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d49051f047a54cd9b735792f5afa5f89" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 44397 } } peers { permanent_uuid: "614d9a0fbdbd41a6ba0c6f13d34ee134" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 42441 } } peers { permanent_uuid: "df7cef473a184c09b626be720c32fbd3" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 46141 } }
I20260811 08:11:19.106559 20424 ts_tablet_manager.cc:1428] T 4db47c347b1d4fb59edc9cb84276424b P df7cef473a184c09b626be720c32fbd3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 08:11:19.106804 20632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:19.102749 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.194:44397 (local address 127.0.0.1:51598)
0811 08:11:19.102796 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:19.102806 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 08:11:19.102842 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:11:19.103355 (+ 513us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:11:19.103356 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:11:19.103358 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:11:19.103399 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:11:19.103400 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:11:19.104439 (+ 1039us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:11:19.104440 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:11:19.105565 (+ 1125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:11:19.105568 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:11:19.106567 (+ 999us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:11:19.106568 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:11:19.106639 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:19.106662 (+ 23us) client_negotiation.cc:769] Sending connection context
0811 08:11:19.106696 (+ 34us) client_negotiation.cc:240] Negotiation successful
0811 08:11:19.106740 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30}
I20260811 08:11:19.107025 21095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:19.102834 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.195:42441 (local address 127.0.0.1:47024)
0811 08:11:19.103020 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:19.103029 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 08:11:19.103069 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:11:19.103455 (+ 386us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:11:19.103456 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:11:19.103457 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:11:19.103488 (+ 31us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:11:19.103490 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:11:19.104708 (+ 1218us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:11:19.104709 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:11:19.105757 (+ 1048us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:11:19.105759 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:11:19.106824 (+ 1065us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:11:19.106825 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:11:19.106881 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:19.106885 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 08:11:19.106931 (+ 46us) client_negotiation.cc:240] Negotiation successful
0811 08:11:19.106968 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":136,"threads_started":1}
I20260811 08:11:19.107246 21096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:19.103103 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47024 (local address 127.27.243.195:42441)
0811 08:11:19.103251 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0811 08:11:19.103255 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 08:11:19.103264 (+ 9us) server_negotiation.cc:407] Connection header received
0811 08:11:19.103299 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:11:19.103300 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:11:19.103314 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:11:19.103395 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:11:19.103555 (+ 160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:19.104589 (+ 1034us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:19.105837 (+ 1248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:19.106678 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:19.106735 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:19.106791 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 08:11:19.107129 (+ 338us) server_negotiation.cc:299] Negotiation successful
0811 08:11:19.107174 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":118,"thread_start_us":85,"threads_started":1}
I20260811 08:11:19.107386 21093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:19.102854 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51598 (local address 127.27.243.194:44397)
0811 08:11:19.103187 (+ 333us) server_negotiation.cc:206] Beginning negotiation
0811 08:11:19.103192 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 08:11:19.103202 (+ 10us) server_negotiation.cc:407] Connection header received
0811 08:11:19.103239 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:11:19.103242 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:11:19.103257 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:11:19.103336 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:11:19.103498 (+ 162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:19.104345 (+ 847us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:19.105740 (+ 1395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:19.106463 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:19.107179 (+ 716us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:19.107244 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 08:11:19.107269 (+ 25us) server_negotiation.cc:299] Negotiation successful
0811 08:11:19.107312 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":291,"thread_start_us":108,"threads_started":1}
I20260811 08:11:19.107805 20969 tablet_service.cc:1467] Processing CreateTablet for tablet 4db47c347b1d4fb59edc9cb84276424b (DEFAULT_TABLE table=test-table [id=0f1794d16ab04ecfb1ac130095dad692]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:11:19.108105 20969 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4db47c347b1d4fb59edc9cb84276424b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:11:19.108031 20743 tablet_service.cc:1467] Processing CreateTablet for tablet 4db47c347b1d4fb59edc9cb84276424b (DEFAULT_TABLE table=test-table [id=0f1794d16ab04ecfb1ac130095dad692]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:11:19.108377 20743 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4db47c347b1d4fb59edc9cb84276424b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:11:19.110749 21101 tablet_bootstrap.cc:492] T 4db47c347b1d4fb59edc9cb84276424b P 614d9a0fbdbd41a6ba0c6f13d34ee134: Bootstrap starting.
I20260811 08:11:19.110862 21109 tablet_bootstrap.cc:492] T 4db47c347b1d4fb59edc9cb84276424b P d49051f047a54cd9b735792f5afa5f89: Bootstrap starting.
I20260811 08:11:19.111423 21109 tablet_bootstrap.cc:654] T 4db47c347b1d4fb59edc9cb84276424b P d49051f047a54cd9b735792f5afa5f89: Neither blocks nor log segments found. Creating new log.
I20260811 08:11:19.111433 21101 tablet_bootstrap.cc:654] T 4db47c347b1d4fb59edc9cb84276424b P 614d9a0fbdbd41a6ba0c6f13d34ee134: Neither blocks nor log segments found. Creating new log.
I20260811 08:11:19.111867 21101 log.cc:824] T 4db47c347b1d4fb59edc9cb84276424b P 614d9a0fbdbd41a6ba0c6f13d34ee134: Log is configured to *not* fsync() on all Append() calls
I20260811 08:11:19.111902 21109 log.cc:824] T 4db47c347b1d4fb59edc9cb84276424b P d49051f047a54cd9b735792f5afa5f89: Log is configured to *not* fsync() on all Append() calls
I20260811 08:11:19.112555 21101 tablet_bootstrap.cc:492] T 4db47c347b1d4fb59edc9cb84276424b P 614d9a0fbdbd41a6ba0c6f13d34ee134: No bootstrap required, opened a new log
I20260811 08:11:19.112617 21101 ts_tablet_manager.cc:1397] T 4db47c347b1d4fb59edc9cb84276424b P 614d9a0fbdbd41a6ba0c6f13d34ee134: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 08:11:19.113829 21109 tablet_bootstrap.cc:492] T 4db47c347b1d4fb59edc9cb84276424b P d49051f047a54cd9b735792f5afa5f89: No bootstrap required, opened a new log
I20260811 08:11:19.113886 21109 ts_tablet_manager.cc:1397] T 4db47c347b1d4fb59edc9cb84276424b P d49051f047a54cd9b735792f5afa5f89: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260811 08:11:19.113973 21101 raft_consensus.cc:348] T 4db47c347b1d4fb59edc9cb84276424b P 614d9a0fbdbd41a6ba0c6f13d34ee134 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d49051f047a54cd9b735792f5afa5f89" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 44397 } } peers { permanent_uuid: "614d9a0fbdbd41a6ba0c6f13d34ee134" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 42441 } } peers { permanent_uuid: "df7cef473a184c09b626be720c32fbd3" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 46141 } }
I20260811 08:11:19.114097 21101 raft_consensus.cc:374] T 4db47c347b1d4fb59edc9cb84276424b P 614d9a0fbdbd41a6ba0c6f13d34ee134 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:11:19.114128 21101 raft_consensus.cc:729] T 4db47c347b1d4fb59edc9cb84276424b P 614d9a0fbdbd41a6ba0c6f13d34ee134 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 614d9a0fbdbd41a6ba0c6f13d34ee134, State: Initialized, Role: FOLLOWER
I20260811 08:11:19.114240 21101 consensus_queue.cc:260] T 4db47c347b1d4fb59edc9cb84276424b P 614d9a0fbdbd41a6ba0c6f13d34ee134 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d49051f047a54cd9b735792f5afa5f89" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 44397 } } peers { permanent_uuid: "614d9a0fbdbd41a6ba0c6f13d34ee134" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 42441 } } peers { permanent_uuid: "df7cef473a184c09b626be720c32fbd3" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 46141 } }
I20260811 08:11:19.114493 21101 ts_tablet_manager.cc:1428] T 4db47c347b1d4fb59edc9cb84276424b P 614d9a0fbdbd41a6ba0c6f13d34ee134: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260811 08:11:19.114614 21081 heartbeater.cc:503] Master 127.27.243.254:36983 was elected leader, sending a full tablet report...
I20260811 08:11:19.115824 21109 raft_consensus.cc:348] T 4db47c347b1d4fb59edc9cb84276424b P d49051f047a54cd9b735792f5afa5f89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d49051f047a54cd9b735792f5afa5f89" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 44397 } } peers { permanent_uuid: "614d9a0fbdbd41a6ba0c6f13d34ee134" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 42441 } } peers { permanent_uuid: "df7cef473a184c09b626be720c32fbd3" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 46141 } }
I20260811 08:11:19.115943 21109 raft_consensus.cc:374] T 4db47c347b1d4fb59edc9cb84276424b P d49051f047a54cd9b735792f5afa5f89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:11:19.115963 21109 raft_consensus.cc:729] T 4db47c347b1d4fb59edc9cb84276424b P d49051f047a54cd9b735792f5afa5f89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d49051f047a54cd9b735792f5afa5f89, State: Initialized, Role: FOLLOWER
I20260811 08:11:19.116039 21109 consensus_queue.cc:260] T 4db47c347b1d4fb59edc9cb84276424b P d49051f047a54cd9b735792f5afa5f89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d49051f047a54cd9b735792f5afa5f89" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 44397 } } peers { permanent_uuid: "614d9a0fbdbd41a6ba0c6f13d34ee134" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 42441 } } peers { permanent_uuid: "df7cef473a184c09b626be720c32fbd3" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 46141 } }
I20260811 08:11:19.116230 21109 ts_tablet_manager.cc:1428] T 4db47c347b1d4fb59edc9cb84276424b P d49051f047a54cd9b735792f5afa5f89: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 08:11:19.116309 20846 heartbeater.cc:503] Master 127.27.243.254:36983 was elected leader, sending a full tablet report...
W20260811 08:11:19.191541 20847 tablet.cc:2369] T 4db47c347b1d4fb59edc9cb84276424b P d49051f047a54cd9b735792f5afa5f89: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 08:11:19.280136 21113 raft_consensus.cc:482] T 4db47c347b1d4fb59edc9cb84276424b P 614d9a0fbdbd41a6ba0c6f13d34ee134 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:11:19.280272 21113 raft_consensus.cc:504] T 4db47c347b1d4fb59edc9cb84276424b P 614d9a0fbdbd41a6ba0c6f13d34ee134 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d49051f047a54cd9b735792f5afa5f89" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 44397 } } peers { permanent_uuid: "614d9a0fbdbd41a6ba0c6f13d34ee134" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 42441 } } peers { permanent_uuid: "df7cef473a184c09b626be720c32fbd3" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 46141 } }
I20260811 08:11:19.280640 21113 leader_election.cc:288] T 4db47c347b1d4fb59edc9cb84276424b P 614d9a0fbdbd41a6ba0c6f13d34ee134 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d49051f047a54cd9b735792f5afa5f89 (127.27.243.194:44397), df7cef473a184c09b626be720c32fbd3 (127.27.243.193:46141)
I20260811 08:11:19.284588 21093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:19.280989 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.195:40389 (local address 127.27.243.194:44397)
0811 08:11:19.281061 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0811 08:11:19.281063 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:11:19.281074 (+ 11us) server_negotiation.cc:407] Connection header received
0811 08:11:19.281109 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:11:19.281110 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:11:19.281121 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:11:19.281187 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:11:19.281355 (+ 168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:19.282144 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:19.283598 (+ 1454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:19.284212 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:19.284302 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:19.284312 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 08:11:19.284475 (+ 163us) server_negotiation.cc:299] Negotiation successful
0811 08:11:19.284513 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 08:11:19.284590 20633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:19.281075 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.195:49627 (local address 127.27.243.193:46141)
0811 08:11:19.281123 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 08:11:19.281125 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:11:19.281245 (+ 120us) server_negotiation.cc:407] Connection header received
0811 08:11:19.281277 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:11:19.281278 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:11:19.281312 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:11:19.281387 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:11:19.281506 (+ 119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:19.282248 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:19.283598 (+ 1350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:19.284226 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:19.284307 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:19.284386 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 08:11:19.284467 (+ 81us) server_negotiation.cc:299] Negotiation successful
0811 08:11:19.284513 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 08:11:19.284627 21090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:19.280827 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.194:44397 (local address 127.27.243.195:40389)
0811 08:11:19.280903 (+ 76us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:19.280918 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 08:11:19.280984 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:11:19.281210 (+ 226us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:11:19.281212 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:11:19.281214 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:11:19.281290 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:11:19.281292 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:11:19.282221 (+ 929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:11:19.282222 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:11:19.283501 (+ 1279us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:11:19.283504 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:11:19.284304 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:11:19.284304 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:11:19.284403 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:19.284405 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 08:11:19.284459 (+ 54us) client_negotiation.cc:240] Negotiation successful
0811 08:11:19.284514 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":46,"mutex_wait_us":68}
I20260811 08:11:19.284633 21118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:19.280979 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.193:46141 (local address 127.27.243.195:49627)
0811 08:11:19.281164 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:19.281174 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 08:11:19.281231 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:11:19.281395 (+ 164us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:11:19.281395 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:11:19.281396 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:11:19.281445 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:11:19.281446 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:11:19.282324 (+ 878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:11:19.282325 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:11:19.283501 (+ 1176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:11:19.283504 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:11:19.284309 (+ 805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:11:19.284310 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:11:19.284400 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:19.284405 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 08:11:19.284459 (+ 54us) client_negotiation.cc:240] Negotiation successful
0811 08:11:19.284515 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":167,"mutex_wait_us":13,"thread_start_us":110,"threads_started":1}
I20260811 08:11:19.285003 20770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4db47c347b1d4fb59edc9cb84276424b" candidate_uuid: "614d9a0fbdbd41a6ba0c6f13d34ee134" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d49051f047a54cd9b735792f5afa5f89" is_pre_election: true
I20260811 08:11:19.285006 20530 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4db47c347b1d4fb59edc9cb84276424b" candidate_uuid: "614d9a0fbdbd41a6ba0c6f13d34ee134" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df7cef473a184c09b626be720c32fbd3" is_pre_election: true
I20260811 08:11:19.285172 20530 raft_consensus.cc:2454] T 4db47c347b1d4fb59edc9cb84276424b P df7cef473a184c09b626be720c32fbd3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 614d9a0fbdbd41a6ba0c6f13d34ee134 in term 0.
I20260811 08:11:19.285172 20770 raft_consensus.cc:2454] T 4db47c347b1d4fb59edc9cb84276424b P d49051f047a54cd9b735792f5afa5f89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 614d9a0fbdbd41a6ba0c6f13d34ee134 in term 0.
I20260811 08:11:19.285408 20889 leader_election.cc:302] T 4db47c347b1d4fb59edc9cb84276424b P 614d9a0fbdbd41a6ba0c6f13d34ee134 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 614d9a0fbdbd41a6ba0c6f13d34ee134, df7cef473a184c09b626be720c32fbd3; no voters:
I20260811 08:11:19.285557 21113 raft_consensus.cc:2781] T 4db47c347b1d4fb59edc9cb84276424b P 614d9a0fbdbd41a6ba0c6f13d34ee134 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 08:11:19.285619 21113 raft_consensus.cc:482] T 4db47c347b1d4fb59edc9cb84276424b P 614d9a0fbdbd41a6ba0c6f13d34ee134 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 08:11:19.285653 21113 raft_consensus.cc:3037] T 4db47c347b1d4fb59edc9cb84276424b P 614d9a0fbdbd41a6ba0c6f13d34ee134 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:11:19.286412 21113 raft_consensus.cc:504] T 4db47c347b1d4fb59edc9cb84276424b P 614d9a0fbdbd41a6ba0c6f13d34ee134 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d49051f047a54cd9b735792f5afa5f89" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 44397 } } peers { permanent_uuid: "614d9a0fbdbd41a6ba0c6f13d34ee134" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 42441 } } peers { permanent_uuid: "df7cef473a184c09b626be720c32fbd3" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 46141 } }
I20260811 08:11:19.286533 21113 leader_election.cc:288] T 4db47c347b1d4fb59edc9cb84276424b P 614d9a0fbdbd41a6ba0c6f13d34ee134 [CANDIDATE]: Term 1 election: Requested vote from peers d49051f047a54cd9b735792f5afa5f89 (127.27.243.194:44397), df7cef473a184c09b626be720c32fbd3 (127.27.243.193:46141)
I20260811 08:11:19.286713 20770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4db47c347b1d4fb59edc9cb84276424b" candidate_uuid: "614d9a0fbdbd41a6ba0c6f13d34ee134" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d49051f047a54cd9b735792f5afa5f89"
I20260811 08:11:19.286758 20530 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4db47c347b1d4fb59edc9cb84276424b" candidate_uuid: "614d9a0fbdbd41a6ba0c6f13d34ee134" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df7cef473a184c09b626be720c32fbd3"
I20260811 08:11:19.286803 20770 raft_consensus.cc:3037] T 4db47c347b1d4fb59edc9cb84276424b P d49051f047a54cd9b735792f5afa5f89 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:11:19.286840 20530 raft_consensus.cc:3037] T 4db47c347b1d4fb59edc9cb84276424b P df7cef473a184c09b626be720c32fbd3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:11:19.287542 20770 raft_consensus.cc:2454] T 4db47c347b1d4fb59edc9cb84276424b P d49051f047a54cd9b735792f5afa5f89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 614d9a0fbdbd41a6ba0c6f13d34ee134 in term 1.
I20260811 08:11:19.287568 20530 raft_consensus.cc:2454] T 4db47c347b1d4fb59edc9cb84276424b P df7cef473a184c09b626be720c32fbd3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 614d9a0fbdbd41a6ba0c6f13d34ee134 in term 1.
I20260811 08:11:19.287711 20889 leader_election.cc:302] T 4db47c347b1d4fb59edc9cb84276424b P 614d9a0fbdbd41a6ba0c6f13d34ee134 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 614d9a0fbdbd41a6ba0c6f13d34ee134, df7cef473a184c09b626be720c32fbd3; no voters:
I20260811 08:11:19.287806 21113 raft_consensus.cc:2781] T 4db47c347b1d4fb59edc9cb84276424b P 614d9a0fbdbd41a6ba0c6f13d34ee134 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:11:19.287976 21113 raft_consensus.cc:686] T 4db47c347b1d4fb59edc9cb84276424b P 614d9a0fbdbd41a6ba0c6f13d34ee134 [term 1 LEADER]: Becoming Leader. State: Replica: 614d9a0fbdbd41a6ba0c6f13d34ee134, State: Running, Role: LEADER
I20260811 08:11:19.288069 21113 consensus_queue.cc:237] T 4db47c347b1d4fb59edc9cb84276424b P 614d9a0fbdbd41a6ba0c6f13d34ee134 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d49051f047a54cd9b735792f5afa5f89" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 44397 } } peers { permanent_uuid: "614d9a0fbdbd41a6ba0c6f13d34ee134" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 42441 } } peers { permanent_uuid: "df7cef473a184c09b626be720c32fbd3" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 46141 } }
I20260811 08:11:19.288978 20274 catalog_manager.cc:5495] T 4db47c347b1d4fb59edc9cb84276424b P 614d9a0fbdbd41a6ba0c6f13d34ee134 reported cstate change: term changed from 0 to 1, leader changed from <none> to 614d9a0fbdbd41a6ba0c6f13d34ee134 (127.27.243.195). New cstate: current_term: 1 leader_uuid: "614d9a0fbdbd41a6ba0c6f13d34ee134" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d49051f047a54cd9b735792f5afa5f89" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 44397 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "614d9a0fbdbd41a6ba0c6f13d34ee134" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 42441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df7cef473a184c09b626be720c32fbd3" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 46141 } health_report { overall_health: UNKNOWN } } }
W20260811 08:11:19.308938 20619 tablet.cc:2369] T 4db47c347b1d4fb59edc9cb84276424b P df7cef473a184c09b626be720c32fbd3: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 08:11:19.328796 21082 tablet.cc:2369] T 4db47c347b1d4fb59edc9cb84276424b P 614d9a0fbdbd41a6ba0c6f13d34ee134: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 08:11:19.331667 21096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:19.329389 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47034 (local address 127.27.243.195:42441)
0811 08:11:19.329442 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 08:11:19.329444 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:11:19.329452 (+ 8us) server_negotiation.cc:407] Connection header received
0811 08:11:19.329544 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:11:19.329545 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:11:19.329567 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:11:19.329628 (+ 61us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:11:19.329736 (+ 108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:19.330232 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:19.330958 (+ 726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:19.331151 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:19.331205 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:19.331365 (+ 160us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:11:19.331466 (+ 101us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:11:19.331534 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 08:11:19.331571 (+ 37us) server_negotiation.cc:299] Negotiation successful
0811 08:11:19.331593 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 08:11:19.333460 20530 raft_consensus.cc:1261] T 4db47c347b1d4fb59edc9cb84276424b P df7cef473a184c09b626be720c32fbd3 [term 1 FOLLOWER]: Refusing update from remote peer 614d9a0fbdbd41a6ba0c6f13d34ee134: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:11:19.333460 20770 raft_consensus.cc:1261] T 4db47c347b1d4fb59edc9cb84276424b P d49051f047a54cd9b735792f5afa5f89 [term 1 FOLLOWER]: Refusing update from remote peer 614d9a0fbdbd41a6ba0c6f13d34ee134: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:11:19.334097 21119 consensus_queue.cc:1035] T 4db47c347b1d4fb59edc9cb84276424b P 614d9a0fbdbd41a6ba0c6f13d34ee134 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df7cef473a184c09b626be720c32fbd3" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 46141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:11:19.334313 21113 consensus_queue.cc:1035] T 4db47c347b1d4fb59edc9cb84276424b P 614d9a0fbdbd41a6ba0c6f13d34ee134 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d49051f047a54cd9b735792f5afa5f89" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 44397 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:11:19.339638 20274 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:60982:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:11:19.339722 20274 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:60982:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:11:19.340426 20274 catalog_manager.cc:5782] T 00000000000000000000000000000000 P bd73426cb34b437a86d301635b77f500: Sending DeleteTablet for 3 replicas of tablet 4db47c347b1d4fb59edc9cb84276424b
I20260811 08:11:19.340796 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 20340
I20260811 08:11:19.340768 20969 tablet_service.cc:1514] Processing DeleteTablet for tablet 4db47c347b1d4fb59edc9cb84276424b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:11:19 UTC) from {username='kudu', principal='kudu/127.27.243.254@KRBTEST.COM'} at 127.0.0.1:47024
I20260811 08:11:19.340723 20743 tablet_service.cc:1514] Processing DeleteTablet for tablet 4db47c347b1d4fb59edc9cb84276424b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:11:19 UTC) from {username='kudu', principal='kudu/127.27.243.254@KRBTEST.COM'} at 127.0.0.1:51598
I20260811 08:11:19.356973 21149 tablet_replica.cc:330] T 4db47c347b1d4fb59edc9cb84276424b P 614d9a0fbdbd41a6ba0c6f13d34ee134: stopping tablet replica
I20260811 08:11:19.357177 21151 tablet_replica.cc:330] T 4db47c347b1d4fb59edc9cb84276424b P d49051f047a54cd9b735792f5afa5f89: stopping tablet replica
I20260811 08:11:19.357362 21151 raft_consensus.cc:2229] T 4db47c347b1d4fb59edc9cb84276424b P d49051f047a54cd9b735792f5afa5f89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:11:19.357550 21149 raft_consensus.cc:2229] T 4db47c347b1d4fb59edc9cb84276424b P 614d9a0fbdbd41a6ba0c6f13d34ee134 [term 1 LEADER]: Raft consensus shutting down.
I20260811 08:11:19.357738 21151 raft_consensus.cc:2258] T 4db47c347b1d4fb59edc9cb84276424b P d49051f047a54cd9b735792f5afa5f89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:11:19.357931 21149 raft_consensus.cc:2258] T 4db47c347b1d4fb59edc9cb84276424b P 614d9a0fbdbd41a6ba0c6f13d34ee134 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:11:19.360553 21149 ts_tablet_manager.cc:1905] T 4db47c347b1d4fb59edc9cb84276424b P 614d9a0fbdbd41a6ba0c6f13d34ee134: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:11:19.362409 21149 ts_tablet_manager.cc:1918] T 4db47c347b1d4fb59edc9cb84276424b P 614d9a0fbdbd41a6ba0c6f13d34ee134: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:11:19.362550 21149 log.cc:1196] T 4db47c347b1d4fb59edc9cb84276424b P 614d9a0fbdbd41a6ba0c6f13d34ee134: Deleting WAL directory at /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-2/wal/wals/4db47c347b1d4fb59edc9cb84276424b
I20260811 08:11:19.362952 21149 ts_tablet_manager.cc:1939] T 4db47c347b1d4fb59edc9cb84276424b P 614d9a0fbdbd41a6ba0c6f13d34ee134: Deleting consensus metadata
I20260811 08:11:19.364853 21151 ts_tablet_manager.cc:1905] T 4db47c347b1d4fb59edc9cb84276424b P d49051f047a54cd9b735792f5afa5f89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:11:19.366210 21151 ts_tablet_manager.cc:1918] T 4db47c347b1d4fb59edc9cb84276424b P d49051f047a54cd9b735792f5afa5f89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:11:19.366359 21151 log.cc:1196] T 4db47c347b1d4fb59edc9cb84276424b P d49051f047a54cd9b735792f5afa5f89: Deleting WAL directory at /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-1/wal/wals/4db47c347b1d4fb59edc9cb84276424b
I20260811 08:11:19.366684 21151 ts_tablet_manager.cc:1939] T 4db47c347b1d4fb59edc9cb84276424b P d49051f047a54cd9b735792f5afa5f89: Deleting consensus metadata
I20260811 08:11:19.367208 20258 catalog_manager.cc:4841] TS d49051f047a54cd9b735792f5afa5f89 (127.27.243.194:44397): tablet 4db47c347b1d4fb59edc9cb84276424b (table test-table [id=0f1794d16ab04ecfb1ac130095dad692]) successfully deleted
I20260811 08:11:19.369982 20258 catalog_manager.cc:4841] TS 614d9a0fbdbd41a6ba0c6f13d34ee134 (127.27.243.195:42441): tablet 4db47c347b1d4fb59edc9cb84276424b (table test-table [id=0f1794d16ab04ecfb1ac130095dad692]) successfully deleted
W20260811 08:11:19.375514 20258 connection.cc:535] client connection to 127.27.243.193:46141 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260811 08:11:19.375613 20258 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260811 08:11:19.375736 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 20630
I20260811 08:11:19.381320 21095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:19.381170 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.193:46141 (local address 127.0.0.1:37578)
0811 08:11:19.381232 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:19.381277 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.193:46141: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260811 08:11:19.385154 20258 catalog_manager.cc:4584] TS df7cef473a184c09b626be720c32fbd3 (127.27.243.193:46141): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 4db47c347b1d4fb59edc9cb84276424b: Network error: Client connection negotiation failed: client connection to 127.27.243.193:46141: connect: Connection refused (error 111)
I20260811 08:11:19.395891 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 20853
I20260811 08:11:19.406740 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 20226
I20260811 08:11:19.419281 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.243.254:36983
--webserver_interface=127.27.243.254
--webserver_port=34105
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab
--principal=kudu/127.27.243.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:42189
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.243.254:36983
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:11:19.500636 21153 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:11:19.500831 21153 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:11:19.500851 21153 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:11:19.501978 21153 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:11:19.502017 21153 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:11:19.502030 21153 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:11:19.502053 21153 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:11:19.502076 21153 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:11:19.503530 21153 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:42189
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.243.254:36983
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab
--principal=kudu/127.27.243.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.243.254:36983
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.243.254
--webserver_port=34105
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21153
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:11:19.503759 21153 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:11:19.503993 21153 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:11:19.508630 21162 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:11:19.508620 21165 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:11:19.508715 21153 server_base.cc:1034] running on GCE node
W20260811 08:11:19.508621 21160 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:11:19.509016 21153 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:11:19.509274 21153 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:11:19.510396 21153 hybrid_clock.cc:648] HybridClock initialized: now 1786435879510386 us; error 26 us; skew 500 ppm
Aug 11 08:11:19 dist-test-slave-7lbf krb5kdc[19274](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435879, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:11:19.512669 21153 init.cc:377] Logged in from keytab as kudu/127.27.243.254@KRBTEST.COM (short username kudu)
I20260811 08:11:19.513057 21153 webserver.cc:460] Webserver started at http://127.27.243.254:34105/ using document root <none> and password file <none>
I20260811 08:11:19.513284 21153 fs_manager.cc:359] Metadata directory not provided
I20260811 08:11:19.513335 21153 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:11:19.514654 21153 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:11:19.515218 21174 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:11:19.515378 21153 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 08:11:19.515460 21153 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/master-0/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/master-0/wal
uuid: "bd73426cb34b437a86d301635b77f500"
format_stamp: "Formatted at 2026-08-11 08:11:17 on dist-test-slave-7lbf"
server_key: "a7731215e900a0fd7eb920c5751fb10c"
server_key_iv: "38f49e16ab948135b39bcf47749bfb31"
server_key_version: "encryptionkey@0"
I20260811 08:11:19.515765 21153 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:11:19.539067 21153 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:11:19.541064 21153 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:11:19.541181 21153 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:11:19.545158 21153 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.254:36983
I20260811 08:11:19.545204 21261 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.254:36983 every 8 connection(s)
I20260811 08:11:19.545637 21153 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
I20260811 08:11:19.547310 21264 sys_catalog.cc:263] Verifying existing consensus state
I20260811 08:11:19.547999 21264 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bd73426cb34b437a86d301635b77f500: Bootstrap starting.
I20260811 08:11:19.554492 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 21153
I20260811 08:11:19.554888 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.243.193:46141
--local_ip_for_outbound_sockets=127.27.243.193
--tserver_master_addrs=127.27.243.254:36983
--webserver_port=38457
--webserver_interface=127.27.243.193
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.193.keytab
--principal=kudu/127.27.243.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:42189
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 08:11:19.557687 21264 log.cc:824] T 00000000000000000000000000000000 P bd73426cb34b437a86d301635b77f500: Log is configured to *not* fsync() on all Append() calls
I20260811 08:11:19.560153 21264 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bd73426cb34b437a86d301635b77f500: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 08:11:19.560464 21264 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bd73426cb34b437a86d301635b77f500: Bootstrap complete.
I20260811 08:11:19.562675 21264 raft_consensus.cc:348] T 00000000000000000000000000000000 P bd73426cb34b437a86d301635b77f500 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd73426cb34b437a86d301635b77f500" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 36983 } }
I20260811 08:11:19.562917 21264 raft_consensus.cc:729] T 00000000000000000000000000000000 P bd73426cb34b437a86d301635b77f500 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd73426cb34b437a86d301635b77f500, State: Initialized, Role: FOLLOWER
I20260811 08:11:19.563071 21264 consensus_queue.cc:260] T 00000000000000000000000000000000 P bd73426cb34b437a86d301635b77f500 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd73426cb34b437a86d301635b77f500" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 36983 } }
I20260811 08:11:19.563139 21264 raft_consensus.cc:388] T 00000000000000000000000000000000 P bd73426cb34b437a86d301635b77f500 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:11:19.563194 21264 raft_consensus.cc:482] T 00000000000000000000000000000000 P bd73426cb34b437a86d301635b77f500 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:11:19.563244 21264 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bd73426cb34b437a86d301635b77f500 [term 2 FOLLOWER]: Advancing to term 3
I20260811 08:11:19.564289 21264 raft_consensus.cc:504] T 00000000000000000000000000000000 P bd73426cb34b437a86d301635b77f500 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd73426cb34b437a86d301635b77f500" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 36983 } }
I20260811 08:11:19.564389 21264 leader_election.cc:302] T 00000000000000000000000000000000 P bd73426cb34b437a86d301635b77f500 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bd73426cb34b437a86d301635b77f500; no voters:
I20260811 08:11:19.564559 21264 leader_election.cc:288] T 00000000000000000000000000000000 P bd73426cb34b437a86d301635b77f500 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260811 08:11:19.564615 21270 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bd73426cb34b437a86d301635b77f500 [term 3 FOLLOWER]: Leader election won for term 3
I20260811 08:11:19.564749 21270 raft_consensus.cc:686] T 00000000000000000000000000000000 P bd73426cb34b437a86d301635b77f500 [term 3 LEADER]: Becoming Leader. State: Replica: bd73426cb34b437a86d301635b77f500, State: Running, Role: LEADER
I20260811 08:11:19.564847 21264 sys_catalog.cc:564] T 00000000000000000000000000000000 P bd73426cb34b437a86d301635b77f500 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:11:19.564853 21270 consensus_queue.cc:237] T 00000000000000000000000000000000 P bd73426cb34b437a86d301635b77f500 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd73426cb34b437a86d301635b77f500" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 36983 } }
I20260811 08:11:19.565248 21272 sys_catalog.cc:455] T 00000000000000000000000000000000 P bd73426cb34b437a86d301635b77f500 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "bd73426cb34b437a86d301635b77f500" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd73426cb34b437a86d301635b77f500" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 36983 } } }
I20260811 08:11:19.565263 21271 sys_catalog.cc:455] T 00000000000000000000000000000000 P bd73426cb34b437a86d301635b77f500 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bd73426cb34b437a86d301635b77f500. Latest consensus state: current_term: 3 leader_uuid: "bd73426cb34b437a86d301635b77f500" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd73426cb34b437a86d301635b77f500" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 36983 } } }
I20260811 08:11:19.565433 21272 sys_catalog.cc:458] T 00000000000000000000000000000000 P bd73426cb34b437a86d301635b77f500 [sys.catalog]: This master's current role is: LEADER
I20260811 08:11:19.565451 21271 sys_catalog.cc:458] T 00000000000000000000000000000000 P bd73426cb34b437a86d301635b77f500 [sys.catalog]: This master's current role is: LEADER
I20260811 08:11:19.565770 21286 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:11:19.566668 21286 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:11:19.566922 21286 catalog_manager.cc:1259] Loaded cluster ID: 247c66e5453342528ccf00e3d0280724
I20260811 08:11:19.567070 21286 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260811 08:11:19.567315 21286 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f41478a69ad google::LogMessage::Fail() at ??:0
@ 0x7f41478a988a google::LogMessage::SendToLog() at ??:0
@ 0x7f41478a64de google::LogMessage::Flush() at ??:0
@ 0x7f41478a7a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f414f7cb0f1 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7f414f7d48b9 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f41497740d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f4149769954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f414a5cd6db start_thread at ??:0
@ 0x7f41463a461f clone at ??:0
W20260811 08:11:19.652017 21267 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:11:19.652226 21267 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:11:19.652248 21267 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:11:19.653422 21267 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:11:19.653465 21267 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:11:19.653491 21267 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.243.193
I20260811 08:11:19.654994 21267 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:42189
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.193.keytab
--principal=kudu/127.27.243.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.243.193:46141
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.243.193
--webserver_port=38457
--tserver_master_addrs=127.27.243.254:36983
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21267
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.243.193
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:11:19.655229 21267 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:11:19.655455 21267 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:11:19.661325 21319 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:11:19.661353 21324 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:11:19.661492 21320 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:11:19.661473 21267 server_base.cc:1034] running on GCE node
I20260811 08:11:19.661790 21267 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:11:19.662076 21267 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:11:19.663261 21267 hybrid_clock.cc:648] HybridClock initialized: now 1786435879663236 us; error 37 us; skew 500 ppm
Aug 11 08:11:19 dist-test-slave-7lbf krb5kdc[19274](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435879, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:11:19.666491 21267 init.cc:377] Logged in from keytab as kudu/127.27.243.193@KRBTEST.COM (short username kudu)
I20260811 08:11:19.667034 21267 webserver.cc:460] Webserver started at http://127.27.243.193:38457/ using document root <none> and password file <none>
I20260811 08:11:19.667325 21267 fs_manager.cc:359] Metadata directory not provided
I20260811 08:11:19.667390 21267 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:11:19.669169 21267 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.001s
I20260811 08:11:19.670043 21338 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:11:19.670228 21267 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 08:11:19.670339 21267 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-0/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-0/wal
uuid: "df7cef473a184c09b626be720c32fbd3"
format_stamp: "Formatted at 2026-08-11 08:11:17 on dist-test-slave-7lbf"
server_key: "009aabc7e264d21f6a56743046dd70d1"
server_key_iv: "8be0cd46d25a4424c53d90dd1f906451"
server_key_version: "encryptionkey@0"
I20260811 08:11:19.670849 21267 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:11:19.686959 21267 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:11:19.689553 21267 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:11:19.689713 21267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:11:19.689973 21267 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:11:19.690500 21348 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260811 08:11:19.692044 21267 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260811 08:11:19.692107 21267 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260811 08:11:19.692142 21267 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260811 08:11:19.693007 21267 ts_tablet_manager.cc:610] Registered 1 tablets
I20260811 08:11:19.693061 21267 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260811 08:11:19.693125 21348 tablet_bootstrap.cc:492] T 4db47c347b1d4fb59edc9cb84276424b P df7cef473a184c09b626be720c32fbd3: Bootstrap starting.
I20260811 08:11:19.699990 21267 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.193:46141
I20260811 08:11:19.700074 21525 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.193:46141 every 8 connection(s)
I20260811 08:11:19.700438 21267 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-0/data/info.pb
I20260811 08:11:19.701476 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 21267
I20260811 08:11:19.701797 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.243.194:44397
--local_ip_for_outbound_sockets=127.27.243.194
--tserver_master_addrs=127.27.243.254:36983
--webserver_port=36931
--webserver_interface=127.27.243.194
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.194.keytab
--principal=kudu/127.27.243.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:42189
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 08:11:19.703735 21348 log.cc:824] T 4db47c347b1d4fb59edc9cb84276424b P df7cef473a184c09b626be720c32fbd3: Log is configured to *not* fsync() on all Append() calls
I20260811 08:11:19.705874 21348 tablet_bootstrap.cc:492] T 4db47c347b1d4fb59edc9cb84276424b P df7cef473a184c09b626be720c32fbd3: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 08:11:19.706143 21348 tablet_bootstrap.cc:492] T 4db47c347b1d4fb59edc9cb84276424b P df7cef473a184c09b626be720c32fbd3: Bootstrap complete.
I20260811 08:11:19.707288 21348 ts_tablet_manager.cc:1397] T 4db47c347b1d4fb59edc9cb84276424b P df7cef473a184c09b626be720c32fbd3: Time spent bootstrapping tablet: real 0.014s user 0.004s sys 0.008s
I20260811 08:11:19.708664 21348 raft_consensus.cc:348] T 4db47c347b1d4fb59edc9cb84276424b P df7cef473a184c09b626be720c32fbd3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d49051f047a54cd9b735792f5afa5f89" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 44397 } } peers { permanent_uuid: "614d9a0fbdbd41a6ba0c6f13d34ee134" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 42441 } } peers { permanent_uuid: "df7cef473a184c09b626be720c32fbd3" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 46141 } }
I20260811 08:11:19.709004 21348 raft_consensus.cc:729] T 4db47c347b1d4fb59edc9cb84276424b P df7cef473a184c09b626be720c32fbd3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: df7cef473a184c09b626be720c32fbd3, State: Initialized, Role: FOLLOWER
I20260811 08:11:19.709175 21348 consensus_queue.cc:260] T 4db47c347b1d4fb59edc9cb84276424b P df7cef473a184c09b626be720c32fbd3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d49051f047a54cd9b735792f5afa5f89" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 44397 } } peers { permanent_uuid: "614d9a0fbdbd41a6ba0c6f13d34ee134" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 42441 } } peers { permanent_uuid: "df7cef473a184c09b626be720c32fbd3" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 46141 } }
I20260811 08:11:19.709444 21348 ts_tablet_manager.cc:1428] T 4db47c347b1d4fb59edc9cb84276424b P df7cef473a184c09b626be720c32fbd3: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
W20260811 08:11:19.762311 21531 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:11:19.701142 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36983 (local address 127.27.243.193:34831)
0811 08:11:19.701699 (+ 557us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:19.701749 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0811 08:11:19.702659 (+ 910us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:11:19.762095 (+ 59436us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:36983: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":506,"thread_start_us":102,"threads_started":1}
W20260811 08:11:19.762580 21528 heartbeater.cc:644] Failed to heartbeat to 127.27.243.254:36983 (0 consecutive failures): Network error: Failed to ping master at 127.27.243.254:36983: Client connection negotiation failed: client connection to 127.27.243.254:36983: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260811 08:11:19.762959 21531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:19.762813 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36983 (local address 127.27.243.193:40313)
0811 08:11:19.762867 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:19.762927 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:36983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
I20260811 08:11:19.763303 21531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:19.763212 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36983 (local address 127.27.243.193:33395)
0811 08:11:19.763256 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:19.763284 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:36983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260811 08:11:19.763422 21528 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 08:11:19.788112 21532 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:11:19.788314 21532 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:11:19.788337 21532 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:11:19.789482 21532 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:11:19.789556 21532 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:11:19.789603 21532 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.243.194
I20260811 08:11:19.791064 21532 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:42189
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.194.keytab
--principal=kudu/127.27.243.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.243.194:44397
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.243.194
--webserver_port=36931
--tserver_master_addrs=127.27.243.254:36983
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21532
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.243.194
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:11:19.791278 21532 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:11:19.791486 21532 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:11:19.796221 21543 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:11:19.796236 21544 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:11:19.796439 21532 server_base.cc:1034] running on GCE node
W20260811 08:11:19.796236 21547 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:11:19.796746 21532 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:11:19.796968 21532 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:11:19.798103 21532 hybrid_clock.cc:648] HybridClock initialized: now 1786435879798090 us; error 30 us; skew 500 ppm
Aug 11 08:11:19 dist-test-slave-7lbf krb5kdc[19274](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435879, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:11:19.800541 21532 init.cc:377] Logged in from keytab as kudu/127.27.243.194@KRBTEST.COM (short username kudu)
I20260811 08:11:19.800978 21532 webserver.cc:460] Webserver started at http://127.27.243.194:36931/ using document root <none> and password file <none>
I20260811 08:11:19.801178 21532 fs_manager.cc:359] Metadata directory not provided
I20260811 08:11:19.801227 21532 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:11:19.802618 21532 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:11:19.803265 21556 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:11:19.803418 21532 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 08:11:19.803503 21532 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-1/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-1/wal
uuid: "d49051f047a54cd9b735792f5afa5f89"
format_stamp: "Formatted at 2026-08-11 08:11:18 on dist-test-slave-7lbf"
server_key: "d58cbd06d96b4f4ce0e65b6494e7f726"
server_key_iv: "bd421cfde3debe9a3b0ae3cc28e33e31"
server_key_version: "encryptionkey@0"
I20260811 08:11:19.803867 21532 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:11:19.813129 21532 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:11:19.815245 21532 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:11:19.815378 21532 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:11:19.815598 21532 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:11:19.815897 21532 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:11:19.815934 21532 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:11:19.815959 21532 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:11:19.815987 21532 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:11:19.822346 21532 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.194:44397
I20260811 08:11:19.822384 21749 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.194:44397 every 8 connection(s)
I20260811 08:11:19.822706 21532 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-1/data/info.pb
I20260811 08:11:19.823686 21753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:19.823350 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36983 (local address 127.27.243.194:59523)
0811 08:11:19.823487 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:19.823557 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:36983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":72,"threads_started":1}
W20260811 08:11:19.824021 21750 heartbeater.cc:644] Failed to heartbeat to 127.27.243.254:36983 (0 consecutive failures): Network error: Failed to ping master at 127.27.243.254:36983: Client connection negotiation failed: client connection to 127.27.243.254:36983: connect: Connection refused (error 111)
I20260811 08:11:19.824265 21753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:19.824187 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36983 (local address 127.27.243.194:49081)
0811 08:11:19.824224 (+ 37us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:19.824249 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:36983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
I20260811 08:11:19.824489 21753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:19.824426 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36983 (local address 127.27.243.194:43453)
0811 08:11:19.824460 (+ 34us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:19.824478 (+ 18us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:36983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
W20260811 08:11:19.824569 21750 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 08:11:19.829236 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 21532
I20260811 08:11:19.829553 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.243.195:42441
--local_ip_for_outbound_sockets=127.27.243.195
--tserver_master_addrs=127.27.243.254:36983
--webserver_port=39019
--webserver_interface=127.27.243.195
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.195.keytab
--principal=kudu/127.27.243.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:42189
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:11:19.912940 21754 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:11:19.913137 21754 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:11:19.913159 21754 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:11:19.914314 21754 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:11:19.914354 21754 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:11:19.914378 21754 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.243.195
I20260811 08:11:19.915798 21754 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:42189
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.195.keytab
--principal=kudu/127.27.243.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.243.195:42441
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.243.195
--webserver_port=39019
--tserver_master_addrs=127.27.243.254:36983
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21754
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.243.195
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:11:19.916011 21754 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:11:19.916211 21754 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:11:19.921011 21761 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:11:19.921082 21754 server_base.cc:1034] running on GCE node
W20260811 08:11:19.921022 21760 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:11:19.921025 21765 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:11:19.921408 21754 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:11:19.921655 21754 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:11:19.922797 21754 hybrid_clock.cc:648] HybridClock initialized: now 1786435879922785 us; error 27 us; skew 500 ppm
Aug 11 08:11:19 dist-test-slave-7lbf krb5kdc[19274](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435879, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:11:19.925381 21754 init.cc:377] Logged in from keytab as kudu/127.27.243.195@KRBTEST.COM (short username kudu)
I20260811 08:11:19.925848 21754 webserver.cc:460] Webserver started at http://127.27.243.195:39019/ using document root <none> and password file <none>
I20260811 08:11:19.926060 21754 fs_manager.cc:359] Metadata directory not provided
I20260811 08:11:19.926105 21754 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:11:19.927377 21754 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 08:11:19.927917 21774 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:11:19.928072 21754 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 08:11:19.928150 21754 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-2/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-2/wal
uuid: "614d9a0fbdbd41a6ba0c6f13d34ee134"
format_stamp: "Formatted at 2026-08-11 08:11:18 on dist-test-slave-7lbf"
server_key: "fadded36b81c57c4cae32c21164d8ed8"
server_key_iv: "def5b0a493b6d893ab36423df8f0f2b1"
server_key_version: "encryptionkey@0"
I20260811 08:11:19.928493 21754 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:11:19.936170 21754 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:11:19.938184 21754 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:11:19.938333 21754 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:11:19.938555 21754 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:11:19.938853 21754 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:11:19.938889 21754 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:11:19.938916 21754 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:11:19.938934 21754 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:11:19.945070 21754 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.195:42441
I20260811 08:11:19.945108 21976 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.195:42441 every 8 connection(s)
I20260811 08:11:19.945487 21754 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435717191469-28623-0/minicluster-data/ts-2/data/info.pb
I20260811 08:11:19.946623 21981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:19.946223 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36983 (local address 127.27.243.195:47227)
0811 08:11:19.946397 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:19.946478 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:36983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":78,"threads_started":1}
W20260811 08:11:19.947032 21977 heartbeater.cc:644] Failed to heartbeat to 127.27.243.254:36983 (0 consecutive failures): Network error: Failed to ping master at 127.27.243.254:36983: Client connection negotiation failed: client connection to 127.27.243.254:36983: connect: Connection refused (error 111)
I20260811 08:11:19.947309 21981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:19.947224 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36983 (local address 127.27.243.195:53777)
0811 08:11:19.947265 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:19.947291 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:36983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
I20260811 08:11:19.947507 21981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:19.947458 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36983 (local address 127.27.243.195:39675)
0811 08:11:19.947478 (+ 20us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:19.947496 (+ 18us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:36983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":11}
W20260811 08:11:19.947584 21977 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 08:11:19.955276 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 21754
I20260811 08:11:20.764045 21984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:20.763792 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36983 (local address 127.27.243.193:42175)
0811 08:11:20.763938 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:20.763977 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:36983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":68,"threads_started":1}
I20260811 08:11:20.825062 21985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:20.824873 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36983 (local address 127.27.243.194:46857)
0811 08:11:20.824991 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:20.825013 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:36983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":63,"threads_started":1}
I20260811 08:11:20.948036 21986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:20.947840 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36983 (local address 127.27.243.195:39799)
0811 08:11:20.947950 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:20.947982 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:36983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":95,"thread_start_us":58,"threads_started":1}
I20260811 08:11:21.392388 21987 raft_consensus.cc:482] T 4db47c347b1d4fb59edc9cb84276424b P df7cef473a184c09b626be720c32fbd3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:11:21.392530 21987 raft_consensus.cc:504] T 4db47c347b1d4fb59edc9cb84276424b P df7cef473a184c09b626be720c32fbd3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d49051f047a54cd9b735792f5afa5f89" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 44397 } } peers { permanent_uuid: "614d9a0fbdbd41a6ba0c6f13d34ee134" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 42441 } } peers { permanent_uuid: "df7cef473a184c09b626be720c32fbd3" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 46141 } }
I20260811 08:11:21.392875 21987 leader_election.cc:288] T 4db47c347b1d4fb59edc9cb84276424b P df7cef473a184c09b626be720c32fbd3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d49051f047a54cd9b735792f5afa5f89 (127.27.243.194:44397), 614d9a0fbdbd41a6ba0c6f13d34ee134 (127.27.243.195:42441)
Aug 11 08:11:21 dist-test-slave-7lbf krb5kdc[19274](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435879, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.193@KRBTEST.COM for kudu/127.27.243.194@KRBTEST.COM
Aug 11 08:11:21 dist-test-slave-7lbf krb5kdc[19274](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435879, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.193@KRBTEST.COM for kudu/127.27.243.195@KRBTEST.COM
I20260811 08:11:21.405982 21989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:21.393146 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.193:50797 (local address 127.27.243.194:44397)
0811 08:11:21.393377 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0811 08:11:21.393390 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 08:11:21.393418 (+ 28us) server_negotiation.cc:407] Connection header received
0811 08:11:21.393925 (+ 507us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:11:21.393928 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:11:21.393973 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:11:21.394085 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:11:21.394871 (+ 786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:21.395761 (+ 890us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:21.396851 (+ 1090us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:21.397259 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:21.397374 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:21.402199 (+ 4825us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:11:21.402203 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:11:21.402203 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:11:21.402213 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:11:21.404151 (+ 1938us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:11:21.404605 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:11:21.404607 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:11:21.404608 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:11:21.404701 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:11:21.404987 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:11:21.404989 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:11:21.404989 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:11:21.405303 (+ 314us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:11:21.405392 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0811 08:11:21.405733 (+ 341us) server_negotiation.cc:299] Negotiation successful
0811 08:11:21.405868 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":176,"thread_start_us":52,"threads_started":1}
I20260811 08:11:21.405997 21994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:21.393346 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.193:49823 (local address 127.27.243.195:42441)
0811 08:11:21.393483 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0811 08:11:21.393493 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 08:11:21.393542 (+ 49us) server_negotiation.cc:407] Connection header received
0811 08:11:21.393980 (+ 438us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:11:21.393982 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:11:21.394021 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:11:21.394161 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:11:21.394880 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:21.395959 (+ 1079us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:21.396845 (+ 886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:21.397228 (+ 383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:21.397311 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:21.402606 (+ 5295us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:11:21.402610 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:11:21.402610 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:11:21.402621 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:11:21.404375 (+ 1754us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:11:21.404715 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:11:21.404718 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:11:21.404718 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:11:21.404818 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:11:21.405007 (+ 189us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:11:21.405007 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:11:21.405008 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:11:21.405303 (+ 295us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:11:21.405386 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0811 08:11:21.405733 (+ 347us) server_negotiation.cc:299] Negotiation successful
0811 08:11:21.405902 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":103,"thread_start_us":64,"threads_started":1}
I20260811 08:11:21.406001 21992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:21.393211 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.195:42441 (local address 127.27.243.193:49823)
0811 08:11:21.393310 (+ 99us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:21.393320 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 08:11:21.393380 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:11:21.394169 (+ 789us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:11:21.394173 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:11:21.394568 (+ 395us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:11:21.394754 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:11:21.394760 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:11:21.396056 (+ 1296us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:11:21.396056 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:11:21.396761 (+ 705us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:11:21.396763 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:11:21.397312 (+ 549us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:11:21.397313 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:11:21.397434 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:21.400518 (+ 3084us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:11:21.400536 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:11:21.402505 (+ 1969us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:11:21.404461 (+ 1956us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:11:21.404462 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:11:21.404463 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:11:21.404644 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:11:21.404894 (+ 250us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:11:21.404894 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:11:21.404895 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:11:21.404951 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:11:21.405378 (+ 427us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:11:21.405387 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:11:21.405564 (+ 177us) client_negotiation.cc:769] Sending connection context
0811 08:11:21.405676 (+ 112us) client_negotiation.cc:240] Negotiation successful
0811 08:11:21.405890 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":83,"mutex_wait_us":6,"thread_start_us":60,"threads_started":1}
I20260811 08:11:21.406002 21988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:21.393003 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.194:44397 (local address 127.27.243.193:50797)
0811 08:11:21.393156 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:21.393167 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 08:11:21.393246 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:11:21.394168 (+ 922us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:11:21.394172 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:11:21.394567 (+ 395us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:11:21.394754 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:11:21.394759 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:11:21.395898 (+ 1139us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:11:21.395899 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:11:21.396762 (+ 863us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:11:21.396765 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:11:21.397342 (+ 577us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:11:21.397343 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:11:21.397432 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:21.400538 (+ 3106us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:11:21.400542 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:11:21.402099 (+ 1557us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:11:21.404248 (+ 2149us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:11:21.404254 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:11:21.404256 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:11:21.404520 (+ 264us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:11:21.404767 (+ 247us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:11:21.404768 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:11:21.404768 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:11:21.404921 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:11:21.405378 (+ 457us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:11:21.405387 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:11:21.405564 (+ 177us) client_negotiation.cc:769] Sending connection context
0811 08:11:21.405676 (+ 112us) client_negotiation.cc:240] Negotiation successful
0811 08:11:21.405912 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"mutex_wait_us":144,"thread_start_us":70,"threads_started":1}
W20260811 08:11:21.406996 21342 leader_election.cc:341] T 4db47c347b1d4fb59edc9cb84276424b P df7cef473a184c09b626be720c32fbd3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 614d9a0fbdbd41a6ba0c6f13d34ee134 (127.27.243.195:42441): Not found: Tablet not found: 4db47c347b1d4fb59edc9cb84276424b
W20260811 08:11:21.407097 21342 leader_election.cc:341] T 4db47c347b1d4fb59edc9cb84276424b P df7cef473a184c09b626be720c32fbd3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d49051f047a54cd9b735792f5afa5f89 (127.27.243.194:44397): Not found: Tablet not found: 4db47c347b1d4fb59edc9cb84276424b
I20260811 08:11:21.407116 21342 leader_election.cc:302] T 4db47c347b1d4fb59edc9cb84276424b P df7cef473a184c09b626be720c32fbd3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df7cef473a184c09b626be720c32fbd3; no voters: 614d9a0fbdbd41a6ba0c6f13d34ee134, d49051f047a54cd9b735792f5afa5f89
I20260811 08:11:21.407220 21987 raft_consensus.cc:2726] T 4db47c347b1d4fb59edc9cb84276424b P df7cef473a184c09b626be720c32fbd3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 08:11:21.764750 21988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:21.764576 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36983 (local address 127.27.243.193:59117)
0811 08:11:21.764662 (+ 86us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:21.764706 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:36983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
I20260811 08:11:21.825762 21995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:21.825542 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36983 (local address 127.27.243.194:42569)
0811 08:11:21.825665 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:21.825714 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:36983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":61,"threads_started":1}
I20260811 08:11:21.948678 21998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:21.948477 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36983 (local address 127.27.243.195:35963)
0811 08:11:21.948591 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:21.948637 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:36983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":61,"threads_started":1}
I20260811 08:11:22.765588 21999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:22.765303 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36983 (local address 127.27.243.193:40727)
0811 08:11:22.765451 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:22.765488 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:36983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":94,"threads_started":1}
I20260811 08:11:22.826436 22001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:22.826224 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36983 (local address 127.27.243.194:59407)
0811 08:11:22.826359 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:22.826395 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:36983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":76,"threads_started":1}
I20260811 08:11:22.949380 22003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:22.949170 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36983 (local address 127.27.243.195:40147)
0811 08:11:22.949300 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:22.949336 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:36983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":78,"threads_started":1}
I20260811 08:11:23.222630 22004 raft_consensus.cc:482] T 4db47c347b1d4fb59edc9cb84276424b P df7cef473a184c09b626be720c32fbd3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:11:23.222728 22004 raft_consensus.cc:504] T 4db47c347b1d4fb59edc9cb84276424b P df7cef473a184c09b626be720c32fbd3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d49051f047a54cd9b735792f5afa5f89" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 44397 } } peers { permanent_uuid: "614d9a0fbdbd41a6ba0c6f13d34ee134" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 42441 } } peers { permanent_uuid: "df7cef473a184c09b626be720c32fbd3" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 46141 } }
I20260811 08:11:23.222901 22004 leader_election.cc:288] T 4db47c347b1d4fb59edc9cb84276424b P df7cef473a184c09b626be720c32fbd3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d49051f047a54cd9b735792f5afa5f89 (127.27.243.194:44397), 614d9a0fbdbd41a6ba0c6f13d34ee134 (127.27.243.195:42441)
W20260811 08:11:23.223362 21342 leader_election.cc:341] T 4db47c347b1d4fb59edc9cb84276424b P df7cef473a184c09b626be720c32fbd3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d49051f047a54cd9b735792f5afa5f89 (127.27.243.194:44397): Not found: Tablet not found: 4db47c347b1d4fb59edc9cb84276424b
W20260811 08:11:23.223433 21342 leader_election.cc:341] T 4db47c347b1d4fb59edc9cb84276424b P df7cef473a184c09b626be720c32fbd3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 614d9a0fbdbd41a6ba0c6f13d34ee134 (127.27.243.195:42441): Not found: Tablet not found: 4db47c347b1d4fb59edc9cb84276424b
I20260811 08:11:23.223449 21342 leader_election.cc:302] T 4db47c347b1d4fb59edc9cb84276424b P df7cef473a184c09b626be720c32fbd3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df7cef473a184c09b626be720c32fbd3; no voters: 614d9a0fbdbd41a6ba0c6f13d34ee134, d49051f047a54cd9b735792f5afa5f89
I20260811 08:11:23.223516 22004 raft_consensus.cc:2726] T 4db47c347b1d4fb59edc9cb84276424b P df7cef473a184c09b626be720c32fbd3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 08:11:23.766369 22009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:23.766100 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36983 (local address 127.27.243.193:41901)
0811 08:11:23.766270 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:23.766318 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:36983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":86,"threads_started":1}
I20260811 08:11:23.827046 22010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:23.826829 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36983 (local address 127.27.243.194:38141)
0811 08:11:23.826963 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:23.827005 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:36983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":62,"threads_started":1}
I20260811 08:11:23.950089 22011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:23.949849 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36983 (local address 127.27.243.195:35377)
0811 08:11:23.950004 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:23.950036 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:36983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":91,"threads_started":1}
I20260811 08:11:24.767164 22013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:24.766920 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36983 (local address 127.27.243.193:58177)
0811 08:11:24.767078 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:24.767118 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:36983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":68,"threads_started":1}
I20260811 08:11:24.827661 22014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:24.827465 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36983 (local address 127.27.243.194:34901)
0811 08:11:24.827594 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:24.827624 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:36983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":65,"threads_started":1}
I20260811 08:11:24.950820 22015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:24.950573 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36983 (local address 127.27.243.195:52689)
0811 08:11:24.950734 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:24.950777 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:36983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":79,"threads_started":1}
I20260811 08:11:25.647461 22019 raft_consensus.cc:482] T 4db47c347b1d4fb59edc9cb84276424b P df7cef473a184c09b626be720c32fbd3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:11:25.647557 22019 raft_consensus.cc:504] T 4db47c347b1d4fb59edc9cb84276424b P df7cef473a184c09b626be720c32fbd3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d49051f047a54cd9b735792f5afa5f89" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 44397 } } peers { permanent_uuid: "614d9a0fbdbd41a6ba0c6f13d34ee134" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 42441 } } peers { permanent_uuid: "df7cef473a184c09b626be720c32fbd3" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 46141 } }
I20260811 08:11:25.647691 22019 leader_election.cc:288] T 4db47c347b1d4fb59edc9cb84276424b P df7cef473a184c09b626be720c32fbd3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d49051f047a54cd9b735792f5afa5f89 (127.27.243.194:44397), 614d9a0fbdbd41a6ba0c6f13d34ee134 (127.27.243.195:42441)
W20260811 08:11:25.648108 21342 leader_election.cc:341] T 4db47c347b1d4fb59edc9cb84276424b P df7cef473a184c09b626be720c32fbd3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d49051f047a54cd9b735792f5afa5f89 (127.27.243.194:44397): Not found: Tablet not found: 4db47c347b1d4fb59edc9cb84276424b
W20260811 08:11:25.648195 21342 leader_election.cc:341] T 4db47c347b1d4fb59edc9cb84276424b P df7cef473a184c09b626be720c32fbd3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 614d9a0fbdbd41a6ba0c6f13d34ee134 (127.27.243.195:42441): Not found: Tablet not found: 4db47c347b1d4fb59edc9cb84276424b
I20260811 08:11:25.648221 21342 leader_election.cc:302] T 4db47c347b1d4fb59edc9cb84276424b P df7cef473a184c09b626be720c32fbd3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df7cef473a184c09b626be720c32fbd3; no voters: 614d9a0fbdbd41a6ba0c6f13d34ee134, d49051f047a54cd9b735792f5afa5f89
I20260811 08:11:25.648310 22019 raft_consensus.cc:2726] T 4db47c347b1d4fb59edc9cb84276424b P df7cef473a184c09b626be720c32fbd3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 08:11:25.767864 22022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:25.767623 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36983 (local address 127.27.243.193:39405)
0811 08:11:25.767771 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:25.767813 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:36983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":69,"threads_started":1}
I20260811 08:11:25.828231 22024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:25.828030 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36983 (local address 127.27.243.194:56827)
0811 08:11:25.828161 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:25.828192 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:36983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":75,"threads_started":1}
I20260811 08:11:25.951495 22025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:25.951262 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36983 (local address 127.27.243.195:49095)
0811 08:11:25.951409 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:25.951452 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:36983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":63,"threads_started":1}
I20260811 08:11:26.768615 22026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:26.768335 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36983 (local address 127.27.243.193:57357)
0811 08:11:26.768525 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:26.768565 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:36983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":99,"threads_started":1}
I20260811 08:11:26.828856 22027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:26.828664 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36983 (local address 127.27.243.194:42769)
0811 08:11:26.828776 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:26.828818 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:36983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97,"thread_start_us":58,"threads_started":1}
I20260811 08:11:26.952131 22028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:26.951930 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36983 (local address 127.27.243.195:58177)
0811 08:11:26.952054 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:26.952090 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:36983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":62,"threads_started":1}
I20260811 08:11:27.517827 22029 raft_consensus.cc:482] T 4db47c347b1d4fb59edc9cb84276424b P df7cef473a184c09b626be720c32fbd3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:11:27.517925 22029 raft_consensus.cc:504] T 4db47c347b1d4fb59edc9cb84276424b P df7cef473a184c09b626be720c32fbd3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d49051f047a54cd9b735792f5afa5f89" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 44397 } } peers { permanent_uuid: "614d9a0fbdbd41a6ba0c6f13d34ee134" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 42441 } } peers { permanent_uuid: "df7cef473a184c09b626be720c32fbd3" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 46141 } }
I20260811 08:11:27.518096 22029 leader_election.cc:288] T 4db47c347b1d4fb59edc9cb84276424b P df7cef473a184c09b626be720c32fbd3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d49051f047a54cd9b735792f5afa5f89 (127.27.243.194:44397), 614d9a0fbdbd41a6ba0c6f13d34ee134 (127.27.243.195:42441)
W20260811 08:11:27.518427 21342 leader_election.cc:341] T 4db47c347b1d4fb59edc9cb84276424b P df7cef473a184c09b626be720c32fbd3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d49051f047a54cd9b735792f5afa5f89 (127.27.243.194:44397): Not found: Tablet not found: 4db47c347b1d4fb59edc9cb84276424b
W20260811 08:11:27.518501 21342 leader_election.cc:341] T 4db47c347b1d4fb59edc9cb84276424b P df7cef473a184c09b626be720c32fbd3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 614d9a0fbdbd41a6ba0c6f13d34ee134 (127.27.243.195:42441): Not found: Tablet not found: 4db47c347b1d4fb59edc9cb84276424b
I20260811 08:11:27.518523 21342 leader_election.cc:302] T 4db47c347b1d4fb59edc9cb84276424b P df7cef473a184c09b626be720c32fbd3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df7cef473a184c09b626be720c32fbd3; no voters: 614d9a0fbdbd41a6ba0c6f13d34ee134, d49051f047a54cd9b735792f5afa5f89
I20260811 08:11:27.518599 22029 raft_consensus.cc:2726] T 4db47c347b1d4fb59edc9cb84276424b P df7cef473a184c09b626be720c32fbd3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 08:11:27.770120 22030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:27.769171 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36983 (local address 127.27.243.193:58221)
0811 08:11:27.770018 (+ 847us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:27.770063 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:36983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":825,"thread_start_us":65,"threads_started":1}
I20260811 08:11:27.829610 22031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:27.829350 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36983 (local address 127.27.243.194:42523)
0811 08:11:27.829492 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:27.829565 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:36983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":77,"threads_started":1}
I20260811 08:11:27.952750 22032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:27.952521 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36983 (local address 127.27.243.195:36169)
0811 08:11:27.952669 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:27.952706 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:36983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":79,"threads_started":1}
I20260811 08:11:28.770900 22034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:28.770645 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36983 (local address 127.27.243.193:36675)
0811 08:11:28.770805 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:28.770847 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:36983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":83,"threads_started":1}
I20260811 08:11:28.830257 22035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:28.830035 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36983 (local address 127.27.243.194:49879)
0811 08:11:28.830175 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:28.830216 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:36983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":64,"threads_started":1}
I20260811 08:11:28.953387 22037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:28.953181 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36983 (local address 127.27.243.195:41127)
0811 08:11:28.953310 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:28.953346 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:36983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":77,"threads_started":1}
I20260811 08:11:29.771629 22038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:29.771379 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36983 (local address 127.27.243.193:54243)
0811 08:11:29.771545 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:29.771580 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:36983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":85,"threads_started":1}
I20260811 08:11:29.830916 22039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:29.830684 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36983 (local address 127.27.243.194:42531)
0811 08:11:29.830821 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:29.830867 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:36983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":81,"threads_started":1}
I20260811 08:11:29.953992 22041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:29.953792 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36983 (local address 127.27.243.195:46911)
0811 08:11:29.953917 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:29.953952 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:36983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":59,"threads_started":1}
I20260811 08:11:30.772475 22044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:30.772183 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36983 (local address 127.27.243.193:60855)
0811 08:11:30.772366 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:30.772412 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:36983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":79,"threads_started":1}
I20260811 08:11:30.831516 22045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:30.831312 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36983 (local address 127.27.243.194:41785)
0811 08:11:30.831433 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:30.831469 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:36983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":66,"threads_started":1}
I20260811 08:11:30.954663 22046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:30.954431 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36983 (local address 127.27.243.195:44767)
0811 08:11:30.954572 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:30.954610 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:36983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":63,"threads_started":1}
I20260811 08:11:31.773167 22051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:31.772950 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36983 (local address 127.27.243.193:33945)
0811 08:11:31.773082 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:31.773120 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:36983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":72,"threads_started":1}
I20260811 08:11:31.832185 22052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:31.831964 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36983 (local address 127.27.243.194:40593)
0811 08:11:31.832110 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:31.832142 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:36983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":85,"threads_started":1}
I20260811 08:11:31.905066 22053 raft_consensus.cc:482] T 4db47c347b1d4fb59edc9cb84276424b P df7cef473a184c09b626be720c32fbd3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:11:31.905167 22053 raft_consensus.cc:504] T 4db47c347b1d4fb59edc9cb84276424b P df7cef473a184c09b626be720c32fbd3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d49051f047a54cd9b735792f5afa5f89" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 44397 } } peers { permanent_uuid: "614d9a0fbdbd41a6ba0c6f13d34ee134" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 42441 } } peers { permanent_uuid: "df7cef473a184c09b626be720c32fbd3" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 46141 } }
I20260811 08:11:31.905331 22053 leader_election.cc:288] T 4db47c347b1d4fb59edc9cb84276424b P df7cef473a184c09b626be720c32fbd3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d49051f047a54cd9b735792f5afa5f89 (127.27.243.194:44397), 614d9a0fbdbd41a6ba0c6f13d34ee134 (127.27.243.195:42441)
W20260811 08:11:31.905745 21342 leader_election.cc:341] T 4db47c347b1d4fb59edc9cb84276424b P df7cef473a184c09b626be720c32fbd3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d49051f047a54cd9b735792f5afa5f89 (127.27.243.194:44397): Not found: Tablet not found: 4db47c347b1d4fb59edc9cb84276424b
W20260811 08:11:31.905849 21342 leader_election.cc:341] T 4db47c347b1d4fb59edc9cb84276424b P df7cef473a184c09b626be720c32fbd3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 614d9a0fbdbd41a6ba0c6f13d34ee134 (127.27.243.195:42441): Not found: Tablet not found: 4db47c347b1d4fb59edc9cb84276424b
I20260811 08:11:31.905874 21342 leader_election.cc:302] T 4db47c347b1d4fb59edc9cb84276424b P df7cef473a184c09b626be720c32fbd3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df7cef473a184c09b626be720c32fbd3; no voters: 614d9a0fbdbd41a6ba0c6f13d34ee134, d49051f047a54cd9b735792f5afa5f89
I20260811 08:11:31.905944 22053 raft_consensus.cc:2726] T 4db47c347b1d4fb59edc9cb84276424b P df7cef473a184c09b626be720c32fbd3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 08:11:31.955338 22054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:31.955087 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36983 (local address 127.27.243.195:36187)
0811 08:11:31.955221 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:31.955261 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:36983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":63,"threads_started":1}
I20260811 08:11:32.773809 22055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:32.773602 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36983 (local address 127.27.243.193:54325)
0811 08:11:32.773719 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:32.773752 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:36983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":59,"threads_started":1}
I20260811 08:11:32.832828 22056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:32.832609 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36983 (local address 127.27.243.194:46149)
0811 08:11:32.832740 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:32.832777 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:36983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":63,"threads_started":1}
I20260811 08:11:32.956079 22057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:32.955776 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36983 (local address 127.27.243.195:40393)
0811 08:11:32.955990 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:32.956032 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:36983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":120,"threads_started":1}
I20260811 08:11:33.774580 22058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:33.774345 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36983 (local address 127.27.243.193:42197)
0811 08:11:33.774489 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:33.774531 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:36983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":63,"threads_started":1}
I20260811 08:11:33.833474 22061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:33.833262 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36983 (local address 127.27.243.194:55407)
0811 08:11:33.833392 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:33.833429 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:36983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":63,"threads_started":1}
I20260811 08:11:33.956835 22063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:33.956554 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36983 (local address 127.27.243.195:38731)
0811 08:11:33.956715 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:33.956754 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:36983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":85,"threads_started":1}
I20260811 08:11:34.775470 22070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:34.775186 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36983 (local address 127.27.243.193:56465)
0811 08:11:34.775372 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:34.775418 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:36983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":69,"threads_started":1}
I20260811 08:11:34.834179 22075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:34.833949 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36983 (local address 127.27.243.194:48247)
0811 08:11:34.834099 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:34.834137 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:36983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":74,"threads_started":1}
I20260811 08:11:34.957561 22077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:34.957315 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36983 (local address 127.27.243.195:58759)
0811 08:11:34.957455 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:34.957487 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:36983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":79,"threads_started":1}
I20260811 08:11:34.965862 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 21267
I20260811 08:11:34.979041 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 21532
I20260811 08:11:34.988087 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 21754
2026-08-11T08:11:34Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (18600 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:11:35 dist-test-slave-7lbf krb5kdc[22082](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:11:35 dist-test-slave-7lbf krb5kdc[22082](info): set up 2 sockets
Aug 11 08:11:35 dist-test-slave-7lbf krb5kdc[22082](info): commencing operation
krb5kdc: starting...
W20260811 08:11:36.160095 28623 mini_kdc.cc:121] Time spent starting KDC: real 1.147s user 0.003s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/krb5kdc/test-user.keytab.
Aug 11 08:11:36 dist-test-slave-7lbf krb5kdc[22082](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435896, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:11:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:11:36Z Disabled control of system clock
WARNING: no policy specified for kudu/127.27.243.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.243.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.243.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab.
Entry for principal kudu/127.27.243.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab.
I20260811 08:11:36.276660 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.243.254:36663
--webserver_interface=127.27.243.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab
--principal=kudu/127.27.243.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:45239
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.243.254:36663
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:11:36.356781 22104 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:11:36.356978 22104 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:11:36.356999 22104 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:11:36.358093 22104 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260811 08:11:36.358124 22104 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260811 08:11:36.358136 22104 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260811 08:11:36.358146 22104 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:11:36.358158 22104 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:11:36.358176 22104 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:11:36.358192 22104 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:11:36.358207 22104 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:11:36.359570 22104 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:45239
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.27.243.254:36663
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab
--principal=kudu/127.27.243.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.243.254:36663
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.243.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22104
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:11:36.359751 22104 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:11:36.359920 22104 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 08:11:36.364720 22104 server_base.cc:1034] running on GCE node
W20260811 08:11:36.364770 22110 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:11:36.364770 22114 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:11:36.364995 22116 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:11:36.365254 22104 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:11:36.365581 22104 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:11:36.366750 22104 hybrid_clock.cc:648] HybridClock initialized: now 1786435896366728 us; error 30 us; skew 500 ppm
Aug 11 08:11:36 dist-test-slave-7lbf krb5kdc[22082](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435896, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:11:36.369334 22104 init.cc:377] Logged in from keytab as kudu/127.27.243.254@KRBTEST.COM (short username kudu)
I20260811 08:11:36.369786 22104 webserver.cc:460] Webserver started at http://127.27.243.254:45689/ using document root <none> and password file <none>
I20260811 08:11:36.370033 22104 fs_manager.cc:359] Metadata directory not provided
I20260811 08:11:36.370082 22104 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:11:36.370203 22104 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:11:36.371227 22104 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/master-0/data/instance:
uuid: "88ab4328a0b64bee8b9a009e9f299ae0"
format_stamp: "Formatted at 2026-08-11 08:11:36 on dist-test-slave-7lbf"
server_key: "0cfc9385ba5920ef4c2161c532b9670f"
server_key_iv: "058869ea34ce19d5fe1723f607e9c5da"
server_key_version: "encryptionkey@0"
I20260811 08:11:36.371560 22104 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/master-0/wal/instance:
uuid: "88ab4328a0b64bee8b9a009e9f299ae0"
format_stamp: "Formatted at 2026-08-11 08:11:36 on dist-test-slave-7lbf"
server_key: "0cfc9385ba5920ef4c2161c532b9670f"
server_key_iv: "058869ea34ce19d5fe1723f607e9c5da"
server_key_version: "encryptionkey@0"
I20260811 08:11:36.372779 22104 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 08:11:36.373505 22126 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:11:36.373695 22104 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 08:11:36.373783 22104 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/master-0/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/master-0/wal
uuid: "88ab4328a0b64bee8b9a009e9f299ae0"
format_stamp: "Formatted at 2026-08-11 08:11:36 on dist-test-slave-7lbf"
server_key: "0cfc9385ba5920ef4c2161c532b9670f"
server_key_iv: "058869ea34ce19d5fe1723f607e9c5da"
server_key_version: "encryptionkey@0"
I20260811 08:11:36.373888 22104 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:11:36.408252 22104 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:11:36.410308 22104 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:11:36.410454 22104 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:11:36.414428 22104 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.254:36663
I20260811 08:11:36.414484 22214 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.254:36663 every 8 connection(s)
I20260811 08:11:36.414825 22104 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
I20260811 08:11:36.415686 22215 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:11:36.418156 22215 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 88ab4328a0b64bee8b9a009e9f299ae0: Bootstrap starting.
I20260811 08:11:36.418740 22215 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 88ab4328a0b64bee8b9a009e9f299ae0: Neither blocks nor log segments found. Creating new log.
I20260811 08:11:36.419081 22215 log.cc:824] T 00000000000000000000000000000000 P 88ab4328a0b64bee8b9a009e9f299ae0: Log is configured to *not* fsync() on all Append() calls
I20260811 08:11:36.419752 22215 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 88ab4328a0b64bee8b9a009e9f299ae0: No bootstrap required, opened a new log
I20260811 08:11:36.421397 22215 raft_consensus.cc:348] T 00000000000000000000000000000000 P 88ab4328a0b64bee8b9a009e9f299ae0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88ab4328a0b64bee8b9a009e9f299ae0" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 36663 } }
I20260811 08:11:36.421624 22215 raft_consensus.cc:374] T 00000000000000000000000000000000 P 88ab4328a0b64bee8b9a009e9f299ae0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:11:36.421679 22215 raft_consensus.cc:729] T 00000000000000000000000000000000 P 88ab4328a0b64bee8b9a009e9f299ae0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ab4328a0b64bee8b9a009e9f299ae0, State: Initialized, Role: FOLLOWER
I20260811 08:11:36.421715 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 22104
I20260811 08:11:36.421834 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/master-0/wal/instance
I20260811 08:11:36.421844 22215 consensus_queue.cc:260] T 00000000000000000000000000000000 P 88ab4328a0b64bee8b9a009e9f299ae0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88ab4328a0b64bee8b9a009e9f299ae0" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 36663 } }
I20260811 08:11:36.421940 22215 raft_consensus.cc:388] T 00000000000000000000000000000000 P 88ab4328a0b64bee8b9a009e9f299ae0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:11:36.421985 22215 raft_consensus.cc:482] T 00000000000000000000000000000000 P 88ab4328a0b64bee8b9a009e9f299ae0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:11:36.422037 22215 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 88ab4328a0b64bee8b9a009e9f299ae0 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:11:36.422047 28623 external_mini_cluster.cc:1428] Setting key 26d6b9af90730ac5660b4bef18934d25
I20260811 08:11:36.422719 22215 raft_consensus.cc:504] T 00000000000000000000000000000000 P 88ab4328a0b64bee8b9a009e9f299ae0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88ab4328a0b64bee8b9a009e9f299ae0" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 36663 } }
I20260811 08:11:36.422824 22215 leader_election.cc:302] T 00000000000000000000000000000000 P 88ab4328a0b64bee8b9a009e9f299ae0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 88ab4328a0b64bee8b9a009e9f299ae0; no voters:
I20260811 08:11:36.422987 22215 leader_election.cc:288] T 00000000000000000000000000000000 P 88ab4328a0b64bee8b9a009e9f299ae0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:11:36.423197 22223 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 88ab4328a0b64bee8b9a009e9f299ae0 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:11:36.423327 22215 sys_catalog.cc:564] T 00000000000000000000000000000000 P 88ab4328a0b64bee8b9a009e9f299ae0 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:11:36.423369 22223 raft_consensus.cc:686] T 00000000000000000000000000000000 P 88ab4328a0b64bee8b9a009e9f299ae0 [term 1 LEADER]: Becoming Leader. State: Replica: 88ab4328a0b64bee8b9a009e9f299ae0, State: Running, Role: LEADER
I20260811 08:11:36.423544 22223 consensus_queue.cc:237] T 00000000000000000000000000000000 P 88ab4328a0b64bee8b9a009e9f299ae0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88ab4328a0b64bee8b9a009e9f299ae0" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 36663 } }
I20260811 08:11:36.423882 22223 sys_catalog.cc:455] T 00000000000000000000000000000000 P 88ab4328a0b64bee8b9a009e9f299ae0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 88ab4328a0b64bee8b9a009e9f299ae0. Latest consensus state: current_term: 1 leader_uuid: "88ab4328a0b64bee8b9a009e9f299ae0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88ab4328a0b64bee8b9a009e9f299ae0" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 36663 } } }
I20260811 08:11:36.424044 22223 sys_catalog.cc:458] T 00000000000000000000000000000000 P 88ab4328a0b64bee8b9a009e9f299ae0 [sys.catalog]: This master's current role is: LEADER
I20260811 08:11:36.424279 22241 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:11:36.424320 22229 sys_catalog.cc:455] T 00000000000000000000000000000000 P 88ab4328a0b64bee8b9a009e9f299ae0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "88ab4328a0b64bee8b9a009e9f299ae0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88ab4328a0b64bee8b9a009e9f299ae0" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 36663 } } }
I20260811 08:11:36.424520 22229 sys_catalog.cc:458] T 00000000000000000000000000000000 P 88ab4328a0b64bee8b9a009e9f299ae0 [sys.catalog]: This master's current role is: LEADER
I20260811 08:11:36.424813 22241 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:11:36.427137 22241 catalog_manager.cc:1347] Generated new cluster ID: 2d8a477a994945359c8feb5b4afcd55e
I20260811 08:11:36.427196 22241 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 08:11:36 dist-test-slave-7lbf krb5kdc[22082](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435896, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.243.254@KRBTEST.COM
I20260811 08:11:36.431914 22222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:36.422519 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38302 (local address 127.27.243.254:36663)
0811 08:11:36.422714 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0811 08:11:36.422724 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 08:11:36.422758 (+ 34us) server_negotiation.cc:407] Connection header received
0811 08:11:36.422886 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:11:36.422893 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:11:36.422947 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:11:36.423078 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:11:36.423875 (+ 797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:36.425275 (+ 1400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:36.426102 (+ 827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:36.426673 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:36.426788 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:36.429001 (+ 2213us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:11:36.429005 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:11:36.429006 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:11:36.429017 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:11:36.430516 (+ 1499us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:11:36.430839 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:11:36.430842 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:11:36.430843 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:11:36.430952 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:11:36.431128 (+ 176us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:11:36.431128 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:11:36.431129 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:11:36.431355 (+ 226us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:11:36.431487 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0811 08:11:36.431585 (+ 98us) server_negotiation.cc:299] Negotiation successful
0811 08:11:36.431710 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141,"thread_start_us":95,"threads_started":1}
I20260811 08:11:36.441294 22241 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:11:36.441849 22241 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:11:36.452929 22241 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 88ab4328a0b64bee8b9a009e9f299ae0: Generated new TSK 0
I20260811 08:11:36.453085 22241 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.27.243.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.243.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.243.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.193.keytab.
Entry for principal kudu/127.27.243.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.193.keytab.
I20260811 08:11:36.480870 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.243.193:0
--local_ip_for_outbound_sockets=127.27.243.193
--webserver_interface=127.27.243.193
--webserver_port=0
--tserver_master_addrs=127.27.243.254:36663
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.193.keytab
--principal=kudu/127.27.243.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:45239
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:11:36.562999 22262 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:11:36.563195 22262 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:11:36.563227 22262 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:11:36.564347 22262 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:11:36.564388 22262 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:11:36.564430 22262 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.243.193
I20260811 08:11:36.565889 22262 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:45239
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.193.keytab
--principal=kudu/127.27.243.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.243.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.243.193
--webserver_port=0
--tserver_master_addrs=127.27.243.254:36663
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22262
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.243.193
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:11:36.566121 22262 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:11:36.566322 22262 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:11:36.571000 22273 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:11:36.571020 22275 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:11:36.571017 22278 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:11:36.571132 22262 server_base.cc:1034] running on GCE node
I20260811 08:11:36.571389 22262 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:11:36.571604 22262 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:11:36.572736 22262 hybrid_clock.cc:648] HybridClock initialized: now 1786435896572723 us; error 29 us; skew 500 ppm
Aug 11 08:11:36 dist-test-slave-7lbf krb5kdc[22082](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435896, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:11:36.575172 22262 init.cc:377] Logged in from keytab as kudu/127.27.243.193@KRBTEST.COM (short username kudu)
I20260811 08:11:36.575598 22262 webserver.cc:460] Webserver started at http://127.27.243.193:45603/ using document root <none> and password file <none>
I20260811 08:11:36.575817 22262 fs_manager.cc:359] Metadata directory not provided
I20260811 08:11:36.575865 22262 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:11:36.575994 22262 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:11:36.577020 22262 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-0/data/instance:
uuid: "2cb7dafc32a1405591a4fbc212c282f9"
format_stamp: "Formatted at 2026-08-11 08:11:36 on dist-test-slave-7lbf"
server_key: "e9e52c88d9c08a66afb2d3b76390e21c"
server_key_iv: "222fb2e1a4dc7faff7feb0034d4fb547"
server_key_version: "encryptionkey@0"
I20260811 08:11:36.577365 22262 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-0/wal/instance:
uuid: "2cb7dafc32a1405591a4fbc212c282f9"
format_stamp: "Formatted at 2026-08-11 08:11:36 on dist-test-slave-7lbf"
server_key: "e9e52c88d9c08a66afb2d3b76390e21c"
server_key_iv: "222fb2e1a4dc7faff7feb0034d4fb547"
server_key_version: "encryptionkey@0"
I20260811 08:11:36.578619 22262 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 08:11:36.579246 22287 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:11:36.579397 22262 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 08:11:36.579500 22262 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-0/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-0/wal
uuid: "2cb7dafc32a1405591a4fbc212c282f9"
format_stamp: "Formatted at 2026-08-11 08:11:36 on dist-test-slave-7lbf"
server_key: "e9e52c88d9c08a66afb2d3b76390e21c"
server_key_iv: "222fb2e1a4dc7faff7feb0034d4fb547"
server_key_version: "encryptionkey@0"
I20260811 08:11:36.579566 22262 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:11:36.588296 22262 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:11:36.590282 22262 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:11:36.590420 22262 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:11:36.590626 22262 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:11:36.590932 22262 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:11:36.590970 22262 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:11:36.590998 22262 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:11:36.591022 22262 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:11:36.596671 22262 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.193:33129
I20260811 08:11:36.596731 22485 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.193:33129 every 8 connection(s)
I20260811 08:11:36.597018 22262 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-0/data/info.pb
Aug 11 08:11:36 dist-test-slave-7lbf krb5kdc[22082](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435896, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.193@KRBTEST.COM for kudu/127.27.243.254@KRBTEST.COM
I20260811 08:11:36.605978 22222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:36.597713 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.193:48675 (local address 127.27.243.254:36663)
0811 08:11:36.597768 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 08:11:36.597771 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:11:36.597992 (+ 221us) server_negotiation.cc:407] Connection header received
0811 08:11:36.598480 (+ 488us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:11:36.598481 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:11:36.598498 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:11:36.598550 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:11:36.599464 (+ 914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:36.599967 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:36.600923 (+ 956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:36.601129 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:36.601186 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:36.603289 (+ 2103us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:11:36.603290 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:11:36.603291 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:11:36.603300 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:11:36.604606 (+ 1306us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:11:36.604986 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:11:36.604988 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:11:36.604988 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:11:36.605041 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:11:36.605254 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:11:36.605255 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:11:36.605256 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:11:36.605397 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:11:36.605500 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0811 08:11:36.605798 (+ 298us) server_negotiation.cc:299] Negotiation successful
0811 08:11:36.605888 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260811 08:11:36.606138 22491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:36.597685 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36663 (local address 127.27.243.193:48675)
0811 08:11:36.597867 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:36.597901 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0811 08:11:36.598385 (+ 484us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:11:36.598621 (+ 236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:11:36.598625 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:11:36.599170 (+ 545us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:11:36.599359 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:11:36.599364 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:11:36.600049 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:11:36.600050 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:11:36.600840 (+ 790us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:11:36.600842 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:11:36.601200 (+ 358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:11:36.601201 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:11:36.601321 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:36.601837 (+ 516us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:11:36.601845 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:11:36.603188 (+ 1343us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:11:36.604682 (+ 1494us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:11:36.604689 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:11:36.604691 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:11:36.604895 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:11:36.605095 (+ 200us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:11:36.605096 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:11:36.605097 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:11:36.605199 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:11:36.605491 (+ 292us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:11:36.605498 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:11:36.605667 (+ 169us) client_negotiation.cc:769] Sending connection context
0811 08:11:36.605761 (+ 94us) client_negotiation.cc:240] Negotiation successful
0811 08:11:36.605933 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":87,"threads_started":1}
I20260811 08:11:36.606614 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 22262
I20260811 08:11:36.606645 22487 heartbeater.cc:347] Connected to a master server at 127.27.243.254:36663
I20260811 08:11:36.606726 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-0/wal/instance
I20260811 08:11:36.606736 22487 heartbeater.cc:464] Registering TS with master...
I20260811 08:11:36.606900 28623 external_mini_cluster.cc:1428] Setting key c3cf06a2f3eaa04c8598f99d49bac836
I20260811 08:11:36.606925 22487 heartbeater.cc:511] Master 127.27.243.254:36663 requested a full tablet report, sending...
I20260811 08:11:36.607419 22154 ts_manager.cc:194] Registered new tserver with Master: 2cb7dafc32a1405591a4fbc212c282f9 (127.27.243.193:33129)
I20260811 08:11:36.608049 22154 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.243.193@KRBTEST.COM'} at 127.27.243.193:48675
WARNING: no policy specified for kudu/127.27.243.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.243.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.243.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.194.keytab.
Entry for principal kudu/127.27.243.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.194.keytab.
I20260811 08:11:36.631971 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.243.194:0
--local_ip_for_outbound_sockets=127.27.243.194
--webserver_interface=127.27.243.194
--webserver_port=0
--tserver_master_addrs=127.27.243.254:36663
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.194.keytab
--principal=kudu/127.27.243.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:45239
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:11:36.714819 22497 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:11:36.715045 22497 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:11:36.715080 22497 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:11:36.716240 22497 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:11:36.716287 22497 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:11:36.716325 22497 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.243.194
I20260811 08:11:36.717808 22497 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:45239
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.194.keytab
--principal=kudu/127.27.243.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.243.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.243.194
--webserver_port=0
--tserver_master_addrs=127.27.243.254:36663
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22497
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.243.194
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:11:36.718039 22497 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:11:36.718276 22497 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:11:36.723076 22505 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:11:36.723145 22510 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:11:36.723145 22508 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:11:36.723335 22497 server_base.cc:1034] running on GCE node
I20260811 08:11:36.723654 22497 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:11:36.723896 22497 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:11:36.725054 22497 hybrid_clock.cc:648] HybridClock initialized: now 1786435896725033 us; error 36 us; skew 500 ppm
Aug 11 08:11:36 dist-test-slave-7lbf krb5kdc[22082](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435896, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:11:36.727514 22497 init.cc:377] Logged in from keytab as kudu/127.27.243.194@KRBTEST.COM (short username kudu)
I20260811 08:11:36.727921 22497 webserver.cc:460] Webserver started at http://127.27.243.194:43279/ using document root <none> and password file <none>
I20260811 08:11:36.728094 22497 fs_manager.cc:359] Metadata directory not provided
I20260811 08:11:36.728132 22497 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:11:36.728219 22497 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:11:36.729192 22497 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-1/data/instance:
uuid: "c8f2cd8efe604ee3aed222d9af32f8b7"
format_stamp: "Formatted at 2026-08-11 08:11:36 on dist-test-slave-7lbf"
server_key: "dff413235383c27d44a46068ff840695"
server_key_iv: "2c3611adec0afc696e55f3a8f0dfbaa4"
server_key_version: "encryptionkey@0"
I20260811 08:11:36.729491 22497 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-1/wal/instance:
uuid: "c8f2cd8efe604ee3aed222d9af32f8b7"
format_stamp: "Formatted at 2026-08-11 08:11:36 on dist-test-slave-7lbf"
server_key: "dff413235383c27d44a46068ff840695"
server_key_iv: "2c3611adec0afc696e55f3a8f0dfbaa4"
server_key_version: "encryptionkey@0"
I20260811 08:11:36.730720 22497 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:11:36.731395 22522 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:11:36.731585 22497 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:11:36.731678 22497 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-1/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-1/wal
uuid: "c8f2cd8efe604ee3aed222d9af32f8b7"
format_stamp: "Formatted at 2026-08-11 08:11:36 on dist-test-slave-7lbf"
server_key: "dff413235383c27d44a46068ff840695"
server_key_iv: "2c3611adec0afc696e55f3a8f0dfbaa4"
server_key_version: "encryptionkey@0"
I20260811 08:11:36.731745 22497 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:11:36.745242 22497 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:11:36.747493 22497 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:11:36.747630 22497 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:11:36.747859 22497 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:11:36.748163 22497 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:11:36.748200 22497 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:11:36.748224 22497 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:11:36.748238 22497 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:11:36.754397 22497 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.194:42953
I20260811 08:11:36.754462 22706 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.194:42953 every 8 connection(s)
I20260811 08:11:36.754752 22497 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-1/data/info.pb
I20260811 08:11:36.757344 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 22497
I20260811 08:11:36.757436 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-1/wal/instance
I20260811 08:11:36.757640 28623 external_mini_cluster.cc:1428] Setting key f5de390979a9e8576e8e4a42d5ae2cbf
Aug 11 08:11:36 dist-test-slave-7lbf krb5kdc[22082](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435896, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.194@KRBTEST.COM for kudu/127.27.243.254@KRBTEST.COM
I20260811 08:11:36.764138 22222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:36.755471 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.194:55791 (local address 127.27.243.254:36663)
0811 08:11:36.755526 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 08:11:36.755528 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:11:36.755694 (+ 166us) server_negotiation.cc:407] Connection header received
0811 08:11:36.756170 (+ 476us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:11:36.756171 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:11:36.756182 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:11:36.756245 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:11:36.757170 (+ 925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:36.757825 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:36.759076 (+ 1251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:36.759272 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:36.759351 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:36.761662 (+ 2311us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:11:36.761664 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:11:36.761664 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:11:36.761671 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:11:36.762901 (+ 1230us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:11:36.763260 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:11:36.763261 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:11:36.763262 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:11:36.763315 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:11:36.763540 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:11:36.763541 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:11:36.763541 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:11:36.763651 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:11:36.763706 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 08:11:36.763970 (+ 264us) server_negotiation.cc:299] Negotiation successful
0811 08:11:36.764050 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 08:11:36.764302 22710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:36.755423 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36663 (local address 127.27.243.194:55791)
0811 08:11:36.755574 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:36.755615 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 08:11:36.756088 (+ 473us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:11:36.756303 (+ 215us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:11:36.756306 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:11:36.756885 (+ 579us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:11:36.757073 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:11:36.757078 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:11:36.757924 (+ 846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:11:36.757925 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:11:36.758986 (+ 1061us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:11:36.758990 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:11:36.759374 (+ 384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:11:36.759376 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:11:36.759506 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:36.760040 (+ 534us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:11:36.760049 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:11:36.761576 (+ 1527us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:11:36.762977 (+ 1401us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:11:36.762985 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:11:36.762987 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:11:36.763194 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:11:36.763378 (+ 184us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:11:36.763379 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:11:36.763379 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:11:36.763484 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:11:36.763707 (+ 223us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:11:36.763714 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:11:36.763853 (+ 139us) client_negotiation.cc:769] Sending connection context
0811 08:11:36.763941 (+ 88us) client_negotiation.cc:240] Negotiation successful
0811 08:11:36.764093 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":83,"threads_started":1}
I20260811 08:11:36.764894 22707 heartbeater.cc:347] Connected to a master server at 127.27.243.254:36663
I20260811 08:11:36.764982 22707 heartbeater.cc:464] Registering TS with master...
I20260811 08:11:36.765149 22707 heartbeater.cc:511] Master 127.27.243.254:36663 requested a full tablet report, sending...
I20260811 08:11:36.765561 22154 ts_manager.cc:194] Registered new tserver with Master: c8f2cd8efe604ee3aed222d9af32f8b7 (127.27.243.194:42953)
I20260811 08:11:36.765959 22154 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.243.194@KRBTEST.COM'} at 127.27.243.194:55791
WARNING: no policy specified for kudu/127.27.243.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.243.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.243.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.195.keytab.
Entry for principal kudu/127.27.243.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.195.keytab.
I20260811 08:11:36.783524 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.243.195:0
--local_ip_for_outbound_sockets=127.27.243.195
--webserver_interface=127.27.243.195
--webserver_port=0
--tserver_master_addrs=127.27.243.254:36663
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.195.keytab
--principal=kudu/127.27.243.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:45239
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:11:36.866617 22715 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:11:36.866812 22715 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:11:36.866834 22715 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:11:36.867899 22715 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:11:36.867933 22715 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:11:36.867956 22715 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.243.195
I20260811 08:11:36.869314 22715 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:45239
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.195.keytab
--principal=kudu/127.27.243.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.243.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.243.195
--webserver_port=0
--tserver_master_addrs=127.27.243.254:36663
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22715
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.243.195
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:11:36.869498 22715 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:11:36.869707 22715 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:11:36.874470 22722 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:11:36.874476 22726 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:11:36.874491 22724 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:11:36.874708 22715 server_base.cc:1034] running on GCE node
I20260811 08:11:36.874927 22715 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:11:36.875144 22715 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:11:36.876295 22715 hybrid_clock.cc:648] HybridClock initialized: now 1786435896876269 us; error 37 us; skew 500 ppm
Aug 11 08:11:36 dist-test-slave-7lbf krb5kdc[22082](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435896, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:11:36.878775 22715 init.cc:377] Logged in from keytab as kudu/127.27.243.195@KRBTEST.COM (short username kudu)
I20260811 08:11:36.879222 22715 webserver.cc:460] Webserver started at http://127.27.243.195:33947/ using document root <none> and password file <none>
I20260811 08:11:36.879424 22715 fs_manager.cc:359] Metadata directory not provided
I20260811 08:11:36.879472 22715 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:11:36.879596 22715 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:11:36.880615 22715 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-2/data/instance:
uuid: "75394a5549a3402b81287c9bdaa9b097"
format_stamp: "Formatted at 2026-08-11 08:11:36 on dist-test-slave-7lbf"
server_key: "77073bc16282d73bd0ad84483669dcb0"
server_key_iv: "25374abf12da4d37324e3c23f1b73cde"
server_key_version: "encryptionkey@0"
I20260811 08:11:36.881042 22715 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-2/wal/instance:
uuid: "75394a5549a3402b81287c9bdaa9b097"
format_stamp: "Formatted at 2026-08-11 08:11:36 on dist-test-slave-7lbf"
server_key: "77073bc16282d73bd0ad84483669dcb0"
server_key_iv: "25374abf12da4d37324e3c23f1b73cde"
server_key_version: "encryptionkey@0"
I20260811 08:11:36.882982 22715 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.003s
I20260811 08:11:36.883934 22739 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:11:36.884083 22715 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:11:36.884173 22715 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-2/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-2/wal
uuid: "75394a5549a3402b81287c9bdaa9b097"
format_stamp: "Formatted at 2026-08-11 08:11:36 on dist-test-slave-7lbf"
server_key: "77073bc16282d73bd0ad84483669dcb0"
server_key_iv: "25374abf12da4d37324e3c23f1b73cde"
server_key_version: "encryptionkey@0"
I20260811 08:11:36.884245 22715 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:11:36.897897 22715 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:11:36.900139 22715 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:11:36.900283 22715 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:11:36.900522 22715 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:11:36.900835 22715 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:11:36.900868 22715 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:11:36.900898 22715 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:11:36.900915 22715 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:11:36.906745 22715 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.195:36139
I20260811 08:11:36.906813 22915 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.195:36139 every 8 connection(s)
I20260811 08:11:36.907114 22715 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-2/data/info.pb
I20260811 08:11:36.908987 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 22715
I20260811 08:11:36.909070 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-2/wal/instance
I20260811 08:11:36.909229 28623 external_mini_cluster.cc:1428] Setting key 5d2d11eb48a8fd11fa87ae621c43f69a
Aug 11 08:11:36 dist-test-slave-7lbf krb5kdc[22082](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435896, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.195@KRBTEST.COM for kudu/127.27.243.254@KRBTEST.COM
I20260811 08:11:36.915979 22222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:36.907826 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.195:50145 (local address 127.27.243.254:36663)
0811 08:11:36.907897 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0811 08:11:36.907899 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:11:36.908099 (+ 200us) server_negotiation.cc:407] Connection header received
0811 08:11:36.908628 (+ 529us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:11:36.908630 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:11:36.908643 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:11:36.908691 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:11:36.909800 (+ 1109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:36.910398 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:36.911382 (+ 984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:36.911599 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:36.911656 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:36.913741 (+ 2085us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:11:36.913742 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:11:36.913743 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:11:36.913750 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:11:36.914759 (+ 1009us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:11:36.915111 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:11:36.915112 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:11:36.915112 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:11:36.915165 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:11:36.915379 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:11:36.915380 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:11:36.915381 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:11:36.915491 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:11:36.915548 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 08:11:36.915800 (+ 252us) server_negotiation.cc:299] Negotiation successful
0811 08:11:36.915881 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 08:11:36.916132 22918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:36.907794 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36663 (local address 127.27.243.195:50145)
0811 08:11:36.907975 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:36.908014 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 08:11:36.908527 (+ 513us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:11:36.908775 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:11:36.908778 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:11:36.909438 (+ 660us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:11:36.909720 (+ 282us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:11:36.909729 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:11:36.910490 (+ 761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:11:36.910491 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:11:36.911299 (+ 808us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:11:36.911302 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:11:36.911670 (+ 368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:11:36.911671 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:11:36.911815 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:36.912256 (+ 441us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:11:36.912271 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:11:36.913658 (+ 1387us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:11:36.914831 (+ 1173us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:11:36.914838 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:11:36.914840 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:11:36.915046 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:11:36.915219 (+ 173us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:11:36.915220 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:11:36.915220 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:11:36.915325 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:11:36.915544 (+ 219us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:11:36.915551 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:11:36.915684 (+ 133us) client_negotiation.cc:769] Sending connection context
0811 08:11:36.915770 (+ 86us) client_negotiation.cc:240] Negotiation successful
0811 08:11:36.915920 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":92,"threads_started":1}
I20260811 08:11:36.916522 22916 heartbeater.cc:347] Connected to a master server at 127.27.243.254:36663
I20260811 08:11:36.916603 22916 heartbeater.cc:464] Registering TS with master...
I20260811 08:11:36.916770 22916 heartbeater.cc:511] Master 127.27.243.254:36663 requested a full tablet report, sending...
I20260811 08:11:36.917101 22154 ts_manager.cc:194] Registered new tserver with Master: 75394a5549a3402b81287c9bdaa9b097 (127.27.243.195:36139)
I20260811 08:11:36.917452 22154 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.243.195@KRBTEST.COM'} at 127.27.243.195:50145
I20260811 08:11:36.920971 28623 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 08:11:36.927772 22222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:36.922312 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38308 (local address 127.27.243.254:36663)
0811 08:11:36.922367 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 08:11:36.922369 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:11:36.922479 (+ 110us) server_negotiation.cc:407] Connection header received
0811 08:11:36.922518 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:11:36.922519 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:11:36.922528 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:11:36.922581 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:11:36.923146 (+ 565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:36.923604 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:36.924394 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:36.924599 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:36.924654 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:36.925741 (+ 1087us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:11:36.925742 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:11:36.925742 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:11:36.925749 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:11:36.926757 (+ 1008us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:11:36.927056 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:11:36.927057 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:11:36.927057 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:11:36.927109 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:11:36.927267 (+ 158us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:11:36.927268 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:11:36.927269 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:11:36.927408 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:11:36.927493 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0811 08:11:36.927620 (+ 127us) server_negotiation.cc:299] Negotiation successful
0811 08:11:36.927691 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260811 08:11:36.929028 22154 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38308:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 08:11:36.930570 22154 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 08:11:36.936785 22932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:36.932538 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.194:42953 (local address 127.0.0.1:46076)
0811 08:11:36.933221 (+ 683us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:36.933228 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0811 08:11:36.933266 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:11:36.933550 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:11:36.933551 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:11:36.933553 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:11:36.933599 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:11:36.933601 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:11:36.934870 (+ 1269us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:11:36.934871 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:11:36.935885 (+ 1014us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:11:36.935887 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:11:36.936545 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:11:36.936547 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:11:36.936608 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:36.936612 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 08:11:36.936660 (+ 48us) client_negotiation.cc:240] Negotiation successful
0811 08:11:36.936702 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":675,"mutex_wait_us":8,"thread_start_us":62,"threads_started":1}
I20260811 08:11:36.936795 22943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:36.932796 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46076 (local address 127.27.243.194:42953)
0811 08:11:36.933015 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0811 08:11:36.933020 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 08:11:36.933316 (+ 296us) server_negotiation.cc:407] Connection header received
0811 08:11:36.933361 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:11:36.933363 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:11:36.933380 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:11:36.933448 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:11:36.933665 (+ 217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:36.934765 (+ 1100us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:36.935956 (+ 1191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:36.936463 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:36.936528 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:36.936582 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 08:11:36.936672 (+ 90us) server_negotiation.cc:299] Negotiation successful
0811 08:11:36.936716 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":179,"thread_start_us":95,"threads_started":1}
I20260811 08:11:36.936885 22942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:36.932802 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59376 (local address 127.27.243.193:33129)
0811 08:11:36.933009 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0811 08:11:36.933012 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:11:36.933022 (+ 10us) server_negotiation.cc:407] Connection header received
0811 08:11:36.933116 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:11:36.933118 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:11:36.933130 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:11:36.933210 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:11:36.933385 (+ 175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:36.934241 (+ 856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:36.935628 (+ 1387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:36.936350 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:36.936420 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:36.936473 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 08:11:36.936750 (+ 277us) server_negotiation.cc:299] Negotiation successful
0811 08:11:36.936798 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":181,"thread_start_us":80,"threads_started":1}
I20260811 08:11:36.937003 22933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:36.932536 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.193:33129 (local address 127.0.0.1:59376)
0811 08:11:36.932927 (+ 391us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:36.932972 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 08:11:36.933043 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:11:36.933227 (+ 184us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:11:36.933230 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:11:36.933233 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:11:36.933299 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:11:36.933301 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:11:36.934329 (+ 1028us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:11:36.934330 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:11:36.935532 (+ 1202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:11:36.935535 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:11:36.936431 (+ 896us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:11:36.936433 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:11:36.936524 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:36.936544 (+ 20us) client_negotiation.cc:769] Sending connection context
0811 08:11:36.936606 (+ 62us) client_negotiation.cc:240] Negotiation successful
0811 08:11:36.936661 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":333,"thread_start_us":59,"threads_started":1}
I20260811 08:11:36.937383 22931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:36.932538 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.195:36139 (local address 127.0.0.1:52918)
0811 08:11:36.933135 (+ 597us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:36.933142 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0811 08:11:36.933175 (+ 33us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:11:36.933433 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:11:36.933435 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:11:36.933437 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:11:36.933491 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:11:36.933492 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:11:36.934835 (+ 1343us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:11:36.934836 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:11:36.936002 (+ 1166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:11:36.936005 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:11:36.937180 (+ 1175us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:11:36.937181 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:11:36.937242 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:36.937246 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 08:11:36.937287 (+ 41us) client_negotiation.cc:240] Negotiation successful
0811 08:11:36.937323 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":589,"mutex_wait_us":25,"thread_start_us":56,"threads_started":1}
I20260811 08:11:36.937609 22609 tablet_service.cc:1467] Processing CreateTablet for tablet ddffc4f9220a4047a8c83e2e941e7c21 (DEFAULT_TABLE table=test-table [id=c9351e8387914961b8dd78fb367f17fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:11:36.937819 22934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:36.932693 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52918 (local address 127.27.243.195:36139)
0811 08:11:36.932894 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0811 08:11:36.932899 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 08:11:36.933211 (+ 312us) server_negotiation.cc:407] Connection header received
0811 08:11:36.933249 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:11:36.933251 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:11:36.933265 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:11:36.933360 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:11:36.933620 (+ 260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:36.934717 (+ 1097us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:36.936089 (+ 1372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:36.936754 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:36.936808 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:36.937606 (+ 798us) server_negotiation.cc:1035] Waiting for connection context
0811 08:11:36.937709 (+ 103us) server_negotiation.cc:299] Negotiation successful
0811 08:11:36.937749 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":163,"thread_start_us":108,"threads_started":1}
I20260811 08:11:36.937805 22377 tablet_service.cc:1467] Processing CreateTablet for tablet ddffc4f9220a4047a8c83e2e941e7c21 (DEFAULT_TABLE table=test-table [id=c9351e8387914961b8dd78fb367f17fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:11:36.938010 22609 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ddffc4f9220a4047a8c83e2e941e7c21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:11:36.938153 22377 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ddffc4f9220a4047a8c83e2e941e7c21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:11:36.940495 22944 tablet_bootstrap.cc:492] T ddffc4f9220a4047a8c83e2e941e7c21 P c8f2cd8efe604ee3aed222d9af32f8b7: Bootstrap starting.
I20260811 08:11:36.941179 22944 tablet_bootstrap.cc:654] T ddffc4f9220a4047a8c83e2e941e7c21 P c8f2cd8efe604ee3aed222d9af32f8b7: Neither blocks nor log segments found. Creating new log.
I20260811 08:11:36.941169 22820 tablet_service.cc:1467] Processing CreateTablet for tablet ddffc4f9220a4047a8c83e2e941e7c21 (DEFAULT_TABLE table=test-table [id=c9351e8387914961b8dd78fb367f17fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:11:36.941504 22820 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ddffc4f9220a4047a8c83e2e941e7c21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:11:36.941666 22946 tablet_bootstrap.cc:492] T ddffc4f9220a4047a8c83e2e941e7c21 P 2cb7dafc32a1405591a4fbc212c282f9: Bootstrap starting.
I20260811 08:11:36.941779 22944 log.cc:824] T ddffc4f9220a4047a8c83e2e941e7c21 P c8f2cd8efe604ee3aed222d9af32f8b7: Log is configured to *not* fsync() on all Append() calls
I20260811 08:11:36.942322 22946 tablet_bootstrap.cc:654] T ddffc4f9220a4047a8c83e2e941e7c21 P 2cb7dafc32a1405591a4fbc212c282f9: Neither blocks nor log segments found. Creating new log.
I20260811 08:11:36.942606 22944 tablet_bootstrap.cc:492] T ddffc4f9220a4047a8c83e2e941e7c21 P c8f2cd8efe604ee3aed222d9af32f8b7: No bootstrap required, opened a new log
I20260811 08:11:36.942682 22944 ts_tablet_manager.cc:1397] T ddffc4f9220a4047a8c83e2e941e7c21 P c8f2cd8efe604ee3aed222d9af32f8b7: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260811 08:11:36.942837 22946 log.cc:824] T ddffc4f9220a4047a8c83e2e941e7c21 P 2cb7dafc32a1405591a4fbc212c282f9: Log is configured to *not* fsync() on all Append() calls
I20260811 08:11:36.943471 22946 tablet_bootstrap.cc:492] T ddffc4f9220a4047a8c83e2e941e7c21 P 2cb7dafc32a1405591a4fbc212c282f9: No bootstrap required, opened a new log
I20260811 08:11:36.943531 22946 ts_tablet_manager.cc:1397] T ddffc4f9220a4047a8c83e2e941e7c21 P 2cb7dafc32a1405591a4fbc212c282f9: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 08:11:36.944671 22951 tablet_bootstrap.cc:492] T ddffc4f9220a4047a8c83e2e941e7c21 P 75394a5549a3402b81287c9bdaa9b097: Bootstrap starting.
I20260811 08:11:36.944653 22944 raft_consensus.cc:348] T ddffc4f9220a4047a8c83e2e941e7c21 P c8f2cd8efe604ee3aed222d9af32f8b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75394a5549a3402b81287c9bdaa9b097" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 36139 } } peers { permanent_uuid: "c8f2cd8efe604ee3aed222d9af32f8b7" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 42953 } } peers { permanent_uuid: "2cb7dafc32a1405591a4fbc212c282f9" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 33129 } }
I20260811 08:11:36.944837 22944 raft_consensus.cc:374] T ddffc4f9220a4047a8c83e2e941e7c21 P c8f2cd8efe604ee3aed222d9af32f8b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:11:36.944885 22944 raft_consensus.cc:729] T ddffc4f9220a4047a8c83e2e941e7c21 P c8f2cd8efe604ee3aed222d9af32f8b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8f2cd8efe604ee3aed222d9af32f8b7, State: Initialized, Role: FOLLOWER
I20260811 08:11:36.945025 22944 consensus_queue.cc:260] T ddffc4f9220a4047a8c83e2e941e7c21 P c8f2cd8efe604ee3aed222d9af32f8b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75394a5549a3402b81287c9bdaa9b097" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 36139 } } peers { permanent_uuid: "c8f2cd8efe604ee3aed222d9af32f8b7" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 42953 } } peers { permanent_uuid: "2cb7dafc32a1405591a4fbc212c282f9" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 33129 } }
I20260811 08:11:36.945279 22944 ts_tablet_manager.cc:1428] T ddffc4f9220a4047a8c83e2e941e7c21 P c8f2cd8efe604ee3aed222d9af32f8b7: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260811 08:11:36.945379 22951 tablet_bootstrap.cc:654] T ddffc4f9220a4047a8c83e2e941e7c21 P 75394a5549a3402b81287c9bdaa9b097: Neither blocks nor log segments found. Creating new log.
I20260811 08:11:36.945397 22707 heartbeater.cc:503] Master 127.27.243.254:36663 was elected leader, sending a full tablet report...
I20260811 08:11:36.945393 22946 raft_consensus.cc:348] T ddffc4f9220a4047a8c83e2e941e7c21 P 2cb7dafc32a1405591a4fbc212c282f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75394a5549a3402b81287c9bdaa9b097" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 36139 } } peers { permanent_uuid: "c8f2cd8efe604ee3aed222d9af32f8b7" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 42953 } } peers { permanent_uuid: "2cb7dafc32a1405591a4fbc212c282f9" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 33129 } }
I20260811 08:11:36.945580 22946 raft_consensus.cc:374] T ddffc4f9220a4047a8c83e2e941e7c21 P 2cb7dafc32a1405591a4fbc212c282f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:11:36.945616 22946 raft_consensus.cc:729] T ddffc4f9220a4047a8c83e2e941e7c21 P 2cb7dafc32a1405591a4fbc212c282f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cb7dafc32a1405591a4fbc212c282f9, State: Initialized, Role: FOLLOWER
I20260811 08:11:36.945771 22946 consensus_queue.cc:260] T ddffc4f9220a4047a8c83e2e941e7c21 P 2cb7dafc32a1405591a4fbc212c282f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75394a5549a3402b81287c9bdaa9b097" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 36139 } } peers { permanent_uuid: "c8f2cd8efe604ee3aed222d9af32f8b7" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 42953 } } peers { permanent_uuid: "2cb7dafc32a1405591a4fbc212c282f9" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 33129 } }
I20260811 08:11:36.945967 22951 log.cc:824] T ddffc4f9220a4047a8c83e2e941e7c21 P 75394a5549a3402b81287c9bdaa9b097: Log is configured to *not* fsync() on all Append() calls
I20260811 08:11:36.946064 22946 ts_tablet_manager.cc:1428] T ddffc4f9220a4047a8c83e2e941e7c21 P 2cb7dafc32a1405591a4fbc212c282f9: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260811 08:11:36.946184 22487 heartbeater.cc:503] Master 127.27.243.254:36663 was elected leader, sending a full tablet report...
I20260811 08:11:36.946851 22951 tablet_bootstrap.cc:492] T ddffc4f9220a4047a8c83e2e941e7c21 P 75394a5549a3402b81287c9bdaa9b097: No bootstrap required, opened a new log
I20260811 08:11:36.946969 22951 ts_tablet_manager.cc:1397] T ddffc4f9220a4047a8c83e2e941e7c21 P 75394a5549a3402b81287c9bdaa9b097: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260811 08:11:36.948313 22951 raft_consensus.cc:348] T ddffc4f9220a4047a8c83e2e941e7c21 P 75394a5549a3402b81287c9bdaa9b097 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75394a5549a3402b81287c9bdaa9b097" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 36139 } } peers { permanent_uuid: "c8f2cd8efe604ee3aed222d9af32f8b7" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 42953 } } peers { permanent_uuid: "2cb7dafc32a1405591a4fbc212c282f9" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 33129 } }
I20260811 08:11:36.948473 22951 raft_consensus.cc:374] T ddffc4f9220a4047a8c83e2e941e7c21 P 75394a5549a3402b81287c9bdaa9b097 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:11:36.948516 22951 raft_consensus.cc:729] T ddffc4f9220a4047a8c83e2e941e7c21 P 75394a5549a3402b81287c9bdaa9b097 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75394a5549a3402b81287c9bdaa9b097, State: Initialized, Role: FOLLOWER
I20260811 08:11:36.948625 22951 consensus_queue.cc:260] T ddffc4f9220a4047a8c83e2e941e7c21 P 75394a5549a3402b81287c9bdaa9b097 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75394a5549a3402b81287c9bdaa9b097" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 36139 } } peers { permanent_uuid: "c8f2cd8efe604ee3aed222d9af32f8b7" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 42953 } } peers { permanent_uuid: "2cb7dafc32a1405591a4fbc212c282f9" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 33129 } }
I20260811 08:11:36.948869 22951 ts_tablet_manager.cc:1428] T ddffc4f9220a4047a8c83e2e941e7c21 P 75394a5549a3402b81287c9bdaa9b097: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260811 08:11:36.948899 22916 heartbeater.cc:503] Master 127.27.243.254:36663 was elected leader, sending a full tablet report...
W20260811 08:11:37.005308 22708 tablet.cc:2369] T ddffc4f9220a4047a8c83e2e941e7c21 P c8f2cd8efe604ee3aed222d9af32f8b7: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 08:11:37.097744 22489 tablet.cc:2369] T ddffc4f9220a4047a8c83e2e941e7c21 P 2cb7dafc32a1405591a4fbc212c282f9: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 08:11:37.157673 22917 tablet.cc:2369] T ddffc4f9220a4047a8c83e2e941e7c21 P 75394a5549a3402b81287c9bdaa9b097: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 08:11:37.228721 22953 raft_consensus.cc:482] T ddffc4f9220a4047a8c83e2e941e7c21 P 2cb7dafc32a1405591a4fbc212c282f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:11:37.228909 22953 raft_consensus.cc:504] T ddffc4f9220a4047a8c83e2e941e7c21 P 2cb7dafc32a1405591a4fbc212c282f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75394a5549a3402b81287c9bdaa9b097" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 36139 } } peers { permanent_uuid: "c8f2cd8efe604ee3aed222d9af32f8b7" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 42953 } } peers { permanent_uuid: "2cb7dafc32a1405591a4fbc212c282f9" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 33129 } }
I20260811 08:11:37.229282 22953 leader_election.cc:288] T ddffc4f9220a4047a8c83e2e941e7c21 P 2cb7dafc32a1405591a4fbc212c282f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 75394a5549a3402b81287c9bdaa9b097 (127.27.243.195:36139), c8f2cd8efe604ee3aed222d9af32f8b7 (127.27.243.194:42953)
I20260811 08:11:37.232227 22934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:37.229652 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.193:38243 (local address 127.27.243.195:36139)
0811 08:11:37.229699 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 08:11:37.229701 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:11:37.229715 (+ 14us) server_negotiation.cc:407] Connection header received
0811 08:11:37.229800 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:11:37.229802 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:11:37.229811 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:11:37.229866 (+ 55us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:11:37.230040 (+ 174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:37.230561 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:37.231525 (+ 964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:37.231910 (+ 385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:37.231977 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:37.231986 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 08:11:37.232122 (+ 136us) server_negotiation.cc:299] Negotiation successful
0811 08:11:37.232157 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 08:11:37.232228 22943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:37.229577 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.193:45433 (local address 127.27.243.194:42953)
0811 08:11:37.229626 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 08:11:37.229628 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:11:37.229743 (+ 115us) server_negotiation.cc:407] Connection header received
0811 08:11:37.229890 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:11:37.229892 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:11:37.229902 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:11:37.229957 (+ 55us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:11:37.230119 (+ 162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:37.230578 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:37.231551 (+ 973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:37.231907 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:37.231965 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:37.231975 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 08:11:37.232123 (+ 148us) server_negotiation.cc:299] Negotiation successful
0811 08:11:37.232160 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 08:11:37.232254 22957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:37.229480 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.195:36139 (local address 127.27.243.193:38243)
0811 08:11:37.229659 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:37.229673 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 08:11:37.229730 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:11:37.229880 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:11:37.229881 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:11:37.229884 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:11:37.229976 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:11:37.229978 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:11:37.230635 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:11:37.230636 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:11:37.231446 (+ 810us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:11:37.231449 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:11:37.231986 (+ 537us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:11:37.231987 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:11:37.232059 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:37.232063 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 08:11:37.232110 (+ 47us) client_negotiation.cc:240] Negotiation successful
0811 08:11:37.232153 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":103,"threads_started":1}
I20260811 08:11:37.232259 22961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:37.229509 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.194:42953 (local address 127.27.243.193:45433)
0811 08:11:37.229673 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:37.229684 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 08:11:37.229769 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:11:37.229967 (+ 198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:11:37.229967 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:11:37.229969 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:11:37.230048 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:11:37.230050 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:11:37.230657 (+ 607us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:11:37.230658 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:11:37.231459 (+ 801us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:11:37.231462 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:11:37.231984 (+ 522us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:11:37.231985 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:11:37.232058 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:37.232062 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 08:11:37.232107 (+ 45us) client_negotiation.cc:240] Negotiation successful
0811 08:11:37.232154 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":63,"threads_started":1}
I20260811 08:11:37.232695 22851 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ddffc4f9220a4047a8c83e2e941e7c21" candidate_uuid: "2cb7dafc32a1405591a4fbc212c282f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75394a5549a3402b81287c9bdaa9b097" is_pre_election: true
I20260811 08:11:37.232744 22637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ddffc4f9220a4047a8c83e2e941e7c21" candidate_uuid: "2cb7dafc32a1405591a4fbc212c282f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8f2cd8efe604ee3aed222d9af32f8b7" is_pre_election: true
I20260811 08:11:37.232875 22637 raft_consensus.cc:2454] T ddffc4f9220a4047a8c83e2e941e7c21 P c8f2cd8efe604ee3aed222d9af32f8b7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cb7dafc32a1405591a4fbc212c282f9 in term 0.
I20260811 08:11:37.232869 22851 raft_consensus.cc:2454] T ddffc4f9220a4047a8c83e2e941e7c21 P 75394a5549a3402b81287c9bdaa9b097 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cb7dafc32a1405591a4fbc212c282f9 in term 0.
I20260811 08:11:37.233103 22290 leader_election.cc:302] T ddffc4f9220a4047a8c83e2e941e7c21 P 2cb7dafc32a1405591a4fbc212c282f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cb7dafc32a1405591a4fbc212c282f9, c8f2cd8efe604ee3aed222d9af32f8b7; no voters:
I20260811 08:11:37.233237 22953 raft_consensus.cc:2781] T ddffc4f9220a4047a8c83e2e941e7c21 P 2cb7dafc32a1405591a4fbc212c282f9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 08:11:37.233297 22953 raft_consensus.cc:482] T ddffc4f9220a4047a8c83e2e941e7c21 P 2cb7dafc32a1405591a4fbc212c282f9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 08:11:37.233315 22953 raft_consensus.cc:3037] T ddffc4f9220a4047a8c83e2e941e7c21 P 2cb7dafc32a1405591a4fbc212c282f9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:11:37.234095 22953 raft_consensus.cc:504] T ddffc4f9220a4047a8c83e2e941e7c21 P 2cb7dafc32a1405591a4fbc212c282f9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75394a5549a3402b81287c9bdaa9b097" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 36139 } } peers { permanent_uuid: "c8f2cd8efe604ee3aed222d9af32f8b7" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 42953 } } peers { permanent_uuid: "2cb7dafc32a1405591a4fbc212c282f9" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 33129 } }
I20260811 08:11:37.234217 22953 leader_election.cc:288] T ddffc4f9220a4047a8c83e2e941e7c21 P 2cb7dafc32a1405591a4fbc212c282f9 [CANDIDATE]: Term 1 election: Requested vote from peers 75394a5549a3402b81287c9bdaa9b097 (127.27.243.195:36139), c8f2cd8efe604ee3aed222d9af32f8b7 (127.27.243.194:42953)
I20260811 08:11:37.234373 22637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ddffc4f9220a4047a8c83e2e941e7c21" candidate_uuid: "2cb7dafc32a1405591a4fbc212c282f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8f2cd8efe604ee3aed222d9af32f8b7"
I20260811 08:11:37.234378 22851 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ddffc4f9220a4047a8c83e2e941e7c21" candidate_uuid: "2cb7dafc32a1405591a4fbc212c282f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75394a5549a3402b81287c9bdaa9b097"
I20260811 08:11:37.234454 22637 raft_consensus.cc:3037] T ddffc4f9220a4047a8c83e2e941e7c21 P c8f2cd8efe604ee3aed222d9af32f8b7 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:11:37.234454 22851 raft_consensus.cc:3037] T ddffc4f9220a4047a8c83e2e941e7c21 P 75394a5549a3402b81287c9bdaa9b097 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:11:37.235293 22851 raft_consensus.cc:2454] T ddffc4f9220a4047a8c83e2e941e7c21 P 75394a5549a3402b81287c9bdaa9b097 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cb7dafc32a1405591a4fbc212c282f9 in term 1.
I20260811 08:11:37.235293 22637 raft_consensus.cc:2454] T ddffc4f9220a4047a8c83e2e941e7c21 P c8f2cd8efe604ee3aed222d9af32f8b7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cb7dafc32a1405591a4fbc212c282f9 in term 1.
I20260811 08:11:37.235503 22290 leader_election.cc:302] T ddffc4f9220a4047a8c83e2e941e7c21 P 2cb7dafc32a1405591a4fbc212c282f9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cb7dafc32a1405591a4fbc212c282f9, c8f2cd8efe604ee3aed222d9af32f8b7; no voters:
I20260811 08:11:37.235586 22953 raft_consensus.cc:2781] T ddffc4f9220a4047a8c83e2e941e7c21 P 2cb7dafc32a1405591a4fbc212c282f9 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:11:37.235715 22953 raft_consensus.cc:686] T ddffc4f9220a4047a8c83e2e941e7c21 P 2cb7dafc32a1405591a4fbc212c282f9 [term 1 LEADER]: Becoming Leader. State: Replica: 2cb7dafc32a1405591a4fbc212c282f9, State: Running, Role: LEADER
I20260811 08:11:37.235823 22953 consensus_queue.cc:237] T ddffc4f9220a4047a8c83e2e941e7c21 P 2cb7dafc32a1405591a4fbc212c282f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75394a5549a3402b81287c9bdaa9b097" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 36139 } } peers { permanent_uuid: "c8f2cd8efe604ee3aed222d9af32f8b7" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 42953 } } peers { permanent_uuid: "2cb7dafc32a1405591a4fbc212c282f9" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 33129 } }
I20260811 08:11:37.236671 22154 catalog_manager.cc:5495] T ddffc4f9220a4047a8c83e2e941e7c21 P 2cb7dafc32a1405591a4fbc212c282f9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2cb7dafc32a1405591a4fbc212c282f9 (127.27.243.193). New cstate: current_term: 1 leader_uuid: "2cb7dafc32a1405591a4fbc212c282f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75394a5549a3402b81287c9bdaa9b097" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 36139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8f2cd8efe604ee3aed222d9af32f8b7" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 42953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cb7dafc32a1405591a4fbc212c282f9" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 33129 } health_report { overall_health: HEALTHY } } }
I20260811 08:11:37.287612 22942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:37.285194 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59386 (local address 127.27.243.193:33129)
0811 08:11:37.285251 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0811 08:11:37.285253 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:11:37.285261 (+ 8us) server_negotiation.cc:407] Connection header received
0811 08:11:37.285300 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:11:37.285301 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:11:37.285320 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:11:37.285387 (+ 67us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:11:37.285494 (+ 107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:37.285983 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:37.286845 (+ 862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:37.287043 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:37.287101 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:37.287233 (+ 132us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:11:37.287363 (+ 130us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:11:37.287425 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 08:11:37.287500 (+ 75us) server_negotiation.cc:299] Negotiation successful
0811 08:11:37.287526 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260811 08:11:37.289558 22851 raft_consensus.cc:1261] T ddffc4f9220a4047a8c83e2e941e7c21 P 75394a5549a3402b81287c9bdaa9b097 [term 1 FOLLOWER]: Refusing update from remote peer 2cb7dafc32a1405591a4fbc212c282f9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:11:37.289558 22637 raft_consensus.cc:1261] T ddffc4f9220a4047a8c83e2e941e7c21 P c8f2cd8efe604ee3aed222d9af32f8b7 [term 1 FOLLOWER]: Refusing update from remote peer 2cb7dafc32a1405591a4fbc212c282f9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:11:37.289943 22953 consensus_queue.cc:1035] T ddffc4f9220a4047a8c83e2e941e7c21 P 2cb7dafc32a1405591a4fbc212c282f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8f2cd8efe604ee3aed222d9af32f8b7" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 42953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:11:37.290096 22963 consensus_queue.cc:1035] T ddffc4f9220a4047a8c83e2e941e7c21 P 2cb7dafc32a1405591a4fbc212c282f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "75394a5549a3402b81287c9bdaa9b097" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 36139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:11:37.292573 22969 mvcc.cc:205] Tried to move back new op lower bound from 7317241435294928896 to 7317241435078500352. Current Snapshot: MvccSnapshot[applied={T|T < 7317241435294928896}]
I20260811 08:11:37.292747 22970 mvcc.cc:205] Tried to move back new op lower bound from 7317241435294928896 to 7317241435078500352. Current Snapshot: MvccSnapshot[applied={T|T < 7317241435294928896}]
I20260811 08:11:37.295132 22154 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38308:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:11:37.295219 22154 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38308:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:11:37.295934 22154 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 88ab4328a0b64bee8b9a009e9f299ae0: Sending DeleteTablet for 3 replicas of tablet ddffc4f9220a4047a8c83e2e941e7c21
I20260811 08:11:37.296317 22820 tablet_service.cc:1514] Processing DeleteTablet for tablet ddffc4f9220a4047a8c83e2e941e7c21 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:11:37 UTC) from {username='kudu', principal='kudu/127.27.243.254@KRBTEST.COM'} at 127.0.0.1:52918
I20260811 08:11:37.296342 22609 tablet_service.cc:1514] Processing DeleteTablet for tablet ddffc4f9220a4047a8c83e2e941e7c21 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:11:37 UTC) from {username='kudu', principal='kudu/127.27.243.254@KRBTEST.COM'} at 127.0.0.1:46076
I20260811 08:11:37.296341 22377 tablet_service.cc:1514] Processing DeleteTablet for tablet ddffc4f9220a4047a8c83e2e941e7c21 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:11:37 UTC) from {username='kudu', principal='kudu/127.27.243.254@KRBTEST.COM'} at 127.0.0.1:59376
I20260811 08:11:37.296561 22984 tablet_replica.cc:330] T ddffc4f9220a4047a8c83e2e941e7c21 P c8f2cd8efe604ee3aed222d9af32f8b7: stopping tablet replica
I20260811 08:11:37.296574 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 22262
I20260811 08:11:37.310516 22982 tablet_replica.cc:330] T ddffc4f9220a4047a8c83e2e941e7c21 P 75394a5549a3402b81287c9bdaa9b097: stopping tablet replica
I20260811 08:11:37.310501 22984 raft_consensus.cc:2229] T ddffc4f9220a4047a8c83e2e941e7c21 P c8f2cd8efe604ee3aed222d9af32f8b7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:11:37.310670 22982 raft_consensus.cc:2229] T ddffc4f9220a4047a8c83e2e941e7c21 P 75394a5549a3402b81287c9bdaa9b097 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:11:37.310690 22984 raft_consensus.cc:2258] T ddffc4f9220a4047a8c83e2e941e7c21 P c8f2cd8efe604ee3aed222d9af32f8b7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:11:37.310806 22982 raft_consensus.cc:2258] T ddffc4f9220a4047a8c83e2e941e7c21 P 75394a5549a3402b81287c9bdaa9b097 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:11:37.312178 22984 ts_tablet_manager.cc:1905] T ddffc4f9220a4047a8c83e2e941e7c21 P c8f2cd8efe604ee3aed222d9af32f8b7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:11:37.313848 22982 ts_tablet_manager.cc:1905] T ddffc4f9220a4047a8c83e2e941e7c21 P 75394a5549a3402b81287c9bdaa9b097: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:11:37.313913 22984 ts_tablet_manager.cc:1918] T ddffc4f9220a4047a8c83e2e941e7c21 P c8f2cd8efe604ee3aed222d9af32f8b7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:11:37.313994 22984 log.cc:1196] T ddffc4f9220a4047a8c83e2e941e7c21 P c8f2cd8efe604ee3aed222d9af32f8b7: Deleting WAL directory at /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-1/wal/wals/ddffc4f9220a4047a8c83e2e941e7c21
I20260811 08:11:37.314231 22984 ts_tablet_manager.cc:1939] T ddffc4f9220a4047a8c83e2e941e7c21 P c8f2cd8efe604ee3aed222d9af32f8b7: Deleting consensus metadata
I20260811 08:11:37.314700 22130 catalog_manager.cc:4841] TS c8f2cd8efe604ee3aed222d9af32f8b7 (127.27.243.194:42953): tablet ddffc4f9220a4047a8c83e2e941e7c21 (table test-table [id=c9351e8387914961b8dd78fb367f17fb]) successfully deleted
I20260811 08:11:37.315490 22982 ts_tablet_manager.cc:1918] T ddffc4f9220a4047a8c83e2e941e7c21 P 75394a5549a3402b81287c9bdaa9b097: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:11:37.315573 22982 log.cc:1196] T ddffc4f9220a4047a8c83e2e941e7c21 P 75394a5549a3402b81287c9bdaa9b097: Deleting WAL directory at /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-2/wal/wals/ddffc4f9220a4047a8c83e2e941e7c21
I20260811 08:11:37.315878 22982 ts_tablet_manager.cc:1939] T ddffc4f9220a4047a8c83e2e941e7c21 P 75394a5549a3402b81287c9bdaa9b097: Deleting consensus metadata
I20260811 08:11:37.316311 22129 catalog_manager.cc:4841] TS 75394a5549a3402b81287c9bdaa9b097 (127.27.243.195:36139): tablet ddffc4f9220a4047a8c83e2e941e7c21 (table test-table [id=c9351e8387914961b8dd78fb367f17fb]) successfully deleted
W20260811 08:11:37.318528 22128 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.27.243.193:33129 (error 108)
I20260811 08:11:37.318774 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 22497
I20260811 08:11:37.318976 22931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:37.318852 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.193:33129 (local address 127.0.0.1:59388)
0811 08:11:37.318910 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:37.318945 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.193:33129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260811 08:11:37.325968 22128 catalog_manager.cc:4584] TS 2cb7dafc32a1405591a4fbc212c282f9 (127.27.243.193:33129): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet ddffc4f9220a4047a8c83e2e941e7c21: Network error: Client connection negotiation failed: client connection to 127.27.243.193:33129: connect: Connection refused (error 111)
I20260811 08:11:37.330508 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 22715
I20260811 08:11:37.352809 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 22104
I20260811 08:11:57.361740 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.243.254:36663
--webserver_interface=127.27.243.254
--webserver_port=45689
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab
--principal=kudu/127.27.243.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:45239
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.243.254:36663
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:11:57.446815 22988 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:11:57.447016 22988 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:11:57.447037 22988 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:11:57.448241 22988 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260811 08:11:57.448284 22988 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260811 08:11:57.448297 22988 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260811 08:11:57.448310 22988 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:11:57.448323 22988 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:11:57.448339 22988 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:11:57.448350 22988 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:11:57.448367 22988 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:11:57.449836 22988 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:45239
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.27.243.254:36663
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab
--principal=kudu/127.27.243.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.243.254:36663
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.243.254
--webserver_port=45689
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22988
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:11:57.450033 22988 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:11:57.450205 22988 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:11:57.459506 22999 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:11:57.459507 22988 server_base.cc:1034] running on GCE node
W20260811 08:11:57.459558 23003 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:11:57.459518 23001 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:11:57.460050 22988 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:11:57.460359 22988 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:11:57.461539 22988 hybrid_clock.cc:648] HybridClock initialized: now 1786435917461491 us; error 35 us; skew 500 ppm
Aug 11 08:11:57 dist-test-slave-7lbf krb5kdc[22082](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435917, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:11:57.464169 22988 init.cc:377] Logged in from keytab as kudu/127.27.243.254@KRBTEST.COM (short username kudu)
I20260811 08:11:57.464632 22988 webserver.cc:460] Webserver started at http://127.27.243.254:45689/ using document root <none> and password file <none>
I20260811 08:11:57.464855 22988 fs_manager.cc:359] Metadata directory not provided
I20260811 08:11:57.464917 22988 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:11:57.466352 22988 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:11:57.467012 23014 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:11:57.467203 22988 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:11:57.467300 22988 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/master-0/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/master-0/wal
uuid: "88ab4328a0b64bee8b9a009e9f299ae0"
format_stamp: "Formatted at 2026-08-11 08:11:36 on dist-test-slave-7lbf"
server_key: "0cfc9385ba5920ef4c2161c532b9670f"
server_key_iv: "058869ea34ce19d5fe1723f607e9c5da"
server_key_version: "encryptionkey@0"
I20260811 08:11:57.467711 22988 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:11:57.475193 22988 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:11:57.476877 22988 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:11:57.477008 22988 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:11:57.480926 22988 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.254:36663
I20260811 08:11:57.480949 23106 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.254:36663 every 8 connection(s)
I20260811 08:11:57.481319 22988 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
I20260811 08:11:57.482803 23107 sys_catalog.cc:263] Verifying existing consensus state
I20260811 08:11:57.483415 23107 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 88ab4328a0b64bee8b9a009e9f299ae0: Bootstrap starting.
I20260811 08:11:57.488129 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 22988
I20260811 08:11:57.488471 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.243.193:33129
--local_ip_for_outbound_sockets=127.27.243.193
--tserver_master_addrs=127.27.243.254:36663
--webserver_port=45603
--webserver_interface=127.27.243.193
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.193.keytab
--principal=kudu/127.27.243.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:45239
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 08:11:57.492671 23107 log.cc:824] T 00000000000000000000000000000000 P 88ab4328a0b64bee8b9a009e9f299ae0: Log is configured to *not* fsync() on all Append() calls
I20260811 08:11:57.494745 23107 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 88ab4328a0b64bee8b9a009e9f299ae0: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 08:11:57.495026 23107 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 88ab4328a0b64bee8b9a009e9f299ae0: Bootstrap complete.
I20260811 08:11:57.497282 23107 raft_consensus.cc:348] T 00000000000000000000000000000000 P 88ab4328a0b64bee8b9a009e9f299ae0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88ab4328a0b64bee8b9a009e9f299ae0" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 36663 } }
I20260811 08:11:57.497509 23107 raft_consensus.cc:729] T 00000000000000000000000000000000 P 88ab4328a0b64bee8b9a009e9f299ae0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ab4328a0b64bee8b9a009e9f299ae0, State: Initialized, Role: FOLLOWER
I20260811 08:11:57.497694 23107 consensus_queue.cc:260] T 00000000000000000000000000000000 P 88ab4328a0b64bee8b9a009e9f299ae0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88ab4328a0b64bee8b9a009e9f299ae0" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 36663 } }
I20260811 08:11:57.497756 23107 raft_consensus.cc:388] T 00000000000000000000000000000000 P 88ab4328a0b64bee8b9a009e9f299ae0 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:11:57.497803 23107 raft_consensus.cc:482] T 00000000000000000000000000000000 P 88ab4328a0b64bee8b9a009e9f299ae0 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:11:57.497857 23107 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 88ab4328a0b64bee8b9a009e9f299ae0 [term 1 FOLLOWER]: Advancing to term 2
I20260811 08:11:57.498852 23107 raft_consensus.cc:504] T 00000000000000000000000000000000 P 88ab4328a0b64bee8b9a009e9f299ae0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88ab4328a0b64bee8b9a009e9f299ae0" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 36663 } }
I20260811 08:11:57.498940 23107 leader_election.cc:302] T 00000000000000000000000000000000 P 88ab4328a0b64bee8b9a009e9f299ae0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 88ab4328a0b64bee8b9a009e9f299ae0; no voters:
I20260811 08:11:57.499100 23107 leader_election.cc:288] T 00000000000000000000000000000000 P 88ab4328a0b64bee8b9a009e9f299ae0 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 08:11:57.499153 23114 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 88ab4328a0b64bee8b9a009e9f299ae0 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 08:11:57.499274 23114 raft_consensus.cc:686] T 00000000000000000000000000000000 P 88ab4328a0b64bee8b9a009e9f299ae0 [term 2 LEADER]: Becoming Leader. State: Replica: 88ab4328a0b64bee8b9a009e9f299ae0, State: Running, Role: LEADER
I20260811 08:11:57.499411 23107 sys_catalog.cc:564] T 00000000000000000000000000000000 P 88ab4328a0b64bee8b9a009e9f299ae0 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:11:57.499431 23114 consensus_queue.cc:237] T 00000000000000000000000000000000 P 88ab4328a0b64bee8b9a009e9f299ae0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88ab4328a0b64bee8b9a009e9f299ae0" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 36663 } }
I20260811 08:11:57.499763 23114 sys_catalog.cc:455] T 00000000000000000000000000000000 P 88ab4328a0b64bee8b9a009e9f299ae0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 88ab4328a0b64bee8b9a009e9f299ae0. Latest consensus state: current_term: 2 leader_uuid: "88ab4328a0b64bee8b9a009e9f299ae0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88ab4328a0b64bee8b9a009e9f299ae0" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 36663 } } }
I20260811 08:11:57.499852 23114 sys_catalog.cc:458] T 00000000000000000000000000000000 P 88ab4328a0b64bee8b9a009e9f299ae0 [sys.catalog]: This master's current role is: LEADER
I20260811 08:11:57.500200 23125 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:11:57.500478 23118 sys_catalog.cc:455] T 00000000000000000000000000000000 P 88ab4328a0b64bee8b9a009e9f299ae0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "88ab4328a0b64bee8b9a009e9f299ae0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88ab4328a0b64bee8b9a009e9f299ae0" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 36663 } } }
I20260811 08:11:57.500541 23118 sys_catalog.cc:458] T 00000000000000000000000000000000 P 88ab4328a0b64bee8b9a009e9f299ae0 [sys.catalog]: This master's current role is: LEADER
I20260811 08:11:57.501107 23125 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:11:57.501223 23125 catalog_manager.cc:1259] Loaded cluster ID: 2d8a477a994945359c8feb5b4afcd55e
I20260811 08:11:57.501273 23125 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:11:57.502573 23125 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:11:57.502971 23125 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 88ab4328a0b64bee8b9a009e9f299ae0: Loaded TSK: 0
I20260811 08:11:57.512655 23125 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 88ab4328a0b64bee8b9a009e9f299ae0: Generated new TSK 1
I20260811 08:11:57.512748 23125 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 08:11:57.573001 23110 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:11:57.573204 23110 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:11:57.573236 23110 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:11:57.574417 23110 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:11:57.574460 23110 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:11:57.574492 23110 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.243.193
I20260811 08:11:57.575925 23110 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:45239
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.193.keytab
--principal=kudu/127.27.243.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.243.193:33129
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.243.193
--webserver_port=45603
--tserver_master_addrs=127.27.243.254:36663
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23110
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.243.193
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:11:57.576155 23110 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:11:57.576362 23110 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:11:57.581019 23159 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:11:57.581382 23160 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:11:57.581614 23164 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:11:57.582861 23110 server_base.cc:1034] running on GCE node
I20260811 08:11:57.583063 23110 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:11:57.583279 23110 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:11:57.584474 23110 hybrid_clock.cc:648] HybridClock initialized: now 1786435917584455 us; error 39 us; skew 500 ppm
Aug 11 08:11:57 dist-test-slave-7lbf krb5kdc[22082](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435917, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:11:57.587028 23110 init.cc:377] Logged in from keytab as kudu/127.27.243.193@KRBTEST.COM (short username kudu)
I20260811 08:11:57.587478 23110 webserver.cc:460] Webserver started at http://127.27.243.193:45603/ using document root <none> and password file <none>
I20260811 08:11:57.587697 23110 fs_manager.cc:359] Metadata directory not provided
I20260811 08:11:57.587754 23110 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:11:57.589048 23110 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:11:57.589788 23175 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:11:57.589982 23110 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 08:11:57.590097 23110 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-0/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-0/wal
uuid: "2cb7dafc32a1405591a4fbc212c282f9"
format_stamp: "Formatted at 2026-08-11 08:11:36 on dist-test-slave-7lbf"
server_key: "e9e52c88d9c08a66afb2d3b76390e21c"
server_key_iv: "222fb2e1a4dc7faff7feb0034d4fb547"
server_key_version: "encryptionkey@0"
I20260811 08:11:57.590574 23110 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:11:57.602918 23110 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:11:57.605479 23110 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:11:57.605687 23110 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:11:57.605969 23110 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:11:57.606477 23187 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260811 08:11:57.608062 23110 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260811 08:11:57.608129 23110 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260811 08:11:57.608168 23110 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260811 08:11:57.609054 23110 ts_tablet_manager.cc:610] Registered 1 tablets
I20260811 08:11:57.609105 23110 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260811 08:11:57.609153 23187 tablet_bootstrap.cc:492] T ddffc4f9220a4047a8c83e2e941e7c21 P 2cb7dafc32a1405591a4fbc212c282f9: Bootstrap starting.
I20260811 08:11:57.617205 23110 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.193:33129
I20260811 08:11:57.617365 23370 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.193:33129 every 8 connection(s)
I20260811 08:11:57.617697 23110 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-0/data/info.pb
I20260811 08:11:57.619347 23187 log.cc:824] T ddffc4f9220a4047a8c83e2e941e7c21 P 2cb7dafc32a1405591a4fbc212c282f9: Log is configured to *not* fsync() on all Append() calls
I20260811 08:11:57.621392 23187 tablet_bootstrap.cc:492] T ddffc4f9220a4047a8c83e2e941e7c21 P 2cb7dafc32a1405591a4fbc212c282f9: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 08:11:57.621676 23187 tablet_bootstrap.cc:492] T ddffc4f9220a4047a8c83e2e941e7c21 P 2cb7dafc32a1405591a4fbc212c282f9: Bootstrap complete.
I20260811 08:11:57.622480 23187 ts_tablet_manager.cc:1397] T ddffc4f9220a4047a8c83e2e941e7c21 P 2cb7dafc32a1405591a4fbc212c282f9: Time spent bootstrapping tablet: real 0.013s user 0.000s sys 0.012s
I20260811 08:11:57.623639 23187 raft_consensus.cc:348] T ddffc4f9220a4047a8c83e2e941e7c21 P 2cb7dafc32a1405591a4fbc212c282f9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75394a5549a3402b81287c9bdaa9b097" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 36139 } } peers { permanent_uuid: "c8f2cd8efe604ee3aed222d9af32f8b7" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 42953 } } peers { permanent_uuid: "2cb7dafc32a1405591a4fbc212c282f9" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 33129 } }
I20260811 08:11:57.623878 23187 raft_consensus.cc:729] T ddffc4f9220a4047a8c83e2e941e7c21 P 2cb7dafc32a1405591a4fbc212c282f9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cb7dafc32a1405591a4fbc212c282f9, State: Initialized, Role: FOLLOWER
I20260811 08:11:57.624049 23187 consensus_queue.cc:260] T ddffc4f9220a4047a8c83e2e941e7c21 P 2cb7dafc32a1405591a4fbc212c282f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75394a5549a3402b81287c9bdaa9b097" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 36139 } } peers { permanent_uuid: "c8f2cd8efe604ee3aed222d9af32f8b7" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 42953 } } peers { permanent_uuid: "2cb7dafc32a1405591a4fbc212c282f9" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 33129 } }
I20260811 08:11:57.624341 23187 ts_tablet_manager.cc:1428] T ddffc4f9220a4047a8c83e2e941e7c21 P 2cb7dafc32a1405591a4fbc212c282f9: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260811 08:11:57.624500 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 23110
I20260811 08:11:57.624768 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.243.194:42953
--local_ip_for_outbound_sockets=127.27.243.194
--tserver_master_addrs=127.27.243.254:36663
--webserver_port=43279
--webserver_interface=127.27.243.194
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.194.keytab
--principal=kudu/127.27.243.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:45239
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 08:11:57 dist-test-slave-7lbf krb5kdc[22082](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435917, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.193@KRBTEST.COM for kudu/127.27.243.254@KRBTEST.COM
I20260811 08:11:57.637300 23378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:57.618592 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36663 (local address 127.27.243.193:48201)
0811 08:11:57.619578 (+ 986us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:57.619622 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 08:11:57.623977 (+ 4355us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:11:57.625841 (+ 1864us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:11:57.625845 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:11:57.626234 (+ 389us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:11:57.626528 (+ 294us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:11:57.626536 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:11:57.628236 (+ 1700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:11:57.628237 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:11:57.629468 (+ 1231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:11:57.629473 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:11:57.630319 (+ 846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:11:57.630321 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:11:57.630466 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:57.631108 (+ 642us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:11:57.631119 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:11:57.632997 (+ 1878us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:11:57.635329 (+ 2332us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:11:57.635337 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:11:57.635340 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:11:57.635680 (+ 340us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:11:57.635995 (+ 315us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:11:57.635996 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:11:57.635996 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:11:57.636141 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:11:57.636655 (+ 514us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:11:57.636662 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:11:57.636812 (+ 150us) client_negotiation.cc:769] Sending connection context
0811 08:11:57.636905 (+ 93us) client_negotiation.cc:240] Negotiation successful
0811 08:11:57.637072 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":946,"thread_start_us":102,"threads_started":1}
I20260811 08:11:57.637912 23381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:57.618726 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.193:48201 (local address 127.27.243.254:36663)
0811 08:11:57.618927 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0811 08:11:57.618937 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 08:11:57.619749 (+ 812us) server_negotiation.cc:407] Connection header received
0811 08:11:57.624245 (+ 4496us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:11:57.624252 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:11:57.624326 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:11:57.624476 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:11:57.626669 (+ 2193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:57.628099 (+ 1430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:57.629603 (+ 1504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:57.630216 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:57.630332 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:57.633194 (+ 2862us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:11:57.633198 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:11:57.633199 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:11:57.633211 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:11:57.635234 (+ 2023us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:11:57.635791 (+ 557us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:11:57.635794 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:11:57.635795 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:11:57.635915 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:11:57.636230 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:11:57.636231 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:11:57.636231 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:11:57.636543 (+ 312us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:11:57.636623 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 08:11:57.637597 (+ 974us) server_negotiation.cc:299] Negotiation successful
0811 08:11:57.637732 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":146,"thread_start_us":107,"threads_started":1}
I20260811 08:11:57.638541 23372 heartbeater.cc:347] Connected to a master server at 127.27.243.254:36663
I20260811 08:11:57.638641 23372 heartbeater.cc:464] Registering TS with master...
I20260811 08:11:57.638826 23372 heartbeater.cc:511] Master 127.27.243.254:36663 requested a full tablet report, sending...
I20260811 08:11:57.639582 23042 ts_manager.cc:194] Registered new tserver with Master: 2cb7dafc32a1405591a4fbc212c282f9 (127.27.243.193:33129)
I20260811 08:11:57.640759 23042 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.243.193@KRBTEST.COM'} at 127.27.243.193:48201
I20260811 08:11:57.641782 23372 heartbeater.cc:503] Master 127.27.243.254:36663 was elected leader, sending a full tablet report...
I20260811 08:11:57.645712 23387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:57.640440 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52050 (local address 127.27.243.193:33129)
0811 08:11:57.641634 (+ 1194us) server_negotiation.cc:206] Beginning negotiation
0811 08:11:57.641639 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 08:11:57.641652 (+ 13us) server_negotiation.cc:407] Connection header received
0811 08:11:57.641687 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:11:57.641689 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:11:57.641705 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:11:57.641805 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:11:57.642062 (+ 257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:57.643032 (+ 970us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:57.644541 (+ 1509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:57.645282 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:57.645354 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:57.645390 (+ 36us) server_negotiation.cc:1035] Waiting for connection context
0811 08:11:57.645618 (+ 228us) server_negotiation.cc:299] Negotiation successful
0811 08:11:57.645651 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1158,"thread_start_us":74,"threads_started":1}
I20260811 08:11:57.645733 23386 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:57.640196 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.193:33129 (local address 127.0.0.1:52050)
0811 08:11:57.640593 (+ 397us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:57.640627 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0811 08:11:57.640691 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:11:57.641885 (+ 1194us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:11:57.641888 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:11:57.641891 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:11:57.641960 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:11:57.641962 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:11:57.643129 (+ 1167us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:11:57.643130 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:11:57.644446 (+ 1316us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:11:57.644448 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:11:57.645368 (+ 920us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:11:57.645369 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:11:57.645460 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:57.645474 (+ 14us) client_negotiation.cc:769] Sending connection context
0811 08:11:57.645600 (+ 126us) client_negotiation.cc:240] Negotiation successful
0811 08:11:57.645658 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":369,"thread_start_us":83,"threads_started":1}
I20260811 08:11:57.646234 23233 tablet_service.cc:1514] Processing DeleteTablet for tablet ddffc4f9220a4047a8c83e2e941e7c21 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:11:37 UTC) from {username='kudu', principal='kudu/127.27.243.254@KRBTEST.COM'} at 127.0.0.1:52050
I20260811 08:11:57.646823 23388 tablet_replica.cc:330] stopping tablet replica
I20260811 08:11:57.646919 23388 raft_consensus.cc:2229] T ddffc4f9220a4047a8c83e2e941e7c21 P 2cb7dafc32a1405591a4fbc212c282f9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:11:57.646996 23388 raft_consensus.cc:2258] T ddffc4f9220a4047a8c83e2e941e7c21 P 2cb7dafc32a1405591a4fbc212c282f9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:11:57.647311 23388 ts_tablet_manager.cc:1905] T ddffc4f9220a4047a8c83e2e941e7c21 P 2cb7dafc32a1405591a4fbc212c282f9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:11:57.649581 23388 ts_tablet_manager.cc:1918] T ddffc4f9220a4047a8c83e2e941e7c21 P 2cb7dafc32a1405591a4fbc212c282f9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:11:57.649658 23388 log.cc:1196] T ddffc4f9220a4047a8c83e2e941e7c21 P 2cb7dafc32a1405591a4fbc212c282f9: Deleting WAL directory at /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-0/wal/wals/ddffc4f9220a4047a8c83e2e941e7c21
I20260811 08:11:57.649891 23388 ts_tablet_manager.cc:1939] T ddffc4f9220a4047a8c83e2e941e7c21 P 2cb7dafc32a1405591a4fbc212c282f9: Deleting consensus metadata
I20260811 08:11:57.650385 23017 catalog_manager.cc:4841] TS 2cb7dafc32a1405591a4fbc212c282f9 (127.27.243.193:33129): tablet ddffc4f9220a4047a8c83e2e941e7c21 (table test-table [id=c9351e8387914961b8dd78fb367f17fb]) successfully deleted
W20260811 08:11:57.713832 23385 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:11:57.714054 23385 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:11:57.714082 23385 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:11:57.715269 23385 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:11:57.715317 23385 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:11:57.715344 23385 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.243.194
I20260811 08:11:57.716766 23385 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:45239
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.194.keytab
--principal=kudu/127.27.243.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.243.194:42953
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.243.194
--webserver_port=43279
--tserver_master_addrs=127.27.243.254:36663
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23385
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.243.194
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:11:57.716986 23385 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:11:57.717185 23385 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:11:57.722195 23394 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:11:57.722204 23399 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:11:57.722237 23402 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:11:57.722498 23385 server_base.cc:1034] running on GCE node
I20260811 08:11:57.722697 23385 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:11:57.722967 23385 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:11:57.724131 23385 hybrid_clock.cc:648] HybridClock initialized: now 1786435917724118 us; error 34 us; skew 500 ppm
Aug 11 08:11:57 dist-test-slave-7lbf krb5kdc[22082](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435917, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:11:57.726586 23385 init.cc:377] Logged in from keytab as kudu/127.27.243.194@KRBTEST.COM (short username kudu)
I20260811 08:11:57.727042 23385 webserver.cc:460] Webserver started at http://127.27.243.194:43279/ using document root <none> and password file <none>
I20260811 08:11:57.727263 23385 fs_manager.cc:359] Metadata directory not provided
I20260811 08:11:57.727329 23385 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:11:57.728641 23385 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:11:57.729209 23414 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:11:57.729360 23385 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 08:11:57.729444 23385 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-1/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-1/wal
uuid: "c8f2cd8efe604ee3aed222d9af32f8b7"
format_stamp: "Formatted at 2026-08-11 08:11:36 on dist-test-slave-7lbf"
server_key: "dff413235383c27d44a46068ff840695"
server_key_iv: "2c3611adec0afc696e55f3a8f0dfbaa4"
server_key_version: "encryptionkey@0"
I20260811 08:11:57.729808 23385 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:11:57.757920 23385 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:11:57.759871 23385 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:11:57.760011 23385 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:11:57.760231 23385 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:11:57.760550 23385 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:11:57.760584 23385 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:11:57.760614 23385 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:11:57.760639 23385 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:11:57.766360 23385 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.194:42953
I20260811 08:11:57.766455 23608 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.194:42953 every 8 connection(s)
I20260811 08:11:57.766775 23385 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-1/data/info.pb
I20260811 08:11:57.771132 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 23385
I20260811 08:11:57.771399 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.243.195:36139
--local_ip_for_outbound_sockets=127.27.243.195
--tserver_master_addrs=127.27.243.254:36663
--webserver_port=33947
--webserver_interface=127.27.243.195
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.195.keytab
--principal=kudu/127.27.243.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:45239
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 08:11:57 dist-test-slave-7lbf krb5kdc[22082](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435917, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.194@KRBTEST.COM for kudu/127.27.243.254@KRBTEST.COM
I20260811 08:11:57.776549 23381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:57.767528 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.194:59679 (local address 127.27.243.254:36663)
0811 08:11:57.767588 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0811 08:11:57.767590 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:11:57.767773 (+ 183us) server_negotiation.cc:407] Connection header received
0811 08:11:57.768303 (+ 530us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:11:57.768305 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:11:57.768321 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:11:57.768386 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:11:57.769332 (+ 946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:57.769929 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:57.771051 (+ 1122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:57.771271 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:57.771351 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:57.773611 (+ 2260us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:11:57.773613 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:11:57.773613 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:11:57.773622 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:11:57.775105 (+ 1483us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:11:57.775522 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:11:57.775523 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:11:57.775523 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:11:57.775590 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:11:57.775818 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:11:57.775819 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:11:57.775820 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:11:57.775969 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:11:57.776042 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 08:11:57.776355 (+ 313us) server_negotiation.cc:299] Negotiation successful
0811 08:11:57.776452 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260811 08:11:57.776624 23612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:57.767494 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36663 (local address 127.27.243.194:59679)
0811 08:11:57.767647 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:57.767690 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 08:11:57.768186 (+ 496us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:11:57.768442 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:11:57.768445 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:11:57.769024 (+ 579us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:11:57.769227 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:11:57.769232 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:11:57.770025 (+ 793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:11:57.770027 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:11:57.770946 (+ 919us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:11:57.770949 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:11:57.771375 (+ 426us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:11:57.771377 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:11:57.771528 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:57.772064 (+ 536us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:11:57.772074 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:11:57.773497 (+ 1423us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:11:57.775191 (+ 1694us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:11:57.775199 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:11:57.775200 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:11:57.775445 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:11:57.775651 (+ 206us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:11:57.775652 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:11:57.775652 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:11:57.775750 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:11:57.776045 (+ 295us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:11:57.776053 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:11:57.776212 (+ 159us) client_negotiation.cc:769] Sending connection context
0811 08:11:57.776318 (+ 106us) client_negotiation.cc:240] Negotiation successful
0811 08:11:57.776453 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":82,"threads_started":1}
I20260811 08:11:57.777204 23610 heartbeater.cc:347] Connected to a master server at 127.27.243.254:36663
I20260811 08:11:57.777297 23610 heartbeater.cc:464] Registering TS with master...
I20260811 08:11:57.777483 23610 heartbeater.cc:511] Master 127.27.243.254:36663 requested a full tablet report, sending...
I20260811 08:11:57.777902 23042 ts_manager.cc:194] Registered new tserver with Master: c8f2cd8efe604ee3aed222d9af32f8b7 (127.27.243.194:42953)
I20260811 08:11:57.778254 23042 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.243.194@KRBTEST.COM'} at 127.27.243.194:59679
W20260811 08:11:57.864109 23613 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:11:57.864300 23613 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:11:57.864338 23613 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:11:57.865419 23613 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:11:57.865458 23613 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:11:57.865491 23613 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.243.195
I20260811 08:11:57.866935 23613 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:45239
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.195.keytab
--principal=kudu/127.27.243.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.243.195:36139
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.243.195
--webserver_port=33947
--tserver_master_addrs=127.27.243.254:36663
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23613
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.243.195
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:11:57.867148 23613 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:11:57.867349 23613 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:11:57.872109 23620 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:11:57.872092 23625 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:11:57.872094 23619 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:11:57.872459 23613 server_base.cc:1034] running on GCE node
I20260811 08:11:57.872661 23613 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:11:57.872871 23613 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:11:57.874009 23613 hybrid_clock.cc:648] HybridClock initialized: now 1786435917873996 us; error 30 us; skew 500 ppm
Aug 11 08:11:57 dist-test-slave-7lbf krb5kdc[22082](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435917, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:11:57.876345 23613 init.cc:377] Logged in from keytab as kudu/127.27.243.195@KRBTEST.COM (short username kudu)
I20260811 08:11:57.876775 23613 webserver.cc:460] Webserver started at http://127.27.243.195:33947/ using document root <none> and password file <none>
I20260811 08:11:57.876967 23613 fs_manager.cc:359] Metadata directory not provided
I20260811 08:11:57.877053 23613 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:11:57.878393 23613 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:11:57.878937 23633 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:11:57.879101 23613 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 08:11:57.879194 23613 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-2/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-2/wal
uuid: "75394a5549a3402b81287c9bdaa9b097"
format_stamp: "Formatted at 2026-08-11 08:11:36 on dist-test-slave-7lbf"
server_key: "77073bc16282d73bd0ad84483669dcb0"
server_key_iv: "25374abf12da4d37324e3c23f1b73cde"
server_key_version: "encryptionkey@0"
I20260811 08:11:57.879522 23613 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:11:57.891477 23613 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:11:57.893079 23613 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:11:57.893208 23613 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:11:57.893410 23613 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:11:57.893728 23613 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:11:57.893762 23613 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:11:57.893790 23613 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:11:57.893814 23613 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:11:57.900395 23613 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.195:36139
I20260811 08:11:57.900449 23816 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.195:36139 every 8 connection(s)
I20260811 08:11:57.900815 23613 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-2/data/info.pb
Aug 11 08:11:57 dist-test-slave-7lbf krb5kdc[22082](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435917, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.195@KRBTEST.COM for kudu/127.27.243.254@KRBTEST.COM
I20260811 08:11:57.909018 23381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:57.901532 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.195:45251 (local address 127.27.243.254:36663)
0811 08:11:57.901602 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0811 08:11:57.901605 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:11:57.901840 (+ 235us) server_negotiation.cc:407] Connection header received
0811 08:11:57.902312 (+ 472us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:11:57.902313 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:11:57.902325 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:11:57.902381 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:11:57.903241 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:57.903732 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:57.904697 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:57.904909 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:57.904969 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:57.906934 (+ 1965us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:11:57.906936 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:11:57.906936 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:11:57.906943 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:11:57.908005 (+ 1062us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:11:57.908347 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:11:57.908347 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:11:57.908348 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:11:57.908390 (+ 42us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:11:57.908562 (+ 172us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:11:57.908563 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:11:57.908563 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:11:57.908654 (+ 91us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:11:57.908697 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0811 08:11:57.908899 (+ 202us) server_negotiation.cc:299] Negotiation successful
0811 08:11:57.908955 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260811 08:11:57.909178 23819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:57.901553 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36663 (local address 127.27.243.195:45251)
0811 08:11:57.901726 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:57.901761 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0811 08:11:57.902222 (+ 461us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:11:57.902435 (+ 213us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:11:57.902438 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:11:57.902982 (+ 544us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:11:57.903170 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:11:57.903175 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:11:57.903820 (+ 645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:11:57.903821 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:11:57.904624 (+ 803us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:11:57.904627 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:11:57.904975 (+ 348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:11:57.904976 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:11:57.905071 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:57.905563 (+ 492us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:11:57.905573 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:11:57.906850 (+ 1277us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:11:57.908072 (+ 1222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:11:57.908079 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:11:57.908080 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:11:57.908282 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:11:57.908434 (+ 152us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:11:57.908434 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:11:57.908435 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:11:57.908521 (+ 86us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:11:57.908693 (+ 172us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:11:57.908696 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:11:57.908799 (+ 103us) client_negotiation.cc:769] Sending connection context
0811 08:11:57.908876 (+ 77us) client_negotiation.cc:240] Negotiation successful
0811 08:11:57.908985 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":97,"threads_started":1}
I20260811 08:11:57.909618 23817 heartbeater.cc:347] Connected to a master server at 127.27.243.254:36663
I20260811 08:11:57.909710 23817 heartbeater.cc:464] Registering TS with master...
I20260811 08:11:57.909884 23817 heartbeater.cc:511] Master 127.27.243.254:36663 requested a full tablet report, sending...
I20260811 08:11:57.910240 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 23613
I20260811 08:11:57.910305 23042 ts_manager.cc:194] Registered new tserver with Master: 75394a5549a3402b81287c9bdaa9b097 (127.27.243.195:36139)
I20260811 08:11:57.910796 23042 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.243.195@KRBTEST.COM'} at 127.27.243.195:45251
I20260811 08:11:57.916064 23381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:57.910629 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45714 (local address 127.27.243.254:36663)
0811 08:11:57.910662 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0811 08:11:57.910664 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:11:57.910856 (+ 192us) server_negotiation.cc:407] Connection header received
0811 08:11:57.910913 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:11:57.910914 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:11:57.910923 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:11:57.910968 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:11:57.911669 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:57.912137 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:57.912832 (+ 695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:57.913004 (+ 172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:57.913054 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:57.914146 (+ 1092us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:11:57.914147 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:11:57.914147 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:11:57.914153 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:11:57.915221 (+ 1068us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:11:57.915513 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:11:57.915513 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:11:57.915513 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:11:57.915563 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:11:57.915691 (+ 128us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:11:57.915691 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:11:57.915691 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:11:57.915779 (+ 88us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:11:57.915916 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0811 08:11:57.915947 (+ 31us) server_negotiation.cc:299] Negotiation successful
0811 08:11:57.916008 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260811 08:11:57.916729 28623 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 08:11:57.919263 23381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:57.917096 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45716 (local address 127.27.243.254:36663)
0811 08:11:57.917128 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0811 08:11:57.917130 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:11:57.917248 (+ 118us) server_negotiation.cc:407] Connection header received
0811 08:11:57.917316 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:11:57.917316 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:11:57.917344 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:11:57.917402 (+ 58us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:11:57.917503 (+ 101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:57.917973 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:57.918659 (+ 686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:57.918909 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:57.918960 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:57.919087 (+ 127us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:11:57.919125 (+ 38us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0811 08:11:57.919226 (+ 101us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:45716: token expired
Metrics: {"server-negotiator.queue_time_us":16}
W20260811 08:11:57.919303 23381 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:45716: token expired
W20260811 08:11:57.920181 22922 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.27.243.254:36663)
I20260811 08:11:57.925261 23381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:57.920431 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45726 (local address 127.27.243.254:36663)
0811 08:11:57.920476 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 08:11:57.920477 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 08:11:57.920484 (+ 7us) server_negotiation.cc:407] Connection header received
0811 08:11:57.920517 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:11:57.920518 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:11:57.920524 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:11:57.920563 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:11:57.920988 (+ 425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:57.921418 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:57.922124 (+ 706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:57.922293 (+ 169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:57.922340 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:57.923352 (+ 1012us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:11:57.923353 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:11:57.923353 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:11:57.923364 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:11:57.924388 (+ 1024us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:11:57.924678 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:11:57.924679 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:11:57.924679 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:11:57.924720 (+ 41us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:11:57.924894 (+ 174us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:11:57.924894 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:11:57.924894 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:11:57.925007 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:11:57.925078 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 08:11:57.925158 (+ 80us) server_negotiation.cc:299] Negotiation successful
0811 08:11:57.925211 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 08:11:57.926369 23042 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45726:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 08:11:57.927878 23042 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 08:11:57.930006 23233 tablet_service.cc:1467] Processing CreateTablet for tablet cbdebdd43add46b88b7bc77f6968ed7f (DEFAULT_TABLE table=test-table [id=9b12ee9d303241fb8e025ffcfb1fa2ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:11:57.930214 23233 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cbdebdd43add46b88b7bc77f6968ed7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:11:57.931751 23187 tablet_bootstrap.cc:492] T cbdebdd43add46b88b7bc77f6968ed7f P 2cb7dafc32a1405591a4fbc212c282f9: Bootstrap starting.
I20260811 08:11:57.932188 23187 tablet_bootstrap.cc:654] T cbdebdd43add46b88b7bc77f6968ed7f P 2cb7dafc32a1405591a4fbc212c282f9: Neither blocks nor log segments found. Creating new log.
I20260811 08:11:57.932921 23187 tablet_bootstrap.cc:492] T cbdebdd43add46b88b7bc77f6968ed7f P 2cb7dafc32a1405591a4fbc212c282f9: No bootstrap required, opened a new log
I20260811 08:11:57.932977 23187 ts_tablet_manager.cc:1397] T cbdebdd43add46b88b7bc77f6968ed7f P 2cb7dafc32a1405591a4fbc212c282f9: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260811 08:11:57.933130 23187 raft_consensus.cc:348] T cbdebdd43add46b88b7bc77f6968ed7f P 2cb7dafc32a1405591a4fbc212c282f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75394a5549a3402b81287c9bdaa9b097" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 36139 } } peers { permanent_uuid: "c8f2cd8efe604ee3aed222d9af32f8b7" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 42953 } } peers { permanent_uuid: "2cb7dafc32a1405591a4fbc212c282f9" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 33129 } }
I20260811 08:11:57.933205 23187 raft_consensus.cc:374] T cbdebdd43add46b88b7bc77f6968ed7f P 2cb7dafc32a1405591a4fbc212c282f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:11:57.933249 23187 raft_consensus.cc:729] T cbdebdd43add46b88b7bc77f6968ed7f P 2cb7dafc32a1405591a4fbc212c282f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cb7dafc32a1405591a4fbc212c282f9, State: Initialized, Role: FOLLOWER
I20260811 08:11:57.933293 23187 consensus_queue.cc:260] T cbdebdd43add46b88b7bc77f6968ed7f P 2cb7dafc32a1405591a4fbc212c282f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75394a5549a3402b81287c9bdaa9b097" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 36139 } } peers { permanent_uuid: "c8f2cd8efe604ee3aed222d9af32f8b7" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 42953 } } peers { permanent_uuid: "2cb7dafc32a1405591a4fbc212c282f9" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 33129 } }
I20260811 08:11:57.933353 23386 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:57.929509 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.195:36139 (local address 127.0.0.1:39260)
0811 08:11:57.929574 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:57.929583 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 08:11:57.929618 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:11:57.930019 (+ 401us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:11:57.930020 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:11:57.930022 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:11:57.930059 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:11:57.930060 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:11:57.931105 (+ 1045us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:11:57.931106 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:11:57.932095 (+ 989us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:11:57.932097 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:11:57.933126 (+ 1029us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:11:57.933127 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:11:57.933190 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:57.933193 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 08:11:57.933244 (+ 51us) client_negotiation.cc:240] Negotiation successful
0811 08:11:57.933288 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":49}
I20260811 08:11:57.933398 23187 ts_tablet_manager.cc:1428] T cbdebdd43add46b88b7bc77f6968ed7f P 2cb7dafc32a1405591a4fbc212c282f9: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260811 08:11:57.933383 23829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:57.929676 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39260 (local address 127.27.243.195:36139)
0811 08:11:57.929881 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0811 08:11:57.929885 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 08:11:57.929894 (+ 9us) server_negotiation.cc:407] Connection header received
0811 08:11:57.929926 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:11:57.929927 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:11:57.929940 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:11:57.930007 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:11:57.930114 (+ 107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:57.931031 (+ 917us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:57.932175 (+ 1144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:57.932947 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:57.933120 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:57.933187 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 08:11:57.933260 (+ 73us) server_negotiation.cc:299] Negotiation successful
0811 08:11:57.933299 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":170,"thread_start_us":119,"threads_started":1}
I20260811 08:11:57.934072 23711 tablet_service.cc:1467] Processing CreateTablet for tablet cbdebdd43add46b88b7bc77f6968ed7f (DEFAULT_TABLE table=test-table [id=9b12ee9d303241fb8e025ffcfb1fa2ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:11:57.934383 23711 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cbdebdd43add46b88b7bc77f6968ed7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:11:57.935333 23822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:57.929644 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.194:42953 (local address 127.0.0.1:45840)
0811 08:11:57.929740 (+ 96us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:57.929748 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 08:11:57.929825 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:11:57.932083 (+ 2258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:11:57.932085 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:11:57.932087 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:11:57.932121 (+ 34us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:11:57.932122 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:11:57.933215 (+ 1093us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:11:57.933216 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:11:57.934249 (+ 1033us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:11:57.934253 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:11:57.935108 (+ 855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:11:57.935109 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:11:57.935175 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:57.935179 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 08:11:57.935226 (+ 47us) client_negotiation.cc:240] Negotiation successful
0811 08:11:57.935266 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":84,"thread_start_us":61,"threads_started":1}
I20260811 08:11:57.935400 23823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:57.929658 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45840 (local address 127.27.243.194:42953)
0811 08:11:57.931843 (+ 2185us) server_negotiation.cc:206] Beginning negotiation
0811 08:11:57.931847 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 08:11:57.931859 (+ 12us) server_negotiation.cc:407] Connection header received
0811 08:11:57.931895 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:11:57.931897 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:11:57.931912 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:11:57.931987 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:11:57.932191 (+ 204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:57.933128 (+ 937us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:57.934326 (+ 1198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:57.935032 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:57.935111 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:57.935160 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0811 08:11:57.935257 (+ 97us) server_negotiation.cc:299] Negotiation successful
0811 08:11:57.935304 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2146,"thread_start_us":75,"threads_started":1}
I20260811 08:11:57.936005 23503 tablet_service.cc:1467] Processing CreateTablet for tablet cbdebdd43add46b88b7bc77f6968ed7f (DEFAULT_TABLE table=test-table [id=9b12ee9d303241fb8e025ffcfb1fa2ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:11:57.936301 23503 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cbdebdd43add46b88b7bc77f6968ed7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:11:57.937249 23833 tablet_bootstrap.cc:492] T cbdebdd43add46b88b7bc77f6968ed7f P 75394a5549a3402b81287c9bdaa9b097: Bootstrap starting.
I20260811 08:11:57.937963 23833 tablet_bootstrap.cc:654] T cbdebdd43add46b88b7bc77f6968ed7f P 75394a5549a3402b81287c9bdaa9b097: Neither blocks nor log segments found. Creating new log.
I20260811 08:11:57.938447 23833 log.cc:824] T cbdebdd43add46b88b7bc77f6968ed7f P 75394a5549a3402b81287c9bdaa9b097: Log is configured to *not* fsync() on all Append() calls
I20260811 08:11:57.939074 23833 tablet_bootstrap.cc:492] T cbdebdd43add46b88b7bc77f6968ed7f P 75394a5549a3402b81287c9bdaa9b097: No bootstrap required, opened a new log
I20260811 08:11:57.939131 23833 ts_tablet_manager.cc:1397] T cbdebdd43add46b88b7bc77f6968ed7f P 75394a5549a3402b81287c9bdaa9b097: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260811 08:11:57.939263 23835 tablet_bootstrap.cc:492] T cbdebdd43add46b88b7bc77f6968ed7f P c8f2cd8efe604ee3aed222d9af32f8b7: Bootstrap starting.
I20260811 08:11:57.939774 23835 tablet_bootstrap.cc:654] T cbdebdd43add46b88b7bc77f6968ed7f P c8f2cd8efe604ee3aed222d9af32f8b7: Neither blocks nor log segments found. Creating new log.
I20260811 08:11:57.940253 23835 log.cc:824] T cbdebdd43add46b88b7bc77f6968ed7f P c8f2cd8efe604ee3aed222d9af32f8b7: Log is configured to *not* fsync() on all Append() calls
I20260811 08:11:57.940541 23833 raft_consensus.cc:348] T cbdebdd43add46b88b7bc77f6968ed7f P 75394a5549a3402b81287c9bdaa9b097 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75394a5549a3402b81287c9bdaa9b097" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 36139 } } peers { permanent_uuid: "c8f2cd8efe604ee3aed222d9af32f8b7" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 42953 } } peers { permanent_uuid: "2cb7dafc32a1405591a4fbc212c282f9" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 33129 } }
I20260811 08:11:57.940675 23833 raft_consensus.cc:374] T cbdebdd43add46b88b7bc77f6968ed7f P 75394a5549a3402b81287c9bdaa9b097 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:11:57.940698 23833 raft_consensus.cc:729] T cbdebdd43add46b88b7bc77f6968ed7f P 75394a5549a3402b81287c9bdaa9b097 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75394a5549a3402b81287c9bdaa9b097, State: Initialized, Role: FOLLOWER
I20260811 08:11:57.940805 23833 consensus_queue.cc:260] T cbdebdd43add46b88b7bc77f6968ed7f P 75394a5549a3402b81287c9bdaa9b097 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75394a5549a3402b81287c9bdaa9b097" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 36139 } } peers { permanent_uuid: "c8f2cd8efe604ee3aed222d9af32f8b7" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 42953 } } peers { permanent_uuid: "2cb7dafc32a1405591a4fbc212c282f9" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 33129 } }
I20260811 08:11:57.940913 23835 tablet_bootstrap.cc:492] T cbdebdd43add46b88b7bc77f6968ed7f P c8f2cd8efe604ee3aed222d9af32f8b7: No bootstrap required, opened a new log
I20260811 08:11:57.940976 23835 ts_tablet_manager.cc:1397] T cbdebdd43add46b88b7bc77f6968ed7f P c8f2cd8efe604ee3aed222d9af32f8b7: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 08:11:57.941071 23833 ts_tablet_manager.cc:1428] T cbdebdd43add46b88b7bc77f6968ed7f P 75394a5549a3402b81287c9bdaa9b097: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260811 08:11:57.941080 23817 heartbeater.cc:503] Master 127.27.243.254:36663 was elected leader, sending a full tablet report...
I20260811 08:11:57.942611 23835 raft_consensus.cc:348] T cbdebdd43add46b88b7bc77f6968ed7f P c8f2cd8efe604ee3aed222d9af32f8b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75394a5549a3402b81287c9bdaa9b097" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 36139 } } peers { permanent_uuid: "c8f2cd8efe604ee3aed222d9af32f8b7" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 42953 } } peers { permanent_uuid: "2cb7dafc32a1405591a4fbc212c282f9" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 33129 } }
I20260811 08:11:57.942739 23835 raft_consensus.cc:374] T cbdebdd43add46b88b7bc77f6968ed7f P c8f2cd8efe604ee3aed222d9af32f8b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:11:57.942770 23835 raft_consensus.cc:729] T cbdebdd43add46b88b7bc77f6968ed7f P c8f2cd8efe604ee3aed222d9af32f8b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8f2cd8efe604ee3aed222d9af32f8b7, State: Initialized, Role: FOLLOWER
I20260811 08:11:57.942876 23835 consensus_queue.cc:260] T cbdebdd43add46b88b7bc77f6968ed7f P c8f2cd8efe604ee3aed222d9af32f8b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75394a5549a3402b81287c9bdaa9b097" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 36139 } } peers { permanent_uuid: "c8f2cd8efe604ee3aed222d9af32f8b7" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 42953 } } peers { permanent_uuid: "2cb7dafc32a1405591a4fbc212c282f9" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 33129 } }
I20260811 08:11:57.943120 23835 ts_tablet_manager.cc:1428] T cbdebdd43add46b88b7bc77f6968ed7f P c8f2cd8efe604ee3aed222d9af32f8b7: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 08:11:57.943166 23610 heartbeater.cc:503] Master 127.27.243.254:36663 was elected leader, sending a full tablet report...
I20260811 08:11:57.989373 23838 raft_consensus.cc:482] T cbdebdd43add46b88b7bc77f6968ed7f P 75394a5549a3402b81287c9bdaa9b097 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:11:57.989490 23838 raft_consensus.cc:504] T cbdebdd43add46b88b7bc77f6968ed7f P 75394a5549a3402b81287c9bdaa9b097 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75394a5549a3402b81287c9bdaa9b097" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 36139 } } peers { permanent_uuid: "c8f2cd8efe604ee3aed222d9af32f8b7" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 42953 } } peers { permanent_uuid: "2cb7dafc32a1405591a4fbc212c282f9" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 33129 } }
I20260811 08:11:57.989851 23838 leader_election.cc:288] T cbdebdd43add46b88b7bc77f6968ed7f P 75394a5549a3402b81287c9bdaa9b097 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c8f2cd8efe604ee3aed222d9af32f8b7 (127.27.243.194:42953), 2cb7dafc32a1405591a4fbc212c282f9 (127.27.243.193:33129)
I20260811 08:11:57.993552 23387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:57.990086 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.195:37487 (local address 127.27.243.193:33129)
0811 08:11:57.990127 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0811 08:11:57.990129 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:11:57.990137 (+ 8us) server_negotiation.cc:407] Connection header received
0811 08:11:57.990210 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:11:57.990212 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:11:57.990221 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:11:57.990277 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:11:57.990434 (+ 157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:57.991206 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:57.992583 (+ 1377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:57.993143 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:57.993220 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:57.993229 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 08:11:57.993406 (+ 177us) server_negotiation.cc:299] Negotiation successful
0811 08:11:57.993452 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 08:11:57.993542 23823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:57.990087 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.195:54745 (local address 127.27.243.194:42953)
0811 08:11:57.990152 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0811 08:11:57.990154 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:11:57.990271 (+ 117us) server_negotiation.cc:407] Connection header received
0811 08:11:57.990307 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:11:57.990308 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:11:57.990317 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:11:57.990366 (+ 49us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:11:57.990497 (+ 131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:57.991204 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:57.992584 (+ 1380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:57.993153 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:57.993220 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:57.993229 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 08:11:57.993411 (+ 182us) server_negotiation.cc:299] Negotiation successful
0811 08:11:57.993452 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 08:11:57.993563 23819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:57.990023 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.193:33129 (local address 127.27.243.195:37487)
0811 08:11:57.990079 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:57.990090 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 08:11:57.990131 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:11:57.990293 (+ 162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:11:57.990294 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:11:57.990295 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:11:57.990368 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:11:57.990370 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:11:57.991291 (+ 921us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:11:57.991292 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:11:57.992494 (+ 1202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:11:57.992497 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:11:57.993236 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:11:57.993237 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:11:57.993328 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:57.993333 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 08:11:57.993393 (+ 60us) client_negotiation.cc:240] Negotiation successful
0811 08:11:57.993437 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36,"mutex_wait_us":4}
I20260811 08:11:57.993571 23840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:57.990047 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.194:42953 (local address 127.27.243.195:54745)
0811 08:11:57.990201 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:57.990210 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 08:11:57.990261 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:11:57.990374 (+ 113us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:11:57.990375 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:11:57.990376 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:11:57.990439 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:11:57.990440 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:11:57.991301 (+ 861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:11:57.991302 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:11:57.992494 (+ 1192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:11:57.992497 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:11:57.993236 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:11:57.993237 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:11:57.993349 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:57.993352 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 08:11:57.993406 (+ 54us) client_negotiation.cc:240] Negotiation successful
0811 08:11:57.993439 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"mutex_wait_us":27,"thread_start_us":90,"threads_started":1}
I20260811 08:11:57.993912 23296 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cbdebdd43add46b88b7bc77f6968ed7f" candidate_uuid: "75394a5549a3402b81287c9bdaa9b097" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cb7dafc32a1405591a4fbc212c282f9" is_pre_election: true
I20260811 08:11:57.994086 23296 raft_consensus.cc:2454] T cbdebdd43add46b88b7bc77f6968ed7f P 2cb7dafc32a1405591a4fbc212c282f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 75394a5549a3402b81287c9bdaa9b097 in term 0.
I20260811 08:11:57.994164 23532 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cbdebdd43add46b88b7bc77f6968ed7f" candidate_uuid: "75394a5549a3402b81287c9bdaa9b097" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8f2cd8efe604ee3aed222d9af32f8b7" is_pre_election: true
I20260811 08:11:57.994315 23532 raft_consensus.cc:2454] T cbdebdd43add46b88b7bc77f6968ed7f P c8f2cd8efe604ee3aed222d9af32f8b7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 75394a5549a3402b81287c9bdaa9b097 in term 0.
I20260811 08:11:57.994324 23635 leader_election.cc:302] T cbdebdd43add46b88b7bc77f6968ed7f P 75394a5549a3402b81287c9bdaa9b097 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cb7dafc32a1405591a4fbc212c282f9, 75394a5549a3402b81287c9bdaa9b097; no voters:
I20260811 08:11:57.994436 23838 raft_consensus.cc:2781] T cbdebdd43add46b88b7bc77f6968ed7f P 75394a5549a3402b81287c9bdaa9b097 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 08:11:57.994491 23838 raft_consensus.cc:482] T cbdebdd43add46b88b7bc77f6968ed7f P 75394a5549a3402b81287c9bdaa9b097 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 08:11:57.994513 23838 raft_consensus.cc:3037] T cbdebdd43add46b88b7bc77f6968ed7f P 75394a5549a3402b81287c9bdaa9b097 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:11:57.995231 23838 raft_consensus.cc:504] T cbdebdd43add46b88b7bc77f6968ed7f P 75394a5549a3402b81287c9bdaa9b097 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75394a5549a3402b81287c9bdaa9b097" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 36139 } } peers { permanent_uuid: "c8f2cd8efe604ee3aed222d9af32f8b7" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 42953 } } peers { permanent_uuid: "2cb7dafc32a1405591a4fbc212c282f9" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 33129 } }
I20260811 08:11:57.995380 23838 leader_election.cc:288] T cbdebdd43add46b88b7bc77f6968ed7f P 75394a5549a3402b81287c9bdaa9b097 [CANDIDATE]: Term 1 election: Requested vote from peers c8f2cd8efe604ee3aed222d9af32f8b7 (127.27.243.194:42953), 2cb7dafc32a1405591a4fbc212c282f9 (127.27.243.193:33129)
I20260811 08:11:57.995525 23296 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cbdebdd43add46b88b7bc77f6968ed7f" candidate_uuid: "75394a5549a3402b81287c9bdaa9b097" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cb7dafc32a1405591a4fbc212c282f9"
I20260811 08:11:57.995532 23532 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cbdebdd43add46b88b7bc77f6968ed7f" candidate_uuid: "75394a5549a3402b81287c9bdaa9b097" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8f2cd8efe604ee3aed222d9af32f8b7"
I20260811 08:11:57.995602 23296 raft_consensus.cc:3037] T cbdebdd43add46b88b7bc77f6968ed7f P 2cb7dafc32a1405591a4fbc212c282f9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:11:57.995604 23532 raft_consensus.cc:3037] T cbdebdd43add46b88b7bc77f6968ed7f P c8f2cd8efe604ee3aed222d9af32f8b7 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:11:57.996397 23532 raft_consensus.cc:2454] T cbdebdd43add46b88b7bc77f6968ed7f P c8f2cd8efe604ee3aed222d9af32f8b7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 75394a5549a3402b81287c9bdaa9b097 in term 1.
I20260811 08:11:57.996569 23639 leader_election.cc:302] T cbdebdd43add46b88b7bc77f6968ed7f P 75394a5549a3402b81287c9bdaa9b097 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 75394a5549a3402b81287c9bdaa9b097, c8f2cd8efe604ee3aed222d9af32f8b7; no voters:
I20260811 08:11:57.996622 23296 raft_consensus.cc:2454] T cbdebdd43add46b88b7bc77f6968ed7f P 2cb7dafc32a1405591a4fbc212c282f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 75394a5549a3402b81287c9bdaa9b097 in term 1.
I20260811 08:11:57.996659 23838 raft_consensus.cc:2781] T cbdebdd43add46b88b7bc77f6968ed7f P 75394a5549a3402b81287c9bdaa9b097 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:11:57.996806 23838 raft_consensus.cc:686] T cbdebdd43add46b88b7bc77f6968ed7f P 75394a5549a3402b81287c9bdaa9b097 [term 1 LEADER]: Becoming Leader. State: Replica: 75394a5549a3402b81287c9bdaa9b097, State: Running, Role: LEADER
I20260811 08:11:57.996892 23838 consensus_queue.cc:237] T cbdebdd43add46b88b7bc77f6968ed7f P 75394a5549a3402b81287c9bdaa9b097 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75394a5549a3402b81287c9bdaa9b097" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 36139 } } peers { permanent_uuid: "c8f2cd8efe604ee3aed222d9af32f8b7" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 42953 } } peers { permanent_uuid: "2cb7dafc32a1405591a4fbc212c282f9" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 33129 } }
I20260811 08:11:57.997654 23042 catalog_manager.cc:5495] T cbdebdd43add46b88b7bc77f6968ed7f P 75394a5549a3402b81287c9bdaa9b097 reported cstate change: term changed from 0 to 1, leader changed from <none> to 75394a5549a3402b81287c9bdaa9b097 (127.27.243.195). New cstate: current_term: 1 leader_uuid: "75394a5549a3402b81287c9bdaa9b097" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75394a5549a3402b81287c9bdaa9b097" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 36139 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8f2cd8efe604ee3aed222d9af32f8b7" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 42953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cb7dafc32a1405591a4fbc212c282f9" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 33129 } health_report { overall_health: UNKNOWN } } }
I20260811 08:11:58.005604 23829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:58.003446 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39262 (local address 127.27.243.195:36139)
0811 08:11:58.003492 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 08:11:58.003494 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:11:58.003500 (+ 6us) server_negotiation.cc:407] Connection header received
0811 08:11:58.003527 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:11:58.003527 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:11:58.003542 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:11:58.003597 (+ 55us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:11:58.003693 (+ 96us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:58.004133 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:58.004862 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:11:58.005149 (+ 287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:11:58.005209 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:11:58.005323 (+ 114us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:11:58.005417 (+ 94us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:11:58.005470 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 08:11:58.005482 (+ 12us) server_negotiation.cc:299] Negotiation successful
0811 08:11:58.005498 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260811 08:11:58.007301 23532 raft_consensus.cc:1261] T cbdebdd43add46b88b7bc77f6968ed7f P c8f2cd8efe604ee3aed222d9af32f8b7 [term 1 FOLLOWER]: Refusing update from remote peer 75394a5549a3402b81287c9bdaa9b097: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:11:58.007305 23296 raft_consensus.cc:1261] T cbdebdd43add46b88b7bc77f6968ed7f P 2cb7dafc32a1405591a4fbc212c282f9 [term 1 FOLLOWER]: Refusing update from remote peer 75394a5549a3402b81287c9bdaa9b097: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:11:58.007614 23838 consensus_queue.cc:1035] T cbdebdd43add46b88b7bc77f6968ed7f P 75394a5549a3402b81287c9bdaa9b097 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8f2cd8efe604ee3aed222d9af32f8b7" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 42953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:11:58.007754 23841 consensus_queue.cc:1035] T cbdebdd43add46b88b7bc77f6968ed7f P 75394a5549a3402b81287c9bdaa9b097 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cb7dafc32a1405591a4fbc212c282f9" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 33129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:11:58.010033 23844 mvcc.cc:205] Tried to move back new op lower bound from 7317241520155598848 to 7317241520115945472. Current Snapshot: MvccSnapshot[applied={T|T < 7317241520155598848}]
I20260811 08:11:58.010772 23847 mvcc.cc:205] Tried to move back new op lower bound from 7317241520155598848 to 7317241520115945472. Current Snapshot: MvccSnapshot[applied={T|T < 7317241520155598848}]
I20260811 08:11:58.012431 23042 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45726:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:11:58.012526 23042 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45726:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:11:58.013268 23042 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 88ab4328a0b64bee8b9a009e9f299ae0: Sending DeleteTablet for 3 replicas of tablet cbdebdd43add46b88b7bc77f6968ed7f
I20260811 08:11:58.013587 23711 tablet_service.cc:1514] Processing DeleteTablet for tablet cbdebdd43add46b88b7bc77f6968ed7f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:11:58 UTC) from {username='kudu', principal='kudu/127.27.243.254@KRBTEST.COM'} at 127.0.0.1:39260
I20260811 08:11:58.013629 23503 tablet_service.cc:1514] Processing DeleteTablet for tablet cbdebdd43add46b88b7bc77f6968ed7f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:11:58 UTC) from {username='kudu', principal='kudu/127.27.243.254@KRBTEST.COM'} at 127.0.0.1:45840
I20260811 08:11:58.013693 23233 tablet_service.cc:1514] Processing DeleteTablet for tablet cbdebdd43add46b88b7bc77f6968ed7f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:11:58 UTC) from {username='kudu', principal='kudu/127.27.243.254@KRBTEST.COM'} at 127.0.0.1:52050
I20260811 08:11:58.013780 23388 tablet_replica.cc:330] T cbdebdd43add46b88b7bc77f6968ed7f P 2cb7dafc32a1405591a4fbc212c282f9: stopping tablet replica
I20260811 08:11:58.013833 23388 raft_consensus.cc:2229] T cbdebdd43add46b88b7bc77f6968ed7f P 2cb7dafc32a1405591a4fbc212c282f9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:11:58.013877 23861 tablet_replica.cc:330] T cbdebdd43add46b88b7bc77f6968ed7f P c8f2cd8efe604ee3aed222d9af32f8b7: stopping tablet replica
I20260811 08:11:58.013893 23388 raft_consensus.cc:2258] T cbdebdd43add46b88b7bc77f6968ed7f P 2cb7dafc32a1405591a4fbc212c282f9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:11:58.014016 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 23110
I20260811 08:11:58.014222 23388 ts_tablet_manager.cc:1905] T cbdebdd43add46b88b7bc77f6968ed7f P 2cb7dafc32a1405591a4fbc212c282f9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:11:58.019090 23861 raft_consensus.cc:2229] T cbdebdd43add46b88b7bc77f6968ed7f P c8f2cd8efe604ee3aed222d9af32f8b7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:11:58.019232 23861 raft_consensus.cc:2258] T cbdebdd43add46b88b7bc77f6968ed7f P c8f2cd8efe604ee3aed222d9af32f8b7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:11:58.021358 23861 ts_tablet_manager.cc:1905] T cbdebdd43add46b88b7bc77f6968ed7f P c8f2cd8efe604ee3aed222d9af32f8b7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:11:58.023157 23860 tablet_replica.cc:330] T cbdebdd43add46b88b7bc77f6968ed7f P 75394a5549a3402b81287c9bdaa9b097: stopping tablet replica
I20260811 08:11:58.023306 23860 raft_consensus.cc:2229] T cbdebdd43add46b88b7bc77f6968ed7f P 75394a5549a3402b81287c9bdaa9b097 [term 1 LEADER]: Raft consensus shutting down.
I20260811 08:11:58.023461 23860 raft_consensus.cc:2258] T cbdebdd43add46b88b7bc77f6968ed7f P 75394a5549a3402b81287c9bdaa9b097 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:11:58.023851 23860 ts_tablet_manager.cc:1905] T cbdebdd43add46b88b7bc77f6968ed7f P 75394a5549a3402b81287c9bdaa9b097: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:11:58.024989 23860 ts_tablet_manager.cc:1918] T cbdebdd43add46b88b7bc77f6968ed7f P 75394a5549a3402b81287c9bdaa9b097: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:11:58.025058 23860 log.cc:1196] T cbdebdd43add46b88b7bc77f6968ed7f P 75394a5549a3402b81287c9bdaa9b097: Deleting WAL directory at /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-2/wal/wals/cbdebdd43add46b88b7bc77f6968ed7f
I20260811 08:11:58.025286 23860 ts_tablet_manager.cc:1939] T cbdebdd43add46b88b7bc77f6968ed7f P 75394a5549a3402b81287c9bdaa9b097: Deleting consensus metadata
I20260811 08:11:58.025724 23019 catalog_manager.cc:4841] TS 75394a5549a3402b81287c9bdaa9b097 (127.27.243.195:36139): tablet cbdebdd43add46b88b7bc77f6968ed7f (table test-table [id=9b12ee9d303241fb8e025ffcfb1fa2ad]) successfully deleted
I20260811 08:11:58.026156 23861 ts_tablet_manager.cc:1918] T cbdebdd43add46b88b7bc77f6968ed7f P c8f2cd8efe604ee3aed222d9af32f8b7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:11:58.026238 23861 log.cc:1196] T cbdebdd43add46b88b7bc77f6968ed7f P c8f2cd8efe604ee3aed222d9af32f8b7: Deleting WAL directory at /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-1/wal/wals/cbdebdd43add46b88b7bc77f6968ed7f
I20260811 08:11:58.026541 23861 ts_tablet_manager.cc:1939] T cbdebdd43add46b88b7bc77f6968ed7f P c8f2cd8efe604ee3aed222d9af32f8b7: Deleting consensus metadata
I20260811 08:11:58.026952 23020 catalog_manager.cc:4841] TS c8f2cd8efe604ee3aed222d9af32f8b7 (127.27.243.194:42953): tablet cbdebdd43add46b88b7bc77f6968ed7f (table test-table [id=9b12ee9d303241fb8e025ffcfb1fa2ad]) successfully deleted
W20260811 08:11:58.032038 23017 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.27.243.193:33129 (error 108)
I20260811 08:11:58.032311 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 23385
I20260811 08:11:58.032496 23822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:11:58.032363 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.193:33129 (local address 127.0.0.1:52058)
0811 08:11:58.032431 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0811 08:11:58.032469 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.193:33129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260811 08:11:58.032598 23017 catalog_manager.cc:4584] TS 2cb7dafc32a1405591a4fbc212c282f9 (127.27.243.193:33129): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet cbdebdd43add46b88b7bc77f6968ed7f: Network error: Client connection negotiation failed: client connection to 127.27.243.193:33129: connect: Connection refused (error 111)
I20260811 08:11:58.053622 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 23613
I20260811 08:11:58.064224 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 22988
I20260811 08:12:18.074110 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.243.254:36663
--webserver_interface=127.27.243.254
--webserver_port=45689
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab
--principal=kudu/127.27.243.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:45239
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.243.254:36663
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:12:18.157545 23865 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:12:18.157754 23865 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:12:18.157783 23865 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:12:18.158932 23865 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260811 08:12:18.158974 23865 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260811 08:12:18.158990 23865 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260811 08:12:18.159005 23865 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:12:18.159021 23865 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:12:18.159039 23865 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:12:18.159062 23865 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:12:18.159080 23865 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:12:18.160548 23865 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:45239
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.27.243.254:36663
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab
--principal=kudu/127.27.243.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.243.254:36663
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.243.254
--webserver_port=45689
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23865
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:12:18.160775 23865 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:12:18.160987 23865 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:12:18.165669 23874 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:12:18.165656 23880 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:12:18.165657 23875 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:12:18.165874 23865 server_base.cc:1034] running on GCE node
I20260811 08:12:18.166121 23865 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:12:18.166371 23865 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:12:18.167502 23865 hybrid_clock.cc:648] HybridClock initialized: now 1786435938167479 us; error 41 us; skew 500 ppm
Aug 11 08:12:18 dist-test-slave-7lbf krb5kdc[22082](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435938, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:12:18.170100 23865 init.cc:377] Logged in from keytab as kudu/127.27.243.254@KRBTEST.COM (short username kudu)
I20260811 08:12:18.170544 23865 webserver.cc:460] Webserver started at http://127.27.243.254:45689/ using document root <none> and password file <none>
I20260811 08:12:18.170764 23865 fs_manager.cc:359] Metadata directory not provided
I20260811 08:12:18.170818 23865 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:12:18.172093 23865 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:12:18.172681 23892 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:12:18.172858 23865 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 08:12:18.172946 23865 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/master-0/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/master-0/wal
uuid: "88ab4328a0b64bee8b9a009e9f299ae0"
format_stamp: "Formatted at 2026-08-11 08:11:36 on dist-test-slave-7lbf"
server_key: "0cfc9385ba5920ef4c2161c532b9670f"
server_key_iv: "058869ea34ce19d5fe1723f607e9c5da"
server_key_version: "encryptionkey@0"
I20260811 08:12:18.173265 23865 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:12:18.187589 23865 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:12:18.189769 23865 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:12:18.189924 23865 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:12:18.194058 23865 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.254:36663
I20260811 08:12:18.194118 23989 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.254:36663 every 8 connection(s)
I20260811 08:12:18.194482 23865 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
I20260811 08:12:18.195978 23992 sys_catalog.cc:263] Verifying existing consensus state
I20260811 08:12:18.196621 23992 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 88ab4328a0b64bee8b9a009e9f299ae0: Bootstrap starting.
I20260811 08:12:18.200461 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 23865
I20260811 08:12:18.200753 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.243.193:33129
--local_ip_for_outbound_sockets=127.27.243.193
--tserver_master_addrs=127.27.243.254:36663
--webserver_port=45603
--webserver_interface=127.27.243.193
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.193.keytab
--principal=kudu/127.27.243.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:45239
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 08:12:18.205758 23992 log.cc:824] T 00000000000000000000000000000000 P 88ab4328a0b64bee8b9a009e9f299ae0: Log is configured to *not* fsync() on all Append() calls
I20260811 08:12:18.207973 23992 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 88ab4328a0b64bee8b9a009e9f299ae0: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 08:12:18.208278 23992 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 88ab4328a0b64bee8b9a009e9f299ae0: Bootstrap complete.
I20260811 08:12:18.210518 23992 raft_consensus.cc:348] T 00000000000000000000000000000000 P 88ab4328a0b64bee8b9a009e9f299ae0 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88ab4328a0b64bee8b9a009e9f299ae0" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 36663 } }
I20260811 08:12:18.210769 23992 raft_consensus.cc:729] T 00000000000000000000000000000000 P 88ab4328a0b64bee8b9a009e9f299ae0 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ab4328a0b64bee8b9a009e9f299ae0, State: Initialized, Role: FOLLOWER
I20260811 08:12:18.210927 23992 consensus_queue.cc:260] T 00000000000000000000000000000000 P 88ab4328a0b64bee8b9a009e9f299ae0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88ab4328a0b64bee8b9a009e9f299ae0" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 36663 } }
I20260811 08:12:18.210997 23992 raft_consensus.cc:388] T 00000000000000000000000000000000 P 88ab4328a0b64bee8b9a009e9f299ae0 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:12:18.211041 23992 raft_consensus.cc:482] T 00000000000000000000000000000000 P 88ab4328a0b64bee8b9a009e9f299ae0 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:12:18.211092 23992 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 88ab4328a0b64bee8b9a009e9f299ae0 [term 2 FOLLOWER]: Advancing to term 3
I20260811 08:12:18.212165 23992 raft_consensus.cc:504] T 00000000000000000000000000000000 P 88ab4328a0b64bee8b9a009e9f299ae0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88ab4328a0b64bee8b9a009e9f299ae0" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 36663 } }
I20260811 08:12:18.212265 23992 leader_election.cc:302] T 00000000000000000000000000000000 P 88ab4328a0b64bee8b9a009e9f299ae0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 88ab4328a0b64bee8b9a009e9f299ae0; no voters:
I20260811 08:12:18.212440 23992 leader_election.cc:288] T 00000000000000000000000000000000 P 88ab4328a0b64bee8b9a009e9f299ae0 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260811 08:12:18.212486 23998 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 88ab4328a0b64bee8b9a009e9f299ae0 [term 3 FOLLOWER]: Leader election won for term 3
I20260811 08:12:18.212610 23998 raft_consensus.cc:686] T 00000000000000000000000000000000 P 88ab4328a0b64bee8b9a009e9f299ae0 [term 3 LEADER]: Becoming Leader. State: Replica: 88ab4328a0b64bee8b9a009e9f299ae0, State: Running, Role: LEADER
I20260811 08:12:18.212710 23992 sys_catalog.cc:564] T 00000000000000000000000000000000 P 88ab4328a0b64bee8b9a009e9f299ae0 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:12:18.212699 23998 consensus_queue.cc:237] T 00000000000000000000000000000000 P 88ab4328a0b64bee8b9a009e9f299ae0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88ab4328a0b64bee8b9a009e9f299ae0" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 36663 } }
I20260811 08:12:18.213034 23998 sys_catalog.cc:455] T 00000000000000000000000000000000 P 88ab4328a0b64bee8b9a009e9f299ae0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 88ab4328a0b64bee8b9a009e9f299ae0. Latest consensus state: current_term: 3 leader_uuid: "88ab4328a0b64bee8b9a009e9f299ae0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88ab4328a0b64bee8b9a009e9f299ae0" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 36663 } } }
I20260811 08:12:18.213109 23998 sys_catalog.cc:458] T 00000000000000000000000000000000 P 88ab4328a0b64bee8b9a009e9f299ae0 [sys.catalog]: This master's current role is: LEADER
I20260811 08:12:18.213286 23999 sys_catalog.cc:455] T 00000000000000000000000000000000 P 88ab4328a0b64bee8b9a009e9f299ae0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "88ab4328a0b64bee8b9a009e9f299ae0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88ab4328a0b64bee8b9a009e9f299ae0" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 36663 } } }
I20260811 08:12:18.213361 23999 sys_catalog.cc:458] T 00000000000000000000000000000000 P 88ab4328a0b64bee8b9a009e9f299ae0 [sys.catalog]: This master's current role is: LEADER
I20260811 08:12:18.213505 24007 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:12:18.214332 24007 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:12:18.214452 24007 catalog_manager.cc:1259] Loaded cluster ID: 2d8a477a994945359c8feb5b4afcd55e
I20260811 08:12:18.214485 24007 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:12:18.215623 24007 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:12:18.215811 24007 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 88ab4328a0b64bee8b9a009e9f299ae0: Loaded TSK: 0
I20260811 08:12:18.215862 24007 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 88ab4328a0b64bee8b9a009e9f299ae0: Loaded TSK: 1
F20260811 08:12:18.216085 24007 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f67b57509ad google::LogMessage::Fail() at ??:0
@ 0x7f67b575388a google::LogMessage::SendToLog() at ??:0
@ 0x7f67b57504de google::LogMessage::Flush() at ??:0
@ 0x7f67b5751a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f67b7ebd104 kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7f67b7ebad41 kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7f67bd6ae1cd kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7f67bd6ae48e kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7f67bd6ae594 _ZNSt17_Function_handlerIFN4kudu6StatusEvEZNS0_6master14CatalogManager24PrepareForLeadershipTaskEvEUlvE3_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f67bd674c48 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7f67bd67ead0 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f67b761e0d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f67b7613954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f67b84776db start_thread at ??:0
@ 0x7f67b424e61f clone at ??:0
W20260811 08:12:18.294862 23994 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:12:18.295070 23994 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:12:18.295105 23994 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:12:18.296224 23994 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:12:18.296273 23994 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:12:18.296314 23994 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.243.193
I20260811 08:12:18.297801 23994 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:45239
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.193.keytab
--principal=kudu/127.27.243.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.243.193:33129
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.243.193
--webserver_port=45603
--tserver_master_addrs=127.27.243.254:36663
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23994
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.243.193
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:12:18.298035 23994 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:12:18.298251 23994 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:12:18.303226 24060 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:12:18.303354 23994 server_base.cc:1034] running on GCE node
W20260811 08:12:18.303238 24062 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:12:18.303465 24067 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:12:18.303722 23994 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:12:18.303959 23994 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:12:18.305114 23994 hybrid_clock.cc:648] HybridClock initialized: now 1786435938305099 us; error 32 us; skew 500 ppm
Aug 11 08:12:18 dist-test-slave-7lbf krb5kdc[22082](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435938, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:12:18.307701 23994 init.cc:377] Logged in from keytab as kudu/127.27.243.193@KRBTEST.COM (short username kudu)
I20260811 08:12:18.308164 23994 webserver.cc:460] Webserver started at http://127.27.243.193:45603/ using document root <none> and password file <none>
I20260811 08:12:18.308358 23994 fs_manager.cc:359] Metadata directory not provided
I20260811 08:12:18.308406 23994 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:12:18.309783 23994 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:12:18.310562 24081 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:12:18.310736 23994 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:12:18.310853 23994 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-0/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-0/wal
uuid: "2cb7dafc32a1405591a4fbc212c282f9"
format_stamp: "Formatted at 2026-08-11 08:11:36 on dist-test-slave-7lbf"
server_key: "e9e52c88d9c08a66afb2d3b76390e21c"
server_key_iv: "222fb2e1a4dc7faff7feb0034d4fb547"
server_key_version: "encryptionkey@0"
I20260811 08:12:18.311277 23994 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:12:18.333084 23994 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:12:18.335744 23994 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:12:18.335930 23994 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:12:18.336233 23994 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:12:18.336872 24090 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260811 08:12:18.338423 23994 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260811 08:12:18.338483 23994 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260811 08:12:18.338521 23994 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260811 08:12:18.339409 23994 ts_tablet_manager.cc:610] Registered 1 tablets
I20260811 08:12:18.339455 23994 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260811 08:12:18.339530 24090 tablet_bootstrap.cc:492] T cbdebdd43add46b88b7bc77f6968ed7f P 2cb7dafc32a1405591a4fbc212c282f9: Bootstrap starting.
I20260811 08:12:18.341207 24090 log.cc:824] T cbdebdd43add46b88b7bc77f6968ed7f P 2cb7dafc32a1405591a4fbc212c282f9: Log is configured to *not* fsync() on all Append() calls
I20260811 08:12:18.344102 24090 tablet_bootstrap.cc:492] T cbdebdd43add46b88b7bc77f6968ed7f P 2cb7dafc32a1405591a4fbc212c282f9: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 08:12:18.344403 24090 tablet_bootstrap.cc:492] T cbdebdd43add46b88b7bc77f6968ed7f P 2cb7dafc32a1405591a4fbc212c282f9: Bootstrap complete.
I20260811 08:12:18.344558 24090 ts_tablet_manager.cc:1397] T cbdebdd43add46b88b7bc77f6968ed7f P 2cb7dafc32a1405591a4fbc212c282f9: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.002s
I20260811 08:12:18.346216 24090 raft_consensus.cc:348] T cbdebdd43add46b88b7bc77f6968ed7f P 2cb7dafc32a1405591a4fbc212c282f9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75394a5549a3402b81287c9bdaa9b097" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 36139 } } peers { permanent_uuid: "c8f2cd8efe604ee3aed222d9af32f8b7" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 42953 } } peers { permanent_uuid: "2cb7dafc32a1405591a4fbc212c282f9" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 33129 } }
I20260811 08:12:18.346493 24090 raft_consensus.cc:729] T cbdebdd43add46b88b7bc77f6968ed7f P 2cb7dafc32a1405591a4fbc212c282f9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cb7dafc32a1405591a4fbc212c282f9, State: Initialized, Role: FOLLOWER
I20260811 08:12:18.346668 24090 consensus_queue.cc:260] T cbdebdd43add46b88b7bc77f6968ed7f P 2cb7dafc32a1405591a4fbc212c282f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75394a5549a3402b81287c9bdaa9b097" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 36139 } } peers { permanent_uuid: "c8f2cd8efe604ee3aed222d9af32f8b7" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 42953 } } peers { permanent_uuid: "2cb7dafc32a1405591a4fbc212c282f9" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 33129 } }
I20260811 08:12:18.346870 23994 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.193:33129
I20260811 08:12:18.346952 24090 ts_tablet_manager.cc:1428] T cbdebdd43add46b88b7bc77f6968ed7f P 2cb7dafc32a1405591a4fbc212c282f9: Time spent starting tablet: real 0.002s user 0.004s sys 0.001s
I20260811 08:12:18.347208 24280 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.193:33129 every 8 connection(s)
I20260811 08:12:18.347255 23994 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-0/data/info.pb
I20260811 08:12:18.357249 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 23994
I20260811 08:12:18.357569 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.243.194:42953
--local_ip_for_outbound_sockets=127.27.243.194
--tserver_master_addrs=127.27.243.254:36663
--webserver_port=43279
--webserver_interface=127.27.243.194
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.194.keytab
--principal=kudu/127.27.243.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:45239
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:12:18.420089 24284 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:12:18.348002 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36663 (local address 127.27.243.193:56899)
0811 08:12:18.348156 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0811 08:12:18.348196 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 08:12:18.348330 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:12:18.419865 (+ 71535us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:36663: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":66,"threads_started":1}
W20260811 08:12:18.420375 24282 heartbeater.cc:644] Failed to heartbeat to 127.27.243.254:36663 (0 consecutive failures): Network error: Failed to ping master at 127.27.243.254:36663: Client connection negotiation failed: client connection to 127.27.243.254:36663: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260811 08:12:18.420737 24284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:18.420612 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36663 (local address 127.27.243.193:37545)
0811 08:12:18.420666 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0811 08:12:18.420710 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:36663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260811 08:12:18.421128 24284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:18.421004 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36663 (local address 127.27.243.193:56225)
0811 08:12:18.421070 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0811 08:12:18.421101 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:36663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260811 08:12:18.421238 24282 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 08:12:18.443441 24285 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:12:18.443642 24285 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:12:18.443666 24285 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:12:18.444973 24285 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:12:18.445027 24285 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:12:18.445053 24285 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.243.194
I20260811 08:12:18.446524 24285 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:45239
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.194.keytab
--principal=kudu/127.27.243.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.243.194:42953
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.243.194
--webserver_port=43279
--tserver_master_addrs=127.27.243.254:36663
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24285
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.243.194
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:12:18.446713 24285 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:12:18.446892 24285 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:12:18.451673 24301 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:12:18.451670 24296 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:12:18.451681 24299 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:12:18.451951 24285 server_base.cc:1034] running on GCE node
I20260811 08:12:18.452157 24285 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:12:18.452363 24285 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:12:18.453495 24285 hybrid_clock.cc:648] HybridClock initialized: now 1786435938453481 us; error 32 us; skew 500 ppm
Aug 11 08:12:18 dist-test-slave-7lbf krb5kdc[22082](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435938, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:12:18.455881 24285 init.cc:377] Logged in from keytab as kudu/127.27.243.194@KRBTEST.COM (short username kudu)
I20260811 08:12:18.456295 24285 webserver.cc:460] Webserver started at http://127.27.243.194:43279/ using document root <none> and password file <none>
I20260811 08:12:18.456501 24285 fs_manager.cc:359] Metadata directory not provided
I20260811 08:12:18.456544 24285 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:12:18.457857 24285 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 08:12:18.458446 24310 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:12:18.458588 24285 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 08:12:18.458668 24285 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-1/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-1/wal
uuid: "c8f2cd8efe604ee3aed222d9af32f8b7"
format_stamp: "Formatted at 2026-08-11 08:11:36 on dist-test-slave-7lbf"
server_key: "dff413235383c27d44a46068ff840695"
server_key_iv: "2c3611adec0afc696e55f3a8f0dfbaa4"
server_key_version: "encryptionkey@0"
I20260811 08:12:18.459000 24285 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:12:18.478837 24285 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:12:18.481046 24285 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:12:18.481187 24285 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:12:18.481407 24285 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:12:18.481737 24285 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:12:18.481778 24285 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:12:18.481801 24285 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:12:18.481823 24285 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:12:18.487576 24285 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.194:42953
I20260811 08:12:18.487630 24488 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.194:42953 every 8 connection(s)
I20260811 08:12:18.487960 24285 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-1/data/info.pb
I20260811 08:12:18.488978 24491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:18.488620 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36663 (local address 127.27.243.194:37043)
0811 08:12:18.488767 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0811 08:12:18.488833 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:36663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":75,"threads_started":1}
W20260811 08:12:18.489363 24489 heartbeater.cc:644] Failed to heartbeat to 127.27.243.254:36663 (0 consecutive failures): Network error: Failed to ping master at 127.27.243.254:36663: Client connection negotiation failed: client connection to 127.27.243.254:36663: connect: Connection refused (error 111)
I20260811 08:12:18.489652 24491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:18.489568 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36663 (local address 127.27.243.194:56663)
0811 08:12:18.489606 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0811 08:12:18.489630 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:36663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":22}
I20260811 08:12:18.489897 24491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:18.489825 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36663 (local address 127.27.243.194:55217)
0811 08:12:18.489857 (+ 32us) negotiation.cc:107] Waiting for socket to connect
0811 08:12:18.489878 (+ 21us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:36663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":21}
W20260811 08:12:18.489986 24489 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 08:12:18.494637 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 24285
I20260811 08:12:18.494874 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.243.195:36139
--local_ip_for_outbound_sockets=127.27.243.195
--tserver_master_addrs=127.27.243.254:36663
--webserver_port=33947
--webserver_interface=127.27.243.195
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.195.keytab
--principal=kudu/127.27.243.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:45239
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:12:18.576689 24492 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:12:18.576929 24492 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:12:18.576952 24492 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:12:18.578109 24492 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:12:18.578151 24492 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:12:18.578176 24492 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.243.195
I20260811 08:12:18.579655 24492 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:45239
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.195.keytab
--principal=kudu/127.27.243.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.243.195:36139
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.243.195
--webserver_port=33947
--tserver_master_addrs=127.27.243.254:36663
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24492
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.243.195
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:12:18.579880 24492 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:12:18.580099 24492 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:12:18.584772 24503 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:12:18.584805 24501 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:12:18.584918 24492 server_base.cc:1034] running on GCE node
W20260811 08:12:18.584805 24508 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:12:18.585172 24492 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:12:18.585383 24492 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:12:18.586539 24492 hybrid_clock.cc:648] HybridClock initialized: now 1786435938586517 us; error 38 us; skew 500 ppm
Aug 11 08:12:18 dist-test-slave-7lbf krb5kdc[22082](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435938, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:12:18.588963 24492 init.cc:377] Logged in from keytab as kudu/127.27.243.195@KRBTEST.COM (short username kudu)
I20260811 08:12:18.589401 24492 webserver.cc:460] Webserver started at http://127.27.243.195:33947/ using document root <none> and password file <none>
I20260811 08:12:18.589646 24492 fs_manager.cc:359] Metadata directory not provided
I20260811 08:12:18.589699 24492 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:12:18.590960 24492 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:12:18.591640 24517 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:12:18.591840 24492 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:12:18.591958 24492 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-2/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-2/wal
uuid: "75394a5549a3402b81287c9bdaa9b097"
format_stamp: "Formatted at 2026-08-11 08:11:36 on dist-test-slave-7lbf"
server_key: "77073bc16282d73bd0ad84483669dcb0"
server_key_iv: "25374abf12da4d37324e3c23f1b73cde"
server_key_version: "encryptionkey@0"
I20260811 08:12:18.592375 24492 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:12:18.621608 24492 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:12:18.623745 24492 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:12:18.623885 24492 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:12:18.624140 24492 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:12:18.624465 24492 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:12:18.624503 24492 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:12:18.624531 24492 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:12:18.624558 24492 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:12:18.631011 24492 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.195:36139
I20260811 08:12:18.631059 24699 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.195:36139 every 8 connection(s)
I20260811 08:12:18.631403 24492 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435717191469-28623-0/minicluster-data/ts-2/data/info.pb
I20260811 08:12:18.632447 24709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:18.632069 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36663 (local address 127.27.243.195:48443)
0811 08:12:18.632226 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0811 08:12:18.632303 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:36663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":80,"threads_started":1}
W20260811 08:12:18.632848 24702 heartbeater.cc:644] Failed to heartbeat to 127.27.243.254:36663 (0 consecutive failures): Network error: Failed to ping master at 127.27.243.254:36663: Client connection negotiation failed: client connection to 127.27.243.254:36663: connect: Connection refused (error 111)
I20260811 08:12:18.633136 24709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:18.633034 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36663 (local address 127.27.243.195:45933)
0811 08:12:18.633083 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0811 08:12:18.633114 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:36663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260811 08:12:18.633380 24709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:18.633310 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36663 (local address 127.27.243.195:53049)
0811 08:12:18.633344 (+ 34us) negotiation.cc:107] Waiting for socket to connect
0811 08:12:18.633365 (+ 21us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:36663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
W20260811 08:12:18.633472 24702 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 08:12:18.640777 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 24492
I20260811 08:12:19.421847 24711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:19.421585 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36663 (local address 127.27.243.193:47359)
0811 08:12:19.421728 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0811 08:12:19.421770 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:36663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":63,"threads_started":1}
I20260811 08:12:19.490440 24713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:19.490247 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36663 (local address 127.27.243.194:35743)
0811 08:12:19.490359 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0811 08:12:19.490392 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:36663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":96,"thread_start_us":52,"threads_started":1}
I20260811 08:12:19.545020 24714 raft_consensus.cc:482] T cbdebdd43add46b88b7bc77f6968ed7f P 2cb7dafc32a1405591a4fbc212c282f9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:12:19.545173 24714 raft_consensus.cc:504] T cbdebdd43add46b88b7bc77f6968ed7f P 2cb7dafc32a1405591a4fbc212c282f9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75394a5549a3402b81287c9bdaa9b097" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 36139 } } peers { permanent_uuid: "c8f2cd8efe604ee3aed222d9af32f8b7" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 42953 } } peers { permanent_uuid: "2cb7dafc32a1405591a4fbc212c282f9" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 33129 } }
I20260811 08:12:19.545557 24714 leader_election.cc:288] T cbdebdd43add46b88b7bc77f6968ed7f P 2cb7dafc32a1405591a4fbc212c282f9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 75394a5549a3402b81287c9bdaa9b097 (127.27.243.195:36139), c8f2cd8efe604ee3aed222d9af32f8b7 (127.27.243.194:42953)
Aug 11 08:12:19 dist-test-slave-7lbf krb5kdc[22082](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435938, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.193@KRBTEST.COM for kudu/127.27.243.194@KRBTEST.COM
Aug 11 08:12:19 dist-test-slave-7lbf krb5kdc[22082](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435938, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.193@KRBTEST.COM for kudu/127.27.243.195@KRBTEST.COM
I20260811 08:12:19.557688 24716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:19.545807 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.193:53769 (local address 127.27.243.194:42953)
0811 08:12:19.545952 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0811 08:12:19.545965 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 08:12:19.546002 (+ 37us) server_negotiation.cc:407] Connection header received
0811 08:12:19.546586 (+ 584us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:12:19.546589 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:12:19.546628 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:12:19.546774 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:12:19.547963 (+ 1189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:19.549314 (+ 1351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:19.550892 (+ 1578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:19.551568 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:19.551691 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:19.554446 (+ 2755us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:12:19.554450 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:12:19.554451 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:12:19.554461 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:12:19.556113 (+ 1652us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:12:19.556502 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:12:19.556505 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:12:19.556506 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:12:19.556592 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:12:19.556816 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:12:19.556817 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:12:19.556818 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:12:19.557070 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:12:19.557144 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 08:12:19.557425 (+ 281us) server_negotiation.cc:299] Negotiation successful
0811 08:12:19.557569 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":105,"thread_start_us":69,"threads_started":1}
I20260811 08:12:19.557687 24711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:19.545698 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.194:42953 (local address 127.27.243.193:53769)
0811 08:12:19.545743 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0811 08:12:19.545757 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 08:12:19.545830 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:12:19.546837 (+ 1007us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:12:19.546840 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:12:19.547334 (+ 494us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:12:19.547847 (+ 513us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:12:19.547849 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:12:19.549446 (+ 1597us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:12:19.549446 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:12:19.550787 (+ 1341us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:12:19.550791 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:12:19.551667 (+ 876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:12:19.551669 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:12:19.551846 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:19.552490 (+ 644us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:12:19.552501 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:12:19.554325 (+ 1824us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:12:19.556194 (+ 1869us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:12:19.556201 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:12:19.556203 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:12:19.556426 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:12:19.556653 (+ 227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:12:19.556653 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:12:19.556654 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:12:19.556761 (+ 107us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:12:19.557138 (+ 377us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:12:19.557145 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:12:19.557275 (+ 130us) client_negotiation.cc:769] Sending connection context
0811 08:12:19.557370 (+ 95us) client_negotiation.cc:240] Negotiation successful
0811 08:12:19.557581 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":24,"mutex_wait_us":70}
I20260811 08:12:19.557773 24715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:19.545699 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.195:36139 (local address 127.27.243.193:39813)
0811 08:12:19.545828 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0811 08:12:19.545837 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 08:12:19.545942 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:12:19.546837 (+ 895us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:12:19.546840 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:12:19.547334 (+ 494us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:12:19.547656 (+ 322us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:12:19.547665 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:12:19.549434 (+ 1769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:12:19.549435 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:12:19.550787 (+ 1352us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:12:19.550791 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:12:19.551669 (+ 878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:12:19.551670 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:12:19.551886 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:19.552503 (+ 617us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:12:19.552507 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:12:19.554623 (+ 2116us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:12:19.556463 (+ 1840us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:12:19.556464 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:12:19.556464 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:12:19.556628 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:12:19.556850 (+ 222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:12:19.556851 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:12:19.556851 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:12:19.556907 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:12:19.557249 (+ 342us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:12:19.557250 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:12:19.557314 (+ 64us) client_negotiation.cc:769] Sending connection context
0811 08:12:19.557373 (+ 59us) client_negotiation.cc:240] Negotiation successful
0811 08:12:19.557644 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114,"mutex_wait_us":235,"thread_start_us":58,"threads_started":1}
I20260811 08:12:19.558172 24717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:19.545849 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.193:39813 (local address 127.27.243.195:36139)
0811 08:12:19.546009 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0811 08:12:19.546017 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 08:12:19.546036 (+ 19us) server_negotiation.cc:407] Connection header received
0811 08:12:19.546537 (+ 501us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:12:19.546540 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:12:19.546615 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:12:19.546774 (+ 159us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:12:19.547842 (+ 1068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:19.549314 (+ 1472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:19.550892 (+ 1578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:19.551567 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:19.551689 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:19.554735 (+ 3046us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:12:19.554739 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:12:19.554740 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:12:19.554752 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:12:19.556381 (+ 1629us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:12:19.556698 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:12:19.556701 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:12:19.556701 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:12:19.556783 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:12:19.556958 (+ 175us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:12:19.556959 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:12:19.556960 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:12:19.557185 (+ 225us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:12:19.557254 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 08:12:19.557447 (+ 193us) server_negotiation.cc:299] Negotiation successful
0811 08:12:19.557622 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":110,"thread_start_us":65,"threads_started":1}
W20260811 08:12:19.558712 24085 leader_election.cc:341] T cbdebdd43add46b88b7bc77f6968ed7f P 2cb7dafc32a1405591a4fbc212c282f9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer c8f2cd8efe604ee3aed222d9af32f8b7 (127.27.243.194:42953): Not found: Tablet not found: cbdebdd43add46b88b7bc77f6968ed7f
W20260811 08:12:19.559705 24084 leader_election.cc:341] T cbdebdd43add46b88b7bc77f6968ed7f P 2cb7dafc32a1405591a4fbc212c282f9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 75394a5549a3402b81287c9bdaa9b097 (127.27.243.195:36139): Not found: Tablet not found: cbdebdd43add46b88b7bc77f6968ed7f
I20260811 08:12:19.559764 24084 leader_election.cc:302] T cbdebdd43add46b88b7bc77f6968ed7f P 2cb7dafc32a1405591a4fbc212c282f9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cb7dafc32a1405591a4fbc212c282f9; no voters: 75394a5549a3402b81287c9bdaa9b097, c8f2cd8efe604ee3aed222d9af32f8b7
I20260811 08:12:19.559861 24714 raft_consensus.cc:2726] T cbdebdd43add46b88b7bc77f6968ed7f P 2cb7dafc32a1405591a4fbc212c282f9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 08:12:19.633962 24719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:19.633746 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36663 (local address 127.27.243.195:49003)
0811 08:12:19.633869 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0811 08:12:19.633924 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:36663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":68,"threads_started":1}
I20260811 08:12:20.422526 24720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:20.422282 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36663 (local address 127.27.243.193:58159)
0811 08:12:20.422417 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0811 08:12:20.422456 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:36663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":84,"threads_started":1}
I20260811 08:12:20.491056 24721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:20.490835 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36663 (local address 127.27.243.194:60971)
0811 08:12:20.490973 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0811 08:12:20.491012 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:36663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":62,"threads_started":1}
I20260811 08:12:20.634627 24725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:20.634413 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36663 (local address 127.27.243.195:42883)
0811 08:12:20.634536 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0811 08:12:20.634574 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:36663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":64,"threads_started":1}
I20260811 08:12:21.138024 24726 raft_consensus.cc:482] T cbdebdd43add46b88b7bc77f6968ed7f P 2cb7dafc32a1405591a4fbc212c282f9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:12:21.138125 24726 raft_consensus.cc:504] T cbdebdd43add46b88b7bc77f6968ed7f P 2cb7dafc32a1405591a4fbc212c282f9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75394a5549a3402b81287c9bdaa9b097" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 36139 } } peers { permanent_uuid: "c8f2cd8efe604ee3aed222d9af32f8b7" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 42953 } } peers { permanent_uuid: "2cb7dafc32a1405591a4fbc212c282f9" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 33129 } }
I20260811 08:12:21.138268 24726 leader_election.cc:288] T cbdebdd43add46b88b7bc77f6968ed7f P 2cb7dafc32a1405591a4fbc212c282f9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 75394a5549a3402b81287c9bdaa9b097 (127.27.243.195:36139), c8f2cd8efe604ee3aed222d9af32f8b7 (127.27.243.194:42953)
W20260811 08:12:21.138674 24085 leader_election.cc:341] T cbdebdd43add46b88b7bc77f6968ed7f P 2cb7dafc32a1405591a4fbc212c282f9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer c8f2cd8efe604ee3aed222d9af32f8b7 (127.27.243.194:42953): Not found: Tablet not found: cbdebdd43add46b88b7bc77f6968ed7f
W20260811 08:12:21.138792 24084 leader_election.cc:341] T cbdebdd43add46b88b7bc77f6968ed7f P 2cb7dafc32a1405591a4fbc212c282f9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 75394a5549a3402b81287c9bdaa9b097 (127.27.243.195:36139): Not found: Tablet not found: cbdebdd43add46b88b7bc77f6968ed7f
I20260811 08:12:21.138875 24084 leader_election.cc:302] T cbdebdd43add46b88b7bc77f6968ed7f P 2cb7dafc32a1405591a4fbc212c282f9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cb7dafc32a1405591a4fbc212c282f9; no voters: 75394a5549a3402b81287c9bdaa9b097, c8f2cd8efe604ee3aed222d9af32f8b7
I20260811 08:12:21.138947 24726 raft_consensus.cc:2726] T cbdebdd43add46b88b7bc77f6968ed7f P 2cb7dafc32a1405591a4fbc212c282f9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 08:12:21.423250 24727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:21.423032 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36663 (local address 127.27.243.193:57525)
0811 08:12:21.423166 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0811 08:12:21.423204 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:36663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":82,"threads_started":1}
I20260811 08:12:21.491663 24729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:21.491453 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36663 (local address 127.27.243.194:42497)
0811 08:12:21.491588 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0811 08:12:21.491625 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:36663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":74,"threads_started":1}
I20260811 08:12:21.635305 24730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:21.635099 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36663 (local address 127.27.243.195:52119)
0811 08:12:21.635216 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0811 08:12:21.635253 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:36663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":60,"threads_started":1}
I20260811 08:12:22.423974 24733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:22.423698 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36663 (local address 127.27.243.193:58589)
0811 08:12:22.423877 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0811 08:12:22.423920 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:36663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":63,"threads_started":1}
I20260811 08:12:22.492327 24735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:22.492127 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36663 (local address 127.27.243.194:33429)
0811 08:12:22.492251 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0811 08:12:22.492285 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:36663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":59,"threads_started":1}
I20260811 08:12:22.635987 24737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:22.635776 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36663 (local address 127.27.243.195:53099)
0811 08:12:22.635897 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0811 08:12:22.635939 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:36663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":63,"threads_started":1}
I20260811 08:12:22.994814 24738 raft_consensus.cc:482] T cbdebdd43add46b88b7bc77f6968ed7f P 2cb7dafc32a1405591a4fbc212c282f9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:12:22.994918 24738 raft_consensus.cc:504] T cbdebdd43add46b88b7bc77f6968ed7f P 2cb7dafc32a1405591a4fbc212c282f9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75394a5549a3402b81287c9bdaa9b097" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 36139 } } peers { permanent_uuid: "c8f2cd8efe604ee3aed222d9af32f8b7" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 42953 } } peers { permanent_uuid: "2cb7dafc32a1405591a4fbc212c282f9" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 33129 } }
I20260811 08:12:22.995090 24738 leader_election.cc:288] T cbdebdd43add46b88b7bc77f6968ed7f P 2cb7dafc32a1405591a4fbc212c282f9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 75394a5549a3402b81287c9bdaa9b097 (127.27.243.195:36139), c8f2cd8efe604ee3aed222d9af32f8b7 (127.27.243.194:42953)
W20260811 08:12:22.995460 24085 leader_election.cc:341] T cbdebdd43add46b88b7bc77f6968ed7f P 2cb7dafc32a1405591a4fbc212c282f9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer c8f2cd8efe604ee3aed222d9af32f8b7 (127.27.243.194:42953): Not found: Tablet not found: cbdebdd43add46b88b7bc77f6968ed7f
W20260811 08:12:22.995556 24084 leader_election.cc:341] T cbdebdd43add46b88b7bc77f6968ed7f P 2cb7dafc32a1405591a4fbc212c282f9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 75394a5549a3402b81287c9bdaa9b097 (127.27.243.195:36139): Not found: Tablet not found: cbdebdd43add46b88b7bc77f6968ed7f
I20260811 08:12:22.995600 24084 leader_election.cc:302] T cbdebdd43add46b88b7bc77f6968ed7f P 2cb7dafc32a1405591a4fbc212c282f9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cb7dafc32a1405591a4fbc212c282f9; no voters: 75394a5549a3402b81287c9bdaa9b097, c8f2cd8efe604ee3aed222d9af32f8b7
I20260811 08:12:22.995671 24738 raft_consensus.cc:2726] T cbdebdd43add46b88b7bc77f6968ed7f P 2cb7dafc32a1405591a4fbc212c282f9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 08:12:23.424659 24739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:23.424463 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36663 (local address 127.27.243.193:45337)
0811 08:12:23.424575 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0811 08:12:23.424611 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:36663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97,"thread_start_us":60,"threads_started":1}
I20260811 08:12:23.492962 24740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:23.492737 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36663 (local address 127.27.243.194:36451)
0811 08:12:23.492887 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0811 08:12:23.492925 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:36663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":76,"threads_started":1}
I20260811 08:12:23.636631 24742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:23.636398 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36663 (local address 127.27.243.195:49699)
0811 08:12:23.636543 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0811 08:12:23.636580 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:36663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":77,"threads_started":1}
I20260811 08:12:24.425312 24743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:24.425093 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36663 (local address 127.27.243.193:46819)
0811 08:12:24.425223 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0811 08:12:24.425261 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:36663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":66,"threads_started":1}
I20260811 08:12:24.493659 24744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:24.493389 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36663 (local address 127.27.243.194:50185)
0811 08:12:24.493576 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0811 08:12:24.493616 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:36663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":64,"threads_started":1}
I20260811 08:12:24.610894 24747 raft_consensus.cc:482] T cbdebdd43add46b88b7bc77f6968ed7f P 2cb7dafc32a1405591a4fbc212c282f9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:12:24.610999 24747 raft_consensus.cc:504] T cbdebdd43add46b88b7bc77f6968ed7f P 2cb7dafc32a1405591a4fbc212c282f9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75394a5549a3402b81287c9bdaa9b097" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 36139 } } peers { permanent_uuid: "c8f2cd8efe604ee3aed222d9af32f8b7" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 42953 } } peers { permanent_uuid: "2cb7dafc32a1405591a4fbc212c282f9" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 33129 } }
I20260811 08:12:24.611176 24747 leader_election.cc:288] T cbdebdd43add46b88b7bc77f6968ed7f P 2cb7dafc32a1405591a4fbc212c282f9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 75394a5549a3402b81287c9bdaa9b097 (127.27.243.195:36139), c8f2cd8efe604ee3aed222d9af32f8b7 (127.27.243.194:42953)
W20260811 08:12:24.611575 24084 leader_election.cc:341] T cbdebdd43add46b88b7bc77f6968ed7f P 2cb7dafc32a1405591a4fbc212c282f9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 75394a5549a3402b81287c9bdaa9b097 (127.27.243.195:36139): Not found: Tablet not found: cbdebdd43add46b88b7bc77f6968ed7f
W20260811 08:12:24.611665 24085 leader_election.cc:341] T cbdebdd43add46b88b7bc77f6968ed7f P 2cb7dafc32a1405591a4fbc212c282f9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer c8f2cd8efe604ee3aed222d9af32f8b7 (127.27.243.194:42953): Not found: Tablet not found: cbdebdd43add46b88b7bc77f6968ed7f
I20260811 08:12:24.611745 24085 leader_election.cc:302] T cbdebdd43add46b88b7bc77f6968ed7f P 2cb7dafc32a1405591a4fbc212c282f9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cb7dafc32a1405591a4fbc212c282f9; no voters: 75394a5549a3402b81287c9bdaa9b097, c8f2cd8efe604ee3aed222d9af32f8b7
I20260811 08:12:24.611876 24747 raft_consensus.cc:2726] T cbdebdd43add46b88b7bc77f6968ed7f P 2cb7dafc32a1405591a4fbc212c282f9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 08:12:24.637315 24749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:24.637079 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36663 (local address 127.27.243.195:50821)
0811 08:12:24.637225 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0811 08:12:24.637271 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:36663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":76,"threads_started":1}
I20260811 08:12:25.426142 24750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:25.425906 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36663 (local address 127.27.243.193:53245)
0811 08:12:25.426042 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0811 08:12:25.426090 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:36663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":76,"threads_started":1}
I20260811 08:12:25.494220 24751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:25.494033 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36663 (local address 127.27.243.194:34845)
0811 08:12:25.494145 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0811 08:12:25.494181 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:36663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97,"thread_start_us":61,"threads_started":1}
I20260811 08:12:25.637976 24752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:25.637757 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36663 (local address 127.27.243.195:41241)
0811 08:12:25.637885 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0811 08:12:25.637927 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:36663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":59,"threads_started":1}
I20260811 08:12:26.426781 24753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:26.426570 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36663 (local address 127.27.243.193:42409)
0811 08:12:26.426694 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0811 08:12:26.426735 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:36663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":61,"threads_started":1}
I20260811 08:12:26.494820 24754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:26.494619 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36663 (local address 127.27.243.194:37243)
0811 08:12:26.494736 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0811 08:12:26.494775 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:36663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":62,"threads_started":1}
I20260811 08:12:26.638561 24755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:26.638354 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36663 (local address 127.27.243.195:57637)
0811 08:12:26.638479 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0811 08:12:26.638517 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:36663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":58,"threads_started":1}
I20260811 08:12:27.427407 24757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:27.427196 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36663 (local address 127.27.243.193:51963)
0811 08:12:27.427318 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0811 08:12:27.427360 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:36663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":60,"threads_started":1}
I20260811 08:12:27.495445 24759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:27.495213 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36663 (local address 127.27.243.194:36035)
0811 08:12:27.495357 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0811 08:12:27.495396 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:36663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":61,"threads_started":1}
I20260811 08:12:27.639242 24761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:27.639029 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36663 (local address 127.27.243.195:48213)
0811 08:12:27.639161 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0811 08:12:27.639197 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:36663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":66,"threads_started":1}
I20260811 08:12:27.808164 24762 raft_consensus.cc:482] T cbdebdd43add46b88b7bc77f6968ed7f P 2cb7dafc32a1405591a4fbc212c282f9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:12:27.808264 24762 raft_consensus.cc:504] T cbdebdd43add46b88b7bc77f6968ed7f P 2cb7dafc32a1405591a4fbc212c282f9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75394a5549a3402b81287c9bdaa9b097" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 36139 } } peers { permanent_uuid: "c8f2cd8efe604ee3aed222d9af32f8b7" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 42953 } } peers { permanent_uuid: "2cb7dafc32a1405591a4fbc212c282f9" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 33129 } }
I20260811 08:12:27.808414 24762 leader_election.cc:288] T cbdebdd43add46b88b7bc77f6968ed7f P 2cb7dafc32a1405591a4fbc212c282f9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 75394a5549a3402b81287c9bdaa9b097 (127.27.243.195:36139), c8f2cd8efe604ee3aed222d9af32f8b7 (127.27.243.194:42953)
W20260811 08:12:27.808780 24084 leader_election.cc:341] T cbdebdd43add46b88b7bc77f6968ed7f P 2cb7dafc32a1405591a4fbc212c282f9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 75394a5549a3402b81287c9bdaa9b097 (127.27.243.195:36139): Not found: Tablet not found: cbdebdd43add46b88b7bc77f6968ed7f
W20260811 08:12:27.808861 24085 leader_election.cc:341] T cbdebdd43add46b88b7bc77f6968ed7f P 2cb7dafc32a1405591a4fbc212c282f9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer c8f2cd8efe604ee3aed222d9af32f8b7 (127.27.243.194:42953): Not found: Tablet not found: cbdebdd43add46b88b7bc77f6968ed7f
I20260811 08:12:27.808931 24085 leader_election.cc:302] T cbdebdd43add46b88b7bc77f6968ed7f P 2cb7dafc32a1405591a4fbc212c282f9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cb7dafc32a1405591a4fbc212c282f9; no voters: 75394a5549a3402b81287c9bdaa9b097, c8f2cd8efe604ee3aed222d9af32f8b7
I20260811 08:12:27.809012 24762 raft_consensus.cc:2726] T cbdebdd43add46b88b7bc77f6968ed7f P 2cb7dafc32a1405591a4fbc212c282f9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 08:12:28.428225 24763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:28.427982 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36663 (local address 127.27.243.193:32875)
0811 08:12:28.428123 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0811 08:12:28.428175 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:36663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":66,"threads_started":1}
I20260811 08:12:28.496251 24764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:28.495997 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36663 (local address 127.27.243.194:45803)
0811 08:12:28.496131 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0811 08:12:28.496182 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:36663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":66,"threads_started":1}
I20260811 08:12:28.640034 24766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:28.639765 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36663 (local address 127.27.243.195:57277)
0811 08:12:28.639931 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0811 08:12:28.639983 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:36663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":76,"threads_started":1}
I20260811 08:12:29.429068 24770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:29.428807 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36663 (local address 127.27.243.193:33435)
0811 08:12:29.428972 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0811 08:12:29.429020 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:36663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":79,"threads_started":1}
I20260811 08:12:29.496997 24771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:29.496742 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36663 (local address 127.27.243.194:55365)
0811 08:12:29.496899 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0811 08:12:29.496948 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:36663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":63,"threads_started":1}
I20260811 08:12:29.640798 24772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:29.640557 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36663 (local address 127.27.243.195:60541)
0811 08:12:29.640692 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0811 08:12:29.640750 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:36663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":64,"threads_started":1}
I20260811 08:12:30.429790 24773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:30.429548 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36663 (local address 127.27.243.193:60987)
0811 08:12:30.429691 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0811 08:12:30.429740 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:36663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":66,"threads_started":1}
I20260811 08:12:30.497726 24774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:30.497455 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36663 (local address 127.27.243.194:34307)
0811 08:12:30.497637 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0811 08:12:30.497678 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:36663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":87,"threads_started":1}
I20260811 08:12:30.641496 24775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:30.641288 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36663 (local address 127.27.243.195:60353)
0811 08:12:30.641410 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0811 08:12:30.641448 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:36663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":61,"threads_started":1}
I20260811 08:12:31.430454 24776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:31.430224 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36663 (local address 127.27.243.193:37063)
0811 08:12:31.430360 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0811 08:12:31.430403 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:36663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":76,"threads_started":1}
I20260811 08:12:31.498287 24779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:31.498102 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36663 (local address 127.27.243.194:48863)
0811 08:12:31.498209 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0811 08:12:31.498242 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:36663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93,"thread_start_us":60,"threads_started":1}
I20260811 08:12:31.642192 24780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:31.641932 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36663 (local address 127.27.243.195:57717)
0811 08:12:31.642111 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0811 08:12:31.642146 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:36663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":98,"threads_started":1}
I20260811 08:12:32.431147 24781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:32.430910 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36663 (local address 127.27.243.193:33479)
0811 08:12:32.431060 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0811 08:12:32.431101 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:36663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":73,"threads_started":1}
I20260811 08:12:32.498852 24782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:32.498637 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36663 (local address 127.27.243.194:42659)
0811 08:12:32.498772 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0811 08:12:32.498808 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:36663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":80,"threads_started":1}
I20260811 08:12:32.642899 24784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:32.642649 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36663 (local address 127.27.243.195:38891)
0811 08:12:32.642802 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0811 08:12:32.642848 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:36663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":71,"threads_started":1}
I20260811 08:12:33.431918 24785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:33.431685 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36663 (local address 127.27.243.193:42223)
0811 08:12:33.431831 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0811 08:12:33.431873 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:36663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":60,"threads_started":1}
I20260811 08:12:33.499604 24786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:33.499398 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36663 (local address 127.27.243.194:48285)
0811 08:12:33.499518 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0811 08:12:33.499558 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:36663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":61,"threads_started":1}
I20260811 08:12:33.643649 24788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:33.643421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:36663 (local address 127.27.243.195:55933)
0811 08:12:33.643567 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0811 08:12:33.643602 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.254:36663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":84,"threads_started":1}
I20260811 08:12:33.646911 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 23994
I20260811 08:12:33.668926 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 24285
I20260811 08:12:33.691890 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 24492
2026-08-11T08:12:33Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (58703 ms)
[----------] 30 tests from SecurityITest (236501 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435717191469-28623-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:12:33 dist-test-slave-7lbf krb5kdc[24799](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:12:33 dist-test-slave-7lbf krb5kdc[24799](info): set up 2 sockets
Aug 11 08:12:33 dist-test-slave-7lbf krb5kdc[24799](info): commencing operation
krb5kdc: starting...
W20260811 08:12:34.869009 28623 mini_kdc.cc:121] Time spent starting KDC: real 1.153s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435717191469-28623-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435717191469-28623-0/krb5kdc/test-user.keytab.
Aug 11 08:12:34 dist-test-slave-7lbf krb5kdc[24799](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435954, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:12:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:12:34Z Disabled control of system clock
WARNING: no policy specified for kudu/127.27.243.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.243.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.243.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab.
Entry for principal kudu/127.27.243.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab.
I20260811 08:12:34.985419 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435717191469-28623-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435717191469-28623-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435717191469-28623-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.243.254:35283
--webserver_interface=127.27.243.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab
--principal=kudu/127.27.243.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:39663
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.243.254:35283
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:12:35.067502 24817 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:12:35.067724 24817 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:12:35.067757 24817 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:12:35.068921 24817 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:12:35.068970 24817 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:12:35.068992 24817 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:12:35.069013 24817 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:12:35.069032 24817 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:12:35.070794 24817 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:39663
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435717191469-28623-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435717191469-28623-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.243.254:35283
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab
--principal=kudu/127.27.243.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.243.254:35283
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.243.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24817
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435717191469-28623-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:12:35.071053 24817 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:12:35.071326 24817 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:12:35.076642 24833 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:12:35.076671 24827 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:12:35.076787 24817 server_base.cc:1034] running on GCE node
W20260811 08:12:35.076730 24828 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:12:35.077071 24817 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:12:35.077337 24817 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:12:35.078485 24817 hybrid_clock.cc:648] HybridClock initialized: now 1786435955078467 us; error 34 us; skew 500 ppm
Aug 11 08:12:35 dist-test-slave-7lbf krb5kdc[24799](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435955, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:12:35.081049 24817 init.cc:377] Logged in from keytab as kudu/127.27.243.254@KRBTEST.COM (short username kudu)
I20260811 08:12:35.081501 24817 webserver.cc:460] Webserver started at http://127.27.243.254:32921/ using document root <none> and password file <none>
I20260811 08:12:35.081745 24817 fs_manager.cc:359] Metadata directory not provided
I20260811 08:12:35.081799 24817 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:12:35.081890 24817 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:12:35.082892 24817 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435717191469-28623-0/minicluster-data/master-0/data/instance:
uuid: "6891775dd7da49798c4a62f9d15a58d1"
format_stamp: "Formatted at 2026-08-11 08:12:35 on dist-test-slave-7lbf"
server_key: "e8f2ce82289a1471d8da3af3f451a583"
server_key_iv: "625b07ed3df80075befc5a44a8b33280"
server_key_version: "encryptionkey@0"
I20260811 08:12:35.083204 24817 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435717191469-28623-0/minicluster-data/master-0/wal/instance:
uuid: "6891775dd7da49798c4a62f9d15a58d1"
format_stamp: "Formatted at 2026-08-11 08:12:35 on dist-test-slave-7lbf"
server_key: "e8f2ce82289a1471d8da3af3f451a583"
server_key_iv: "625b07ed3df80075befc5a44a8b33280"
server_key_version: "encryptionkey@0"
I20260811 08:12:35.084502 24817 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 08:12:35.085216 24845 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:12:35.085368 24817 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 08:12:35.085436 24817 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435717191469-28623-0/minicluster-data/master-0/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435717191469-28623-0/minicluster-data/master-0/wal
uuid: "6891775dd7da49798c4a62f9d15a58d1"
format_stamp: "Formatted at 2026-08-11 08:12:35 on dist-test-slave-7lbf"
server_key: "e8f2ce82289a1471d8da3af3f451a583"
server_key_iv: "625b07ed3df80075befc5a44a8b33280"
server_key_version: "encryptionkey@0"
I20260811 08:12:35.085505 24817 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435717191469-28623-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435717191469-28623-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435717191469-28623-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:12:35.099146 24817 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:12:35.101147 24817 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:12:35.101255 24817 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:12:35.105026 24817 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.254:35283
I20260811 08:12:35.105085 24925 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.254:35283 every 8 connection(s)
I20260811 08:12:35.105391 24817 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
I20260811 08:12:35.106319 24927 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:12:35.108697 24927 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6891775dd7da49798c4a62f9d15a58d1: Bootstrap starting.
I20260811 08:12:35.109315 24927 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6891775dd7da49798c4a62f9d15a58d1: Neither blocks nor log segments found. Creating new log.
I20260811 08:12:35.109655 24927 log.cc:824] T 00000000000000000000000000000000 P 6891775dd7da49798c4a62f9d15a58d1: Log is configured to *not* fsync() on all Append() calls
I20260811 08:12:35.109802 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 24817
I20260811 08:12:35.109951 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435717191469-28623-0/minicluster-data/master-0/wal/instance
I20260811 08:12:35.110132 28623 external_mini_cluster.cc:1428] Setting key c2d8e4a802b03e5bf2f010d9de7b8fa9
I20260811 08:12:35.110435 24927 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6891775dd7da49798c4a62f9d15a58d1: No bootstrap required, opened a new log
I20260811 08:12:35.112356 24927 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6891775dd7da49798c4a62f9d15a58d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6891775dd7da49798c4a62f9d15a58d1" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 35283 } }
I20260811 08:12:35.112620 24927 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6891775dd7da49798c4a62f9d15a58d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:12:35.112736 24927 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6891775dd7da49798c4a62f9d15a58d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6891775dd7da49798c4a62f9d15a58d1, State: Initialized, Role: FOLLOWER
I20260811 08:12:35.112890 24927 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6891775dd7da49798c4a62f9d15a58d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6891775dd7da49798c4a62f9d15a58d1" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 35283 } }
I20260811 08:12:35.112983 24927 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6891775dd7da49798c4a62f9d15a58d1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:12:35.113044 24927 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6891775dd7da49798c4a62f9d15a58d1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:12:35.113101 24927 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6891775dd7da49798c4a62f9d15a58d1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:12:35.114291 24927 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6891775dd7da49798c4a62f9d15a58d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6891775dd7da49798c4a62f9d15a58d1" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 35283 } }
I20260811 08:12:35.114413 24927 leader_election.cc:302] T 00000000000000000000000000000000 P 6891775dd7da49798c4a62f9d15a58d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6891775dd7da49798c4a62f9d15a58d1; no voters:
I20260811 08:12:35.114573 24927 leader_election.cc:288] T 00000000000000000000000000000000 P 6891775dd7da49798c4a62f9d15a58d1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:12:35.114640 24935 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6891775dd7da49798c4a62f9d15a58d1 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:12:35.114818 24927 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6891775dd7da49798c4a62f9d15a58d1 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:12:35.114854 24935 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6891775dd7da49798c4a62f9d15a58d1 [term 1 LEADER]: Becoming Leader. State: Replica: 6891775dd7da49798c4a62f9d15a58d1, State: Running, Role: LEADER
I20260811 08:12:35.115015 24935 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6891775dd7da49798c4a62f9d15a58d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6891775dd7da49798c4a62f9d15a58d1" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 35283 } }
I20260811 08:12:35.115386 24937 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6891775dd7da49798c4a62f9d15a58d1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6891775dd7da49798c4a62f9d15a58d1. Latest consensus state: current_term: 1 leader_uuid: "6891775dd7da49798c4a62f9d15a58d1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6891775dd7da49798c4a62f9d15a58d1" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 35283 } } }
I20260811 08:12:35.115509 24937 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6891775dd7da49798c4a62f9d15a58d1 [sys.catalog]: This master's current role is: LEADER
I20260811 08:12:35.115375 24936 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6891775dd7da49798c4a62f9d15a58d1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6891775dd7da49798c4a62f9d15a58d1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6891775dd7da49798c4a62f9d15a58d1" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 35283 } } }
I20260811 08:12:35.115761 24947 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:12:35.115890 24936 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6891775dd7da49798c4a62f9d15a58d1 [sys.catalog]: This master's current role is: LEADER
I20260811 08:12:35.116425 24947 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:12:35.117944 24947 catalog_manager.cc:1347] Generated new cluster ID: 3bf3c28cad2a4e3fbfed3e9f2b81d424
I20260811 08:12:35.117990 24947 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 08:12:35 dist-test-slave-7lbf krb5kdc[24799](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435954, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.243.254@KRBTEST.COM
I20260811 08:12:35.123905 24934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:35.110609 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39992 (local address 127.27.243.254:35283)
0811 08:12:35.110813 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0811 08:12:35.110822 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 08:12:35.110847 (+ 25us) server_negotiation.cc:407] Connection header received
0811 08:12:35.112325 (+ 1478us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:12:35.112336 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:12:35.112425 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:12:35.112587 (+ 162us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:12:35.113476 (+ 889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:35.114912 (+ 1436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:35.116064 (+ 1152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:35.116666 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:35.117135 (+ 469us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:35.119776 (+ 2641us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:12:35.119794 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:12:35.119794 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:12:35.119807 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:12:35.121752 (+ 1945us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:12:35.122203 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:12:35.122206 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:12:35.122206 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:12:35.122350 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:12:35.122596 (+ 246us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:12:35.122596 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:12:35.122597 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:12:35.122917 (+ 320us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:12:35.123456 (+ 539us) server_negotiation.cc:1035] Waiting for connection context
0811 08:12:35.123533 (+ 77us) server_negotiation.cc:299] Negotiation successful
0811 08:12:35.123676 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":151,"thread_start_us":94,"threads_started":1}
I20260811 08:12:35.139739 24947 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:12:35.140357 24947 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:12:35.143949 24947 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6891775dd7da49798c4a62f9d15a58d1: Generated new TSK 0
I20260811 08:12:35.144121 24947 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.27.243.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.243.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.243.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.193.keytab.
Entry for principal kudu/127.27.243.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.193.keytab.
I20260811 08:12:35.174412 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435717191469-28623-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435717191469-28623-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435717191469-28623-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435717191469-28623-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.243.193:0
--local_ip_for_outbound_sockets=127.27.243.193
--webserver_interface=127.27.243.193
--webserver_port=0
--tserver_master_addrs=127.27.243.254:35283
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.193.keytab
--principal=kudu/127.27.243.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:39663
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:12:35.278277 24972 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:12:35.278488 24972 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:12:35.278512 24972 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:12:35.279624 24972 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:12:35.279670 24972 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:12:35.279697 24972 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.243.193
I20260811 08:12:35.281178 24972 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:39663
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435717191469-28623-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435717191469-28623-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.193.keytab
--principal=kudu/127.27.243.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.243.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435717191469-28623-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.243.193
--webserver_port=0
--tserver_master_addrs=127.27.243.254:35283
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24972
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.243.193
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435717191469-28623-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:12:35.281410 24972 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:12:35.281658 24972 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:12:35.286396 24978 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:12:35.286430 24981 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:12:35.286536 24972 server_base.cc:1034] running on GCE node
W20260811 08:12:35.286445 24977 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:12:35.286850 24972 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:12:35.287086 24972 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:12:35.288241 24972 hybrid_clock.cc:648] HybridClock initialized: now 1786435955288231 us; error 35 us; skew 500 ppm
Aug 11 08:12:35 dist-test-slave-7lbf krb5kdc[24799](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435955, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:12:35.290664 24972 init.cc:377] Logged in from keytab as kudu/127.27.243.193@KRBTEST.COM (short username kudu)
I20260811 08:12:35.291040 24972 webserver.cc:460] Webserver started at http://127.27.243.193:36105/ using document root <none> and password file <none>
I20260811 08:12:35.291224 24972 fs_manager.cc:359] Metadata directory not provided
I20260811 08:12:35.291261 24972 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:12:35.291363 24972 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:12:35.292316 24972 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435717191469-28623-0/minicluster-data/ts-0/data/instance:
uuid: "5a5059dd0ac142fc90dd2a1eb296313d"
format_stamp: "Formatted at 2026-08-11 08:12:35 on dist-test-slave-7lbf"
server_key: "b1c17828375a4e36e00afff91f026013"
server_key_iv: "8979fe4f8036d09c20e339e220aa2842"
server_key_version: "encryptionkey@0"
I20260811 08:12:35.292619 24972 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435717191469-28623-0/minicluster-data/ts-0/wal/instance:
uuid: "5a5059dd0ac142fc90dd2a1eb296313d"
format_stamp: "Formatted at 2026-08-11 08:12:35 on dist-test-slave-7lbf"
server_key: "b1c17828375a4e36e00afff91f026013"
server_key_iv: "8979fe4f8036d09c20e339e220aa2842"
server_key_version: "encryptionkey@0"
I20260811 08:12:35.293810 24972 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 08:12:35.294456 24997 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:12:35.294627 24972 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 08:12:35.294709 24972 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435717191469-28623-0/minicluster-data/ts-0/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435717191469-28623-0/minicluster-data/ts-0/wal
uuid: "5a5059dd0ac142fc90dd2a1eb296313d"
format_stamp: "Formatted at 2026-08-11 08:12:35 on dist-test-slave-7lbf"
server_key: "b1c17828375a4e36e00afff91f026013"
server_key_iv: "8979fe4f8036d09c20e339e220aa2842"
server_key_version: "encryptionkey@0"
I20260811 08:12:35.294762 24972 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435717191469-28623-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435717191469-28623-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435717191469-28623-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:12:35.312350 24972 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:12:35.314428 24972 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:12:35.314538 24972 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:12:35.314720 24972 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:12:35.315047 24972 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:12:35.315099 24972 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:12:35.315120 24972 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:12:35.315133 24972 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:12:35.320712 24972 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.193:36191
I20260811 08:12:35.320779 25190 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.193:36191 every 8 connection(s)
I20260811 08:12:35.321055 24972 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435717191469-28623-0/minicluster-data/ts-0/data/info.pb
Aug 11 08:12:35 dist-test-slave-7lbf krb5kdc[24799](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435955, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.193@KRBTEST.COM for kudu/127.27.243.254@KRBTEST.COM
I20260811 08:12:35.329659 24934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:35.321725 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.193:42079 (local address 127.27.243.254:35283)
0811 08:12:35.321777 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 08:12:35.321780 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:12:35.322009 (+ 229us) server_negotiation.cc:407] Connection header received
0811 08:12:35.322462 (+ 453us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:12:35.322463 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:12:35.322477 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:12:35.322526 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:12:35.323402 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:35.323909 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:35.324875 (+ 966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:35.325082 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:35.325133 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:35.327235 (+ 2102us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:12:35.327237 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:12:35.327237 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:12:35.327248 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:12:35.328360 (+ 1112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:12:35.328715 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:12:35.328716 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:12:35.328717 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:12:35.328773 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:12:35.329027 (+ 254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:12:35.329028 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:12:35.329028 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:12:35.329139 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:12:35.329193 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 08:12:35.329452 (+ 259us) server_negotiation.cc:299] Negotiation successful
0811 08:12:35.329568 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 08:12:35.329788 25197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:35.321715 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:35283 (local address 127.27.243.193:42079)
0811 08:12:35.321892 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0811 08:12:35.321927 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0811 08:12:35.322386 (+ 459us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:12:35.322582 (+ 196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:12:35.322586 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:12:35.323119 (+ 533us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:12:35.323309 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:12:35.323314 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:12:35.323996 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:12:35.323996 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:12:35.324786 (+ 790us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:12:35.324788 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:12:35.325157 (+ 369us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:12:35.325158 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:12:35.325262 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:35.325707 (+ 445us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:12:35.325716 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:12:35.327145 (+ 1429us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:12:35.328435 (+ 1290us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:12:35.328442 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:12:35.328444 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:12:35.328649 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:12:35.328868 (+ 219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:12:35.328868 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:12:35.328869 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:12:35.328970 (+ 101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:12:35.329194 (+ 224us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:12:35.329201 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:12:35.329333 (+ 132us) client_negotiation.cc:769] Sending connection context
0811 08:12:35.329419 (+ 86us) client_negotiation.cc:240] Negotiation successful
0811 08:12:35.329587 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":97,"threads_started":1}
I20260811 08:12:35.330205 25193 heartbeater.cc:347] Connected to a master server at 127.27.243.254:35283
I20260811 08:12:35.330291 25193 heartbeater.cc:464] Registering TS with master...
I20260811 08:12:35.330456 25193 heartbeater.cc:511] Master 127.27.243.254:35283 requested a full tablet report, sending...
I20260811 08:12:35.330684 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 24972
I20260811 08:12:35.330904 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435717191469-28623-0/minicluster-data/ts-0/wal/instance
I20260811 08:12:35.331180 28623 external_mini_cluster.cc:1428] Setting key 9beb52021d70641cca20d5d335284a39
I20260811 08:12:35.331178 24871 ts_manager.cc:194] Registered new tserver with Master: 5a5059dd0ac142fc90dd2a1eb296313d (127.27.243.193:36191)
I20260811 08:12:35.332050 24871 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.243.193@KRBTEST.COM'} at 127.27.243.193:42079
WARNING: no policy specified for kudu/127.27.243.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.243.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.243.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.194.keytab.
Entry for principal kudu/127.27.243.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.194.keytab.
I20260811 08:12:35.356557 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435717191469-28623-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435717191469-28623-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435717191469-28623-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435717191469-28623-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.243.194:0
--local_ip_for_outbound_sockets=127.27.243.194
--webserver_interface=127.27.243.194
--webserver_port=0
--tserver_master_addrs=127.27.243.254:35283
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.194.keytab
--principal=kudu/127.27.243.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:39663
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:12:35.440953 25200 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:12:35.441151 25200 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:12:35.441181 25200 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:12:35.442296 25200 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:12:35.442337 25200 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:12:35.442370 25200 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.243.194
I20260811 08:12:35.443759 25200 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:39663
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435717191469-28623-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435717191469-28623-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.194.keytab
--principal=kudu/127.27.243.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.243.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435717191469-28623-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.243.194
--webserver_port=0
--tserver_master_addrs=127.27.243.254:35283
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25200
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.243.194
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435717191469-28623-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:12:35.444005 25200 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:12:35.444208 25200 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:12:35.449088 25210 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:12:35.449131 25200 server_base.cc:1034] running on GCE node
W20260811 08:12:35.449095 25211 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:12:35.449105 25218 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:12:35.449476 25200 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:12:35.449736 25200 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:12:35.450888 25200 hybrid_clock.cc:648] HybridClock initialized: now 1786435955450884 us; error 31 us; skew 500 ppm
Aug 11 08:12:35 dist-test-slave-7lbf krb5kdc[24799](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435955, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:12:35.453248 25200 init.cc:377] Logged in from keytab as kudu/127.27.243.194@KRBTEST.COM (short username kudu)
I20260811 08:12:35.453744 25200 webserver.cc:460] Webserver started at http://127.27.243.194:39939/ using document root <none> and password file <none>
I20260811 08:12:35.453959 25200 fs_manager.cc:359] Metadata directory not provided
I20260811 08:12:35.454007 25200 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:12:35.454133 25200 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:12:35.455121 25200 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435717191469-28623-0/minicluster-data/ts-1/data/instance:
uuid: "923a2bbe60274971aa6b00b4d5347fc8"
format_stamp: "Formatted at 2026-08-11 08:12:35 on dist-test-slave-7lbf"
server_key: "fb5afc367c0f4e77fa1839acd87ef11c"
server_key_iv: "42767950a03a6d2542ecc064ccff96ba"
server_key_version: "encryptionkey@0"
I20260811 08:12:35.455458 25200 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435717191469-28623-0/minicluster-data/ts-1/wal/instance:
uuid: "923a2bbe60274971aa6b00b4d5347fc8"
format_stamp: "Formatted at 2026-08-11 08:12:35 on dist-test-slave-7lbf"
server_key: "fb5afc367c0f4e77fa1839acd87ef11c"
server_key_iv: "42767950a03a6d2542ecc064ccff96ba"
server_key_version: "encryptionkey@0"
I20260811 08:12:35.456694 25200 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 08:12:35.457338 25234 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:12:35.457486 25200 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 08:12:35.457599 25200 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435717191469-28623-0/minicluster-data/ts-1/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435717191469-28623-0/minicluster-data/ts-1/wal
uuid: "923a2bbe60274971aa6b00b4d5347fc8"
format_stamp: "Formatted at 2026-08-11 08:12:35 on dist-test-slave-7lbf"
server_key: "fb5afc367c0f4e77fa1839acd87ef11c"
server_key_iv: "42767950a03a6d2542ecc064ccff96ba"
server_key_version: "encryptionkey@0"
I20260811 08:12:35.457660 25200 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435717191469-28623-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435717191469-28623-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435717191469-28623-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:12:35.488962 25200 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:12:35.491107 25200 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:12:35.491266 25200 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:12:35.491489 25200 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:12:35.491788 25200 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:12:35.491822 25200 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:12:35.491852 25200 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:12:35.491874 25200 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:12:35.497876 25200 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.194:41393
I20260811 08:12:35.497917 25422 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.194:41393 every 8 connection(s)
I20260811 08:12:35.498227 25200 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435717191469-28623-0/minicluster-data/ts-1/data/info.pb
I20260811 08:12:35.502151 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 25200
I20260811 08:12:35.502255 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435717191469-28623-0/minicluster-data/ts-1/wal/instance
I20260811 08:12:35.502442 28623 external_mini_cluster.cc:1428] Setting key d170d61c5625645dd0321386f254db36
Aug 11 08:12:35 dist-test-slave-7lbf krb5kdc[24799](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435955, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.194@KRBTEST.COM for kudu/127.27.243.254@KRBTEST.COM
I20260811 08:12:35.506937 24934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:35.498897 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.194:47933 (local address 127.27.243.254:35283)
0811 08:12:35.498961 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0811 08:12:35.498963 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:12:35.499137 (+ 174us) server_negotiation.cc:407] Connection header received
0811 08:12:35.499609 (+ 472us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:12:35.499611 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:12:35.499621 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:12:35.499672 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:12:35.500560 (+ 888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:35.501053 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:35.502082 (+ 1029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:35.502323 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:35.502394 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:35.504428 (+ 2034us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:12:35.504429 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:12:35.504430 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:12:35.504437 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:12:35.505682 (+ 1245us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:12:35.506060 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:12:35.506062 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:12:35.506062 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:12:35.506118 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:12:35.506334 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:12:35.506335 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:12:35.506335 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:12:35.506452 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:12:35.506508 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 08:12:35.506761 (+ 253us) server_negotiation.cc:299] Negotiation successful
0811 08:12:35.506848 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260811 08:12:35.507095 25427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:35.498879 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:35283 (local address 127.27.243.194:47933)
0811 08:12:35.499032 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0811 08:12:35.499068 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 08:12:35.499532 (+ 464us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:12:35.499728 (+ 196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:12:35.499731 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:12:35.500293 (+ 562us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:12:35.500491 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:12:35.500496 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:12:35.501136 (+ 640us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:12:35.501137 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:12:35.501996 (+ 859us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:12:35.502000 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:12:35.502407 (+ 407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:12:35.502408 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:12:35.502551 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:35.503013 (+ 462us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:12:35.503023 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:12:35.504338 (+ 1315us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:12:35.505762 (+ 1424us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:12:35.505769 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:12:35.505771 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:12:35.505993 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:12:35.506172 (+ 179us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:12:35.506173 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:12:35.506173 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:12:35.506278 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:12:35.506507 (+ 229us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:12:35.506514 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:12:35.506645 (+ 131us) client_negotiation.cc:769] Sending connection context
0811 08:12:35.506732 (+ 87us) client_negotiation.cc:240] Negotiation successful
0811 08:12:35.506890 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":88,"threads_started":1}
I20260811 08:12:35.507501 25425 heartbeater.cc:347] Connected to a master server at 127.27.243.254:35283
I20260811 08:12:35.507606 25425 heartbeater.cc:464] Registering TS with master...
I20260811 08:12:35.507788 25425 heartbeater.cc:511] Master 127.27.243.254:35283 requested a full tablet report, sending...
I20260811 08:12:35.508167 24871 ts_manager.cc:194] Registered new tserver with Master: 923a2bbe60274971aa6b00b4d5347fc8 (127.27.243.194:41393)
I20260811 08:12:35.508526 24871 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.243.194@KRBTEST.COM'} at 127.27.243.194:47933
WARNING: no policy specified for kudu/127.27.243.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.243.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.243.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.195.keytab.
Entry for principal kudu/127.27.243.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.195.keytab.
I20260811 08:12:35.526623 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435717191469-28623-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435717191469-28623-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435717191469-28623-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435717191469-28623-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.243.195:0
--local_ip_for_outbound_sockets=127.27.243.195
--webserver_interface=127.27.243.195
--webserver_port=0
--tserver_master_addrs=127.27.243.254:35283
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.195.keytab
--principal=kudu/127.27.243.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:39663
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:12:35.609620 25433 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:12:35.609817 25433 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:12:35.609840 25433 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:12:35.611022 25433 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:12:35.611070 25433 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:12:35.611094 25433 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.243.195
I20260811 08:12:35.612528 25433 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:39663
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435717191469-28623-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435717191469-28623-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.195.keytab
--principal=kudu/127.27.243.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.243.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435717191469-28623-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.243.195
--webserver_port=0
--tserver_master_addrs=127.27.243.254:35283
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25433
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.243.195
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435717191469-28623-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:12:35.612731 25433 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:12:35.612923 25433 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:12:35.618115 25442 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:12:35.618294 25433 server_base.cc:1034] running on GCE node
W20260811 08:12:35.618124 25445 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:12:35.618129 25443 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:12:35.618585 25433 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:12:35.618813 25433 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:12:35.619966 25433 hybrid_clock.cc:648] HybridClock initialized: now 1786435955619949 us; error 33 us; skew 500 ppm
Aug 11 08:12:35 dist-test-slave-7lbf krb5kdc[24799](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435955, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:12:35.622408 25433 init.cc:377] Logged in from keytab as kudu/127.27.243.195@KRBTEST.COM (short username kudu)
I20260811 08:12:35.622829 25433 webserver.cc:460] Webserver started at http://127.27.243.195:33835/ using document root <none> and password file <none>
I20260811 08:12:35.623095 25433 fs_manager.cc:359] Metadata directory not provided
I20260811 08:12:35.623144 25433 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:12:35.623282 25433 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:12:35.624397 25433 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435717191469-28623-0/minicluster-data/ts-2/data/instance:
uuid: "36f4022cb2604c16873ae1a550630067"
format_stamp: "Formatted at 2026-08-11 08:12:35 on dist-test-slave-7lbf"
server_key: "89d0c2f4ec8e3ae4c958aa0055e4f6cb"
server_key_iv: "c95d2e4d34f8b84fdddc31ba5e68962f"
server_key_version: "encryptionkey@0"
I20260811 08:12:35.624725 25433 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435717191469-28623-0/minicluster-data/ts-2/wal/instance:
uuid: "36f4022cb2604c16873ae1a550630067"
format_stamp: "Formatted at 2026-08-11 08:12:35 on dist-test-slave-7lbf"
server_key: "89d0c2f4ec8e3ae4c958aa0055e4f6cb"
server_key_iv: "c95d2e4d34f8b84fdddc31ba5e68962f"
server_key_version: "encryptionkey@0"
I20260811 08:12:35.626046 25433 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 08:12:35.626699 25456 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:12:35.626909 25433 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 08:12:35.627002 25433 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435717191469-28623-0/minicluster-data/ts-2/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435717191469-28623-0/minicluster-data/ts-2/wal
uuid: "36f4022cb2604c16873ae1a550630067"
format_stamp: "Formatted at 2026-08-11 08:12:35 on dist-test-slave-7lbf"
server_key: "89d0c2f4ec8e3ae4c958aa0055e4f6cb"
server_key_iv: "c95d2e4d34f8b84fdddc31ba5e68962f"
server_key_version: "encryptionkey@0"
I20260811 08:12:35.627069 25433 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435717191469-28623-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435717191469-28623-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435717191469-28623-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:12:35.634397 25433 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:12:35.636180 25433 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:12:35.636308 25433 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:12:35.636507 25433 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:12:35.636775 25433 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:12:35.636808 25433 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:12:35.636834 25433 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:12:35.636873 25433 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:12:35.642603 25433 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.195:37273
I20260811 08:12:35.642659 25661 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.195:37273 every 8 connection(s)
I20260811 08:12:35.642948 25433 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435717191469-28623-0/minicluster-data/ts-2/data/info.pb
Aug 11 08:12:35 dist-test-slave-7lbf krb5kdc[24799](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435955, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.195@KRBTEST.COM for kudu/127.27.243.254@KRBTEST.COM
I20260811 08:12:35.651813 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 25433
I20260811 08:12:35.651902 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435717191469-28623-0/minicluster-data/ts-2/wal/instance
I20260811 08:12:35.652060 28623 external_mini_cluster.cc:1428] Setting key a3fae8dec6a410cee372802a7fcedce1
I20260811 08:12:35.652308 24934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:35.643604 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.195:37167 (local address 127.27.243.254:35283)
0811 08:12:35.643662 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0811 08:12:35.643663 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 08:12:35.643867 (+ 204us) server_negotiation.cc:407] Connection header received
0811 08:12:35.644504 (+ 637us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:12:35.644505 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:12:35.644520 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:12:35.644572 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:12:35.645541 (+ 969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:35.646063 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:35.647081 (+ 1018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:35.647295 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:35.647354 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:35.649556 (+ 2202us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:12:35.649559 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:12:35.649559 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:12:35.649567 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:12:35.650915 (+ 1348us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:12:35.651308 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:12:35.651310 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:12:35.651310 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:12:35.651377 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:12:35.651609 (+ 232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:12:35.651610 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:12:35.651610 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:12:35.651727 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:12:35.651809 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0811 08:12:35.652121 (+ 312us) server_negotiation.cc:299] Negotiation successful
0811 08:12:35.652213 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 08:12:35.652451 25668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:35.643556 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:35283 (local address 127.27.243.195:37167)
0811 08:12:35.643715 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0811 08:12:35.643754 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 08:12:35.644388 (+ 634us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:12:35.644645 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:12:35.644649 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:12:35.645212 (+ 563us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:12:35.645418 (+ 206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:12:35.645424 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:12:35.646159 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:12:35.646160 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:12:35.646986 (+ 826us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:12:35.646989 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:12:35.647382 (+ 393us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:12:35.647383 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:12:35.647517 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:35.648038 (+ 521us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:12:35.648047 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:12:35.649435 (+ 1388us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:12:35.650999 (+ 1564us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:12:35.651007 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:12:35.651009 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:12:35.651232 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:12:35.651438 (+ 206us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:12:35.651439 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:12:35.651439 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:12:35.651548 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:12:35.651807 (+ 259us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:12:35.651815 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:12:35.651967 (+ 152us) client_negotiation.cc:769] Sending connection context
0811 08:12:35.652071 (+ 104us) client_negotiation.cc:240] Negotiation successful
0811 08:12:35.652224 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":74,"threads_started":1}
I20260811 08:12:35.653012 25663 heartbeater.cc:347] Connected to a master server at 127.27.243.254:35283
I20260811 08:12:35.653110 25663 heartbeater.cc:464] Registering TS with master...
I20260811 08:12:35.653283 25663 heartbeater.cc:511] Master 127.27.243.254:35283 requested a full tablet report, sending...
I20260811 08:12:35.653661 24871 ts_manager.cc:194] Registered new tserver with Master: 36f4022cb2604c16873ae1a550630067 (127.27.243.195:37273)
I20260811 08:12:35.654034 24871 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.243.195@KRBTEST.COM'} at 127.27.243.195:37167
I20260811 08:12:35.663784 28623 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 08:12:35.670611 24934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:35.665078 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40006 (local address 127.27.243.254:35283)
0811 08:12:35.665126 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 08:12:35.665128 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:12:35.665211 (+ 83us) server_negotiation.cc:407] Connection header received
0811 08:12:35.665261 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:12:35.665262 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:12:35.665270 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:12:35.665313 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:12:35.665879 (+ 566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:35.666462 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:35.667162 (+ 700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:35.667381 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:35.667447 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:35.668471 (+ 1024us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:12:35.668472 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:12:35.668472 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:12:35.668478 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:12:35.669730 (+ 1252us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:12:35.670028 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:12:35.670029 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:12:35.670029 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:12:35.670076 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:12:35.670197 (+ 121us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:12:35.670197 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:12:35.670197 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:12:35.670335 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:12:35.670406 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 08:12:35.670479 (+ 73us) server_negotiation.cc:299] Negotiation successful
0811 08:12:35.670550 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 08:12:35.672144 24871 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40006:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 08:12:35.674047 24871 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 08:12:35.680251 25693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:35.676275 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.195:37273 (local address 127.0.0.1:35124)
0811 08:12:35.676447 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0811 08:12:35.676488 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 08:12:35.676562 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:12:35.676962 (+ 400us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:12:35.676966 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:12:35.676969 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:12:35.677035 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:12:35.677037 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:12:35.678090 (+ 1053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:12:35.678091 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:12:35.679095 (+ 1004us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:12:35.679097 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:12:35.679969 (+ 872us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:12:35.679970 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:12:35.680047 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:35.680061 (+ 14us) client_negotiation.cc:769] Sending connection context
0811 08:12:35.680123 (+ 62us) client_negotiation.cc:240] Negotiation successful
0811 08:12:35.680178 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":43,"threads_started":1}
I20260811 08:12:35.680262 25694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:35.676467 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35124 (local address 127.27.243.195:37273)
0811 08:12:35.676712 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0811 08:12:35.676717 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 08:12:35.676727 (+ 10us) server_negotiation.cc:407] Connection header received
0811 08:12:35.676768 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:12:35.676770 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:12:35.676786 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:12:35.676917 (+ 131us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:12:35.677124 (+ 207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:35.677998 (+ 874us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:35.679188 (+ 1190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:35.679902 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:35.679962 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:35.680021 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0811 08:12:35.680147 (+ 126us) server_negotiation.cc:299] Negotiation successful
0811 08:12:35.680188 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":205,"thread_start_us":87,"threads_started":1}
I20260811 08:12:35.680487 25692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:35.676277 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.193:36191 (local address 127.0.0.1:34772)
0811 08:12:35.676863 (+ 586us) negotiation.cc:107] Waiting for socket to connect
0811 08:12:35.676871 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 08:12:35.676934 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:12:35.677100 (+ 166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:12:35.677101 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:12:35.677103 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:12:35.677147 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:12:35.677148 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:12:35.678515 (+ 1367us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:12:35.678516 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:12:35.679428 (+ 912us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:12:35.679431 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:12:35.680256 (+ 825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:12:35.680257 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:12:35.680318 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:35.680323 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 08:12:35.680375 (+ 52us) client_negotiation.cc:240] Negotiation successful
0811 08:12:35.680415 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":568,"mutex_wait_us":1,"thread_start_us":116,"threads_started":1}
I20260811 08:12:35.680527 25698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:35.676566 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34772 (local address 127.27.243.193:36191)
0811 08:12:35.676731 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0811 08:12:35.676735 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 08:12:35.676953 (+ 218us) server_negotiation.cc:407] Connection header received
0811 08:12:35.677001 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:12:35.677003 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:12:35.677019 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:12:35.677085 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:12:35.677226 (+ 141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:35.678406 (+ 1180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:35.679515 (+ 1109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:35.680104 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:35.680173 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:35.680220 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0811 08:12:35.680400 (+ 180us) server_negotiation.cc:299] Negotiation successful
0811 08:12:35.680447 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":93,"threads_started":1}
I20260811 08:12:35.681012 25690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:35.676277 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.194:41393 (local address 127.0.0.1:37402)
0811 08:12:35.676742 (+ 465us) negotiation.cc:107] Waiting for socket to connect
0811 08:12:35.676751 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 08:12:35.676794 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:12:35.677347 (+ 553us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:12:35.677348 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:12:35.677351 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:12:35.677396 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:12:35.677397 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:12:35.678645 (+ 1248us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:12:35.678646 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:12:35.679710 (+ 1064us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:12:35.679713 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:12:35.680832 (+ 1119us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:12:35.680833 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:12:35.680895 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:35.680898 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 08:12:35.680924 (+ 26us) client_negotiation.cc:240] Negotiation successful
0811 08:12:35.680952 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":453,"thread_start_us":85,"threads_started":1}
I20260811 08:12:35.681389 25697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:35.676467 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37402 (local address 127.27.243.194:41393)
0811 08:12:35.677186 (+ 719us) server_negotiation.cc:206] Beginning negotiation
0811 08:12:35.677190 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 08:12:35.677200 (+ 10us) server_negotiation.cc:407] Connection header received
0811 08:12:35.677241 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:12:35.677243 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:12:35.677258 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:12:35.677339 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:12:35.677464 (+ 125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:35.678541 (+ 1077us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:35.679792 (+ 1251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:35.680500 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:35.681163 (+ 663us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:35.681230 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 08:12:35.681256 (+ 26us) server_negotiation.cc:299] Negotiation successful
0811 08:12:35.681299 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":568,"thread_start_us":88,"threads_started":1}
I20260811 08:12:35.681286 25081 tablet_service.cc:1467] Processing CreateTablet for tablet d631cb8122ed4b568c57ad36f79a4691 (DEFAULT_TABLE table=test-table [id=5de8bac873744b0987ece27a2a69afc0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:12:35.681406 25549 tablet_service.cc:1467] Processing CreateTablet for tablet d631cb8122ed4b568c57ad36f79a4691 (DEFAULT_TABLE table=test-table [id=5de8bac873744b0987ece27a2a69afc0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:12:35.681700 25081 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d631cb8122ed4b568c57ad36f79a4691. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:12:35.681775 25549 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d631cb8122ed4b568c57ad36f79a4691. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:12:35.682021 25310 tablet_service.cc:1467] Processing CreateTablet for tablet d631cb8122ed4b568c57ad36f79a4691 (DEFAULT_TABLE table=test-table [id=5de8bac873744b0987ece27a2a69afc0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:12:35.682349 25310 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d631cb8122ed4b568c57ad36f79a4691. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:12:35.684494 25699 tablet_bootstrap.cc:492] T d631cb8122ed4b568c57ad36f79a4691 P 5a5059dd0ac142fc90dd2a1eb296313d: Bootstrap starting.
I20260811 08:12:35.685009 25703 tablet_bootstrap.cc:492] T d631cb8122ed4b568c57ad36f79a4691 P 36f4022cb2604c16873ae1a550630067: Bootstrap starting.
I20260811 08:12:35.685256 25699 tablet_bootstrap.cc:654] T d631cb8122ed4b568c57ad36f79a4691 P 5a5059dd0ac142fc90dd2a1eb296313d: Neither blocks nor log segments found. Creating new log.
I20260811 08:12:35.685714 25706 tablet_bootstrap.cc:492] T d631cb8122ed4b568c57ad36f79a4691 P 923a2bbe60274971aa6b00b4d5347fc8: Bootstrap starting.
I20260811 08:12:35.685734 25703 tablet_bootstrap.cc:654] T d631cb8122ed4b568c57ad36f79a4691 P 36f4022cb2604c16873ae1a550630067: Neither blocks nor log segments found. Creating new log.
I20260811 08:12:35.685889 25699 log.cc:824] T d631cb8122ed4b568c57ad36f79a4691 P 5a5059dd0ac142fc90dd2a1eb296313d: Log is configured to *not* fsync() on all Append() calls
I20260811 08:12:35.686257 25703 log.cc:824] T d631cb8122ed4b568c57ad36f79a4691 P 36f4022cb2604c16873ae1a550630067: Log is configured to *not* fsync() on all Append() calls
I20260811 08:12:35.686303 25706 tablet_bootstrap.cc:654] T d631cb8122ed4b568c57ad36f79a4691 P 923a2bbe60274971aa6b00b4d5347fc8: Neither blocks nor log segments found. Creating new log.
I20260811 08:12:35.686661 25699 tablet_bootstrap.cc:492] T d631cb8122ed4b568c57ad36f79a4691 P 5a5059dd0ac142fc90dd2a1eb296313d: No bootstrap required, opened a new log
I20260811 08:12:35.686760 25699 ts_tablet_manager.cc:1397] T d631cb8122ed4b568c57ad36f79a4691 P 5a5059dd0ac142fc90dd2a1eb296313d: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 08:12:35.686836 25706 log.cc:824] T d631cb8122ed4b568c57ad36f79a4691 P 923a2bbe60274971aa6b00b4d5347fc8: Log is configured to *not* fsync() on all Append() calls
I20260811 08:12:35.687023 25703 tablet_bootstrap.cc:492] T d631cb8122ed4b568c57ad36f79a4691 P 36f4022cb2604c16873ae1a550630067: No bootstrap required, opened a new log
I20260811 08:12:35.687091 25703 ts_tablet_manager.cc:1397] T d631cb8122ed4b568c57ad36f79a4691 P 36f4022cb2604c16873ae1a550630067: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 08:12:35.687486 25706 tablet_bootstrap.cc:492] T d631cb8122ed4b568c57ad36f79a4691 P 923a2bbe60274971aa6b00b4d5347fc8: No bootstrap required, opened a new log
I20260811 08:12:35.687546 25706 ts_tablet_manager.cc:1397] T d631cb8122ed4b568c57ad36f79a4691 P 923a2bbe60274971aa6b00b4d5347fc8: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 08:12:35.688822 25699 raft_consensus.cc:348] T d631cb8122ed4b568c57ad36f79a4691 P 5a5059dd0ac142fc90dd2a1eb296313d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a5059dd0ac142fc90dd2a1eb296313d" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 36191 } } peers { permanent_uuid: "923a2bbe60274971aa6b00b4d5347fc8" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 41393 } } peers { permanent_uuid: "36f4022cb2604c16873ae1a550630067" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 37273 } }
I20260811 08:12:35.689011 25699 raft_consensus.cc:374] T d631cb8122ed4b568c57ad36f79a4691 P 5a5059dd0ac142fc90dd2a1eb296313d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:12:35.689056 25699 raft_consensus.cc:729] T d631cb8122ed4b568c57ad36f79a4691 P 5a5059dd0ac142fc90dd2a1eb296313d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a5059dd0ac142fc90dd2a1eb296313d, State: Initialized, Role: FOLLOWER
I20260811 08:12:35.688946 25703 raft_consensus.cc:348] T d631cb8122ed4b568c57ad36f79a4691 P 36f4022cb2604c16873ae1a550630067 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a5059dd0ac142fc90dd2a1eb296313d" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 36191 } } peers { permanent_uuid: "923a2bbe60274971aa6b00b4d5347fc8" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 41393 } } peers { permanent_uuid: "36f4022cb2604c16873ae1a550630067" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 37273 } }
I20260811 08:12:35.689095 25703 raft_consensus.cc:374] T d631cb8122ed4b568c57ad36f79a4691 P 36f4022cb2604c16873ae1a550630067 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:12:35.689131 25703 raft_consensus.cc:729] T d631cb8122ed4b568c57ad36f79a4691 P 36f4022cb2604c16873ae1a550630067 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36f4022cb2604c16873ae1a550630067, State: Initialized, Role: FOLLOWER
I20260811 08:12:35.689102 25706 raft_consensus.cc:348] T d631cb8122ed4b568c57ad36f79a4691 P 923a2bbe60274971aa6b00b4d5347fc8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a5059dd0ac142fc90dd2a1eb296313d" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 36191 } } peers { permanent_uuid: "923a2bbe60274971aa6b00b4d5347fc8" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 41393 } } peers { permanent_uuid: "36f4022cb2604c16873ae1a550630067" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 37273 } }
I20260811 08:12:35.689230 25703 consensus_queue.cc:260] T d631cb8122ed4b568c57ad36f79a4691 P 36f4022cb2604c16873ae1a550630067 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a5059dd0ac142fc90dd2a1eb296313d" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 36191 } } peers { permanent_uuid: "923a2bbe60274971aa6b00b4d5347fc8" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 41393 } } peers { permanent_uuid: "36f4022cb2604c16873ae1a550630067" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 37273 } }
I20260811 08:12:35.689230 25699 consensus_queue.cc:260] T d631cb8122ed4b568c57ad36f79a4691 P 5a5059dd0ac142fc90dd2a1eb296313d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a5059dd0ac142fc90dd2a1eb296313d" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 36191 } } peers { permanent_uuid: "923a2bbe60274971aa6b00b4d5347fc8" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 41393 } } peers { permanent_uuid: "36f4022cb2604c16873ae1a550630067" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 37273 } }
I20260811 08:12:35.689267 25706 raft_consensus.cc:374] T d631cb8122ed4b568c57ad36f79a4691 P 923a2bbe60274971aa6b00b4d5347fc8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:12:35.689311 25706 raft_consensus.cc:729] T d631cb8122ed4b568c57ad36f79a4691 P 923a2bbe60274971aa6b00b4d5347fc8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 923a2bbe60274971aa6b00b4d5347fc8, State: Initialized, Role: FOLLOWER
I20260811 08:12:35.689453 25706 consensus_queue.cc:260] T d631cb8122ed4b568c57ad36f79a4691 P 923a2bbe60274971aa6b00b4d5347fc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a5059dd0ac142fc90dd2a1eb296313d" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 36191 } } peers { permanent_uuid: "923a2bbe60274971aa6b00b4d5347fc8" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 41393 } } peers { permanent_uuid: "36f4022cb2604c16873ae1a550630067" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 37273 } }
I20260811 08:12:35.689509 25699 ts_tablet_manager.cc:1428] T d631cb8122ed4b568c57ad36f79a4691 P 5a5059dd0ac142fc90dd2a1eb296313d: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260811 08:12:35.689509 25703 ts_tablet_manager.cc:1428] T d631cb8122ed4b568c57ad36f79a4691 P 36f4022cb2604c16873ae1a550630067: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260811 08:12:35.689647 25663 heartbeater.cc:503] Master 127.27.243.254:35283 was elected leader, sending a full tablet report...
I20260811 08:12:35.689739 25706 ts_tablet_manager.cc:1428] T d631cb8122ed4b568c57ad36f79a4691 P 923a2bbe60274971aa6b00b4d5347fc8: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260811 08:12:35.689785 25425 heartbeater.cc:503] Master 127.27.243.254:35283 was elected leader, sending a full tablet report...
I20260811 08:12:35.689896 25193 heartbeater.cc:503] Master 127.27.243.254:35283 was elected leader, sending a full tablet report...
W20260811 08:12:35.748872 25426 tablet.cc:2369] T d631cb8122ed4b568c57ad36f79a4691 P 923a2bbe60274971aa6b00b4d5347fc8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 08:12:35.781937 25720 raft_consensus.cc:482] T d631cb8122ed4b568c57ad36f79a4691 P 923a2bbe60274971aa6b00b4d5347fc8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:12:35.782068 25720 raft_consensus.cc:504] T d631cb8122ed4b568c57ad36f79a4691 P 923a2bbe60274971aa6b00b4d5347fc8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a5059dd0ac142fc90dd2a1eb296313d" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 36191 } } peers { permanent_uuid: "923a2bbe60274971aa6b00b4d5347fc8" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 41393 } } peers { permanent_uuid: "36f4022cb2604c16873ae1a550630067" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 37273 } }
I20260811 08:12:35.782454 25720 leader_election.cc:288] T d631cb8122ed4b568c57ad36f79a4691 P 923a2bbe60274971aa6b00b4d5347fc8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a5059dd0ac142fc90dd2a1eb296313d (127.27.243.193:36191), 36f4022cb2604c16873ae1a550630067 (127.27.243.195:37273)
I20260811 08:12:35.785243 25694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:35.782823 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.194:45675 (local address 127.27.243.195:37273)
0811 08:12:35.782886 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0811 08:12:35.782887 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 08:12:35.782896 (+ 9us) server_negotiation.cc:407] Connection header received
0811 08:12:35.782922 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:12:35.782923 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:12:35.782931 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:12:35.782979 (+ 48us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:12:35.783137 (+ 158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:35.783642 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:35.784548 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:35.784927 (+ 379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:35.784990 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:35.784999 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 08:12:35.785141 (+ 142us) server_negotiation.cc:299] Negotiation successful
0811 08:12:35.785178 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 08:12:35.785243 25427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:35.782655 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.195:37273 (local address 127.27.243.194:45675)
0811 08:12:35.782713 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0811 08:12:35.782727 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 08:12:35.782789 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:12:35.782992 (+ 203us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:12:35.782993 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:12:35.782995 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:12:35.783068 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:12:35.783070 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:12:35.783714 (+ 644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:12:35.783716 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:12:35.784459 (+ 743us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:12:35.784461 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:12:35.784996 (+ 535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:12:35.784997 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:12:35.785078 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:35.785082 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 08:12:35.785126 (+ 44us) client_negotiation.cc:240] Negotiation successful
0811 08:12:35.785167 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260811 08:12:35.785502 25698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:35.782740 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.194:37523 (local address 127.27.243.193:36191)
0811 08:12:35.782793 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 08:12:35.782795 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:12:35.782992 (+ 197us) server_negotiation.cc:407] Connection header received
0811 08:12:35.783029 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:12:35.783030 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:12:35.783040 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:12:35.783091 (+ 51us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:12:35.783258 (+ 167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:35.783725 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:35.784750 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:35.785129 (+ 379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:35.785191 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:35.785200 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 08:12:35.785377 (+ 177us) server_negotiation.cc:299] Negotiation successful
0811 08:12:35.785428 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260811 08:12:35.785737 25723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:35.782655 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.193:36191 (local address 127.27.243.194:37523)
0811 08:12:35.782905 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0811 08:12:35.782915 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 08:12:35.782979 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:12:35.783106 (+ 127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:12:35.783107 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:12:35.783109 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:12:35.783182 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:12:35.783184 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:12:35.783890 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:12:35.783892 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:12:35.784646 (+ 754us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:12:35.784648 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:12:35.785211 (+ 563us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:12:35.785212 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:12:35.785283 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:35.785286 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 08:12:35.785612 (+ 326us) client_negotiation.cc:240] Negotiation successful
0811 08:12:35.785658 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":230,"mutex_wait_us":71,"thread_start_us":117,"threads_started":1}
I20260811 08:12:35.785758 25583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d631cb8122ed4b568c57ad36f79a4691" candidate_uuid: "923a2bbe60274971aa6b00b4d5347fc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f4022cb2604c16873ae1a550630067" is_pre_election: true
I20260811 08:12:35.785944 25583 raft_consensus.cc:2454] T d631cb8122ed4b568c57ad36f79a4691 P 36f4022cb2604c16873ae1a550630067 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 923a2bbe60274971aa6b00b4d5347fc8 in term 0.
I20260811 08:12:35.786095 25119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d631cb8122ed4b568c57ad36f79a4691" candidate_uuid: "923a2bbe60274971aa6b00b4d5347fc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a5059dd0ac142fc90dd2a1eb296313d" is_pre_election: true
I20260811 08:12:35.786226 25119 raft_consensus.cc:2454] T d631cb8122ed4b568c57ad36f79a4691 P 5a5059dd0ac142fc90dd2a1eb296313d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 923a2bbe60274971aa6b00b4d5347fc8 in term 0.
I20260811 08:12:35.786202 25235 leader_election.cc:302] T d631cb8122ed4b568c57ad36f79a4691 P 923a2bbe60274971aa6b00b4d5347fc8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f4022cb2604c16873ae1a550630067, 923a2bbe60274971aa6b00b4d5347fc8; no voters:
I20260811 08:12:35.786334 25720 raft_consensus.cc:2781] T d631cb8122ed4b568c57ad36f79a4691 P 923a2bbe60274971aa6b00b4d5347fc8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 08:12:35.786388 25720 raft_consensus.cc:482] T d631cb8122ed4b568c57ad36f79a4691 P 923a2bbe60274971aa6b00b4d5347fc8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 08:12:35.786412 25720 raft_consensus.cc:3037] T d631cb8122ed4b568c57ad36f79a4691 P 923a2bbe60274971aa6b00b4d5347fc8 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:12:35.787122 25720 raft_consensus.cc:504] T d631cb8122ed4b568c57ad36f79a4691 P 923a2bbe60274971aa6b00b4d5347fc8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a5059dd0ac142fc90dd2a1eb296313d" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 36191 } } peers { permanent_uuid: "923a2bbe60274971aa6b00b4d5347fc8" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 41393 } } peers { permanent_uuid: "36f4022cb2604c16873ae1a550630067" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 37273 } }
I20260811 08:12:35.787238 25720 leader_election.cc:288] T d631cb8122ed4b568c57ad36f79a4691 P 923a2bbe60274971aa6b00b4d5347fc8 [CANDIDATE]: Term 1 election: Requested vote from peers 5a5059dd0ac142fc90dd2a1eb296313d (127.27.243.193:36191), 36f4022cb2604c16873ae1a550630067 (127.27.243.195:37273)
I20260811 08:12:35.787390 25583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d631cb8122ed4b568c57ad36f79a4691" candidate_uuid: "923a2bbe60274971aa6b00b4d5347fc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f4022cb2604c16873ae1a550630067"
I20260811 08:12:35.787459 25583 raft_consensus.cc:3037] T d631cb8122ed4b568c57ad36f79a4691 P 36f4022cb2604c16873ae1a550630067 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:12:35.787447 25119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d631cb8122ed4b568c57ad36f79a4691" candidate_uuid: "923a2bbe60274971aa6b00b4d5347fc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a5059dd0ac142fc90dd2a1eb296313d"
I20260811 08:12:35.787528 25119 raft_consensus.cc:3037] T d631cb8122ed4b568c57ad36f79a4691 P 5a5059dd0ac142fc90dd2a1eb296313d [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:12:35.788254 25583 raft_consensus.cc:2454] T d631cb8122ed4b568c57ad36f79a4691 P 36f4022cb2604c16873ae1a550630067 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 923a2bbe60274971aa6b00b4d5347fc8 in term 1.
I20260811 08:12:35.788287 25119 raft_consensus.cc:2454] T d631cb8122ed4b568c57ad36f79a4691 P 5a5059dd0ac142fc90dd2a1eb296313d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 923a2bbe60274971aa6b00b4d5347fc8 in term 1.
I20260811 08:12:35.788407 25235 leader_election.cc:302] T d631cb8122ed4b568c57ad36f79a4691 P 923a2bbe60274971aa6b00b4d5347fc8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f4022cb2604c16873ae1a550630067, 923a2bbe60274971aa6b00b4d5347fc8; no voters:
I20260811 08:12:35.788527 25720 raft_consensus.cc:2781] T d631cb8122ed4b568c57ad36f79a4691 P 923a2bbe60274971aa6b00b4d5347fc8 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:12:35.788693 25720 raft_consensus.cc:686] T d631cb8122ed4b568c57ad36f79a4691 P 923a2bbe60274971aa6b00b4d5347fc8 [term 1 LEADER]: Becoming Leader. State: Replica: 923a2bbe60274971aa6b00b4d5347fc8, State: Running, Role: LEADER
I20260811 08:12:35.788782 25720 consensus_queue.cc:237] T d631cb8122ed4b568c57ad36f79a4691 P 923a2bbe60274971aa6b00b4d5347fc8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a5059dd0ac142fc90dd2a1eb296313d" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 36191 } } peers { permanent_uuid: "923a2bbe60274971aa6b00b4d5347fc8" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 41393 } } peers { permanent_uuid: "36f4022cb2604c16873ae1a550630067" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 37273 } }
I20260811 08:12:35.789680 24870 catalog_manager.cc:5495] T d631cb8122ed4b568c57ad36f79a4691 P 923a2bbe60274971aa6b00b4d5347fc8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 923a2bbe60274971aa6b00b4d5347fc8 (127.27.243.194). New cstate: current_term: 1 leader_uuid: "923a2bbe60274971aa6b00b4d5347fc8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a5059dd0ac142fc90dd2a1eb296313d" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 36191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "923a2bbe60274971aa6b00b4d5347fc8" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 41393 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "36f4022cb2604c16873ae1a550630067" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 37273 } health_report { overall_health: UNKNOWN } } }
W20260811 08:12:35.821755 25194 tablet.cc:2369] T d631cb8122ed4b568c57ad36f79a4691 P 5a5059dd0ac142fc90dd2a1eb296313d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 08:12:35.823557 25697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:35.821151 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37416 (local address 127.27.243.194:41393)
0811 08:12:35.821202 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 08:12:35.821205 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:12:35.821213 (+ 8us) server_negotiation.cc:407] Connection header received
0811 08:12:35.821277 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:12:35.821278 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:12:35.821296 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:12:35.821356 (+ 60us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:12:35.821485 (+ 129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:35.822061 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:35.822832 (+ 771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:35.823035 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:35.823090 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:35.823246 (+ 156us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:12:35.823350 (+ 104us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:12:35.823422 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0811 08:12:35.823462 (+ 40us) server_negotiation.cc:299] Negotiation successful
0811 08:12:35.823483 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 08:12:35.825372 25119 raft_consensus.cc:1261] T d631cb8122ed4b568c57ad36f79a4691 P 5a5059dd0ac142fc90dd2a1eb296313d [term 1 FOLLOWER]: Refusing update from remote peer 923a2bbe60274971aa6b00b4d5347fc8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:12:35.825421 25583 raft_consensus.cc:1261] T d631cb8122ed4b568c57ad36f79a4691 P 36f4022cb2604c16873ae1a550630067 [term 1 FOLLOWER]: Refusing update from remote peer 923a2bbe60274971aa6b00b4d5347fc8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:12:35.825773 25730 consensus_queue.cc:1035] T d631cb8122ed4b568c57ad36f79a4691 P 923a2bbe60274971aa6b00b4d5347fc8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f4022cb2604c16873ae1a550630067" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 37273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:12:35.825901 25720 consensus_queue.cc:1035] T d631cb8122ed4b568c57ad36f79a4691 P 923a2bbe60274971aa6b00b4d5347fc8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a5059dd0ac142fc90dd2a1eb296313d" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 36191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:12:35.828686 25733 mvcc.cc:205] Tried to move back new op lower bound from 7317241675057922048 to 7317241674911539200. Current Snapshot: MvccSnapshot[applied={T|T < 7317241675057922048 or (T in {7317241675057922048})}]
I20260811 08:12:35.829035 25734 mvcc.cc:205] Tried to move back new op lower bound from 7317241675057922048 to 7317241674911539200. Current Snapshot: MvccSnapshot[applied={T|T < 7317241675057922048}]
I20260811 08:12:35.829180 25737 mvcc.cc:205] Tried to move back new op lower bound from 7317241675057922048 to 7317241674911539200. Current Snapshot: MvccSnapshot[applied={T|T < 7317241675057922048 or (T in {7317241675057922048})}]
I20260811 08:12:35.830320 24869 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40006:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:12:35.830404 24869 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40006:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:12:35.831125 24869 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6891775dd7da49798c4a62f9d15a58d1: Sending DeleteTablet for 3 replicas of tablet d631cb8122ed4b568c57ad36f79a4691
I20260811 08:12:35.831460 25310 tablet_service.cc:1514] Processing DeleteTablet for tablet d631cb8122ed4b568c57ad36f79a4691 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:12:35 UTC) from {username='kudu', principal='kudu/127.27.243.254@KRBTEST.COM'} at 127.0.0.1:37402
I20260811 08:12:35.831460 25081 tablet_service.cc:1514] Processing DeleteTablet for tablet d631cb8122ed4b568c57ad36f79a4691 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:12:35 UTC) from {username='kudu', principal='kudu/127.27.243.254@KRBTEST.COM'} at 127.0.0.1:34772
I20260811 08:12:35.831689 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 24972
I20260811 08:12:35.831761 25549 tablet_service.cc:1514] Processing DeleteTablet for tablet d631cb8122ed4b568c57ad36f79a4691 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:12:35 UTC) from {username='kudu', principal='kudu/127.27.243.254@KRBTEST.COM'} at 127.0.0.1:35124
I20260811 08:12:35.832171 25752 tablet_replica.cc:330] T d631cb8122ed4b568c57ad36f79a4691 P 923a2bbe60274971aa6b00b4d5347fc8: stopping tablet replica
I20260811 08:12:35.832250 25752 raft_consensus.cc:2229] T d631cb8122ed4b568c57ad36f79a4691 P 923a2bbe60274971aa6b00b4d5347fc8 [term 1 LEADER]: Raft consensus shutting down.
I20260811 08:12:35.832319 25752 raft_consensus.cc:2258] T d631cb8122ed4b568c57ad36f79a4691 P 923a2bbe60274971aa6b00b4d5347fc8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:12:35.837998 25753 tablet_replica.cc:330] T d631cb8122ed4b568c57ad36f79a4691 P 36f4022cb2604c16873ae1a550630067: stopping tablet replica
I20260811 08:12:35.838167 25752 ts_tablet_manager.cc:1905] T d631cb8122ed4b568c57ad36f79a4691 P 923a2bbe60274971aa6b00b4d5347fc8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:12:35.838191 25753 raft_consensus.cc:2229] T d631cb8122ed4b568c57ad36f79a4691 P 36f4022cb2604c16873ae1a550630067 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:12:35.838433 25753 raft_consensus.cc:2258] T d631cb8122ed4b568c57ad36f79a4691 P 36f4022cb2604c16873ae1a550630067 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:12:35.839462 25753 ts_tablet_manager.cc:1905] T d631cb8122ed4b568c57ad36f79a4691 P 36f4022cb2604c16873ae1a550630067: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:12:35.840528 25752 ts_tablet_manager.cc:1918] T d631cb8122ed4b568c57ad36f79a4691 P 923a2bbe60274971aa6b00b4d5347fc8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:12:35.840607 25752 log.cc:1196] T d631cb8122ed4b568c57ad36f79a4691 P 923a2bbe60274971aa6b00b4d5347fc8: Deleting WAL directory at /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435717191469-28623-0/minicluster-data/ts-1/wal/wals/d631cb8122ed4b568c57ad36f79a4691
I20260811 08:12:35.840895 25752 ts_tablet_manager.cc:1939] T d631cb8122ed4b568c57ad36f79a4691 P 923a2bbe60274971aa6b00b4d5347fc8: Deleting consensus metadata
I20260811 08:12:35.841325 24849 catalog_manager.cc:4841] TS 923a2bbe60274971aa6b00b4d5347fc8 (127.27.243.194:41393): tablet d631cb8122ed4b568c57ad36f79a4691 (table test-table [id=5de8bac873744b0987ece27a2a69afc0]) successfully deleted
I20260811 08:12:35.841940 25753 ts_tablet_manager.cc:1918] T d631cb8122ed4b568c57ad36f79a4691 P 36f4022cb2604c16873ae1a550630067: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:12:35.842077 25753 log.cc:1196] T d631cb8122ed4b568c57ad36f79a4691 P 36f4022cb2604c16873ae1a550630067: Deleting WAL directory at /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435717191469-28623-0/minicluster-data/ts-2/wal/wals/d631cb8122ed4b568c57ad36f79a4691
I20260811 08:12:35.842388 25753 ts_tablet_manager.cc:1939] T d631cb8122ed4b568c57ad36f79a4691 P 36f4022cb2604c16873ae1a550630067: Deleting consensus metadata
I20260811 08:12:35.844537 24848 catalog_manager.cc:4841] TS 36f4022cb2604c16873ae1a550630067 (127.27.243.195:37273): tablet d631cb8122ed4b568c57ad36f79a4691 (table test-table [id=5de8bac873744b0987ece27a2a69afc0]) successfully deleted
W20260811 08:12:35.856911 24851 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.27.243.193:36191 (error 108)
I20260811 08:12:35.857025 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 25200
I20260811 08:12:35.860957 25690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:35.860814 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.193:36191 (local address 127.0.0.1:34782)
0811 08:12:35.860878 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0811 08:12:35.860917 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.193:36191: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260811 08:12:35.861080 24851 catalog_manager.cc:4584] TS 5a5059dd0ac142fc90dd2a1eb296313d (127.27.243.193:36191): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet d631cb8122ed4b568c57ad36f79a4691: Network error: Client connection negotiation failed: client connection to 127.27.243.193:36191: connect: Connection refused (error 111)
I20260811 08:12:35.875901 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 25433
I20260811 08:12:35.884996 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 24817
2026-08-11T08:12:35Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (2194 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-11T08:12:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:12:35Z Disabled control of system clock
I20260811 08:12:35.918074 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435717191469-28623-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435717191469-28623-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435717191469-28623-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.243.254:44281
--webserver_interface=127.27.243.254
--webserver_port=0
--builtin_ntp_servers=127.27.243.212:46463
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.243.254:44281
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 08:12:36.019640 25767 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:12:36.019861 25767 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:12:36.019881 25767 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:12:36.020969 25767 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:12:36.021000 25767 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:12:36.021013 25767 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:12:36.021023 25767 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:12:36.021034 25767 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:12:36.022356 25767 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:46463
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435717191469-28623-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435717191469-28623-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.243.254:44281
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.243.254:44281
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.243.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25767
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435717191469-28623-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:12:36.022562 25767 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:12:36.022799 25767 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:12:36.027267 25776 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:12:36.027294 25774 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:12:36.027297 25773 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:12:36.027362 25767 server_base.cc:1034] running on GCE node
I20260811 08:12:36.027657 25767 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:12:36.027935 25767 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:12:36.029073 25767 hybrid_clock.cc:648] HybridClock initialized: now 1786435956029054 us; error 32 us; skew 500 ppm
I20260811 08:12:36.030284 25767 webserver.cc:460] Webserver started at http://127.27.243.254:34667/ using document root <none> and password file <none>
I20260811 08:12:36.030515 25767 fs_manager.cc:359] Metadata directory not provided
I20260811 08:12:36.030576 25767 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:12:36.030701 25767 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:12:36.031713 25767 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435717191469-28623-0/minicluster-data/master-0/data/instance:
uuid: "c1badb26e1f6468cbc6592786ed2ce11"
format_stamp: "Formatted at 2026-08-11 08:12:36 on dist-test-slave-7lbf"
server_key: "ebc4d22350cb3fe1b0af1c5e91edce07"
server_key_iv: "713c3d6a45fbbe739219c77d77386e98"
server_key_version: "encryptionkey@0"
I20260811 08:12:36.032051 25767 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435717191469-28623-0/minicluster-data/master-0/wal/instance:
uuid: "c1badb26e1f6468cbc6592786ed2ce11"
format_stamp: "Formatted at 2026-08-11 08:12:36 on dist-test-slave-7lbf"
server_key: "ebc4d22350cb3fe1b0af1c5e91edce07"
server_key_iv: "713c3d6a45fbbe739219c77d77386e98"
server_key_version: "encryptionkey@0"
I20260811 08:12:36.033202 25767 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 08:12:36.033885 25785 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:12:36.034044 25767 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 08:12:36.034128 25767 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435717191469-28623-0/minicluster-data/master-0/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435717191469-28623-0/minicluster-data/master-0/wal
uuid: "c1badb26e1f6468cbc6592786ed2ce11"
format_stamp: "Formatted at 2026-08-11 08:12:36 on dist-test-slave-7lbf"
server_key: "ebc4d22350cb3fe1b0af1c5e91edce07"
server_key_iv: "713c3d6a45fbbe739219c77d77386e98"
server_key_version: "encryptionkey@0"
I20260811 08:12:36.034186 25767 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435717191469-28623-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435717191469-28623-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435717191469-28623-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:12:36.061995 25767 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:12:36.062302 25767 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:12:36.062443 25767 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:12:36.066190 25767 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.254:44281
I20260811 08:12:36.066226 25880 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.254:44281 every 8 connection(s)
I20260811 08:12:36.066543 25767 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
I20260811 08:12:36.067495 25881 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:12:36.069749 25881 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c1badb26e1f6468cbc6592786ed2ce11: Bootstrap starting.
I20260811 08:12:36.070314 25881 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c1badb26e1f6468cbc6592786ed2ce11: Neither blocks nor log segments found. Creating new log.
I20260811 08:12:36.070605 25881 log.cc:824] T 00000000000000000000000000000000 P c1badb26e1f6468cbc6592786ed2ce11: Log is configured to *not* fsync() on all Append() calls
I20260811 08:12:36.071221 25881 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c1badb26e1f6468cbc6592786ed2ce11: No bootstrap required, opened a new log
I20260811 08:12:36.072760 25881 raft_consensus.cc:348] T 00000000000000000000000000000000 P c1badb26e1f6468cbc6592786ed2ce11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1badb26e1f6468cbc6592786ed2ce11" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 44281 } }
I20260811 08:12:36.072896 25881 raft_consensus.cc:374] T 00000000000000000000000000000000 P c1badb26e1f6468cbc6592786ed2ce11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:12:36.072917 25881 raft_consensus.cc:729] T 00000000000000000000000000000000 P c1badb26e1f6468cbc6592786ed2ce11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1badb26e1f6468cbc6592786ed2ce11, State: Initialized, Role: FOLLOWER
I20260811 08:12:36.073030 25881 consensus_queue.cc:260] T 00000000000000000000000000000000 P c1badb26e1f6468cbc6592786ed2ce11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1badb26e1f6468cbc6592786ed2ce11" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 44281 } }
I20260811 08:12:36.073105 25881 raft_consensus.cc:388] T 00000000000000000000000000000000 P c1badb26e1f6468cbc6592786ed2ce11 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:12:36.073140 25881 raft_consensus.cc:482] T 00000000000000000000000000000000 P c1badb26e1f6468cbc6592786ed2ce11 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:12:36.073172 25881 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c1badb26e1f6468cbc6592786ed2ce11 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:12:36.073693 25881 raft_consensus.cc:504] T 00000000000000000000000000000000 P c1badb26e1f6468cbc6592786ed2ce11 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1badb26e1f6468cbc6592786ed2ce11" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 44281 } }
I20260811 08:12:36.073781 25881 leader_election.cc:302] T 00000000000000000000000000000000 P c1badb26e1f6468cbc6592786ed2ce11 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c1badb26e1f6468cbc6592786ed2ce11; no voters:
I20260811 08:12:36.073917 25881 leader_election.cc:288] T 00000000000000000000000000000000 P c1badb26e1f6468cbc6592786ed2ce11 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:12:36.074000 25885 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c1badb26e1f6468cbc6592786ed2ce11 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:12:36.074179 25885 raft_consensus.cc:686] T 00000000000000000000000000000000 P c1badb26e1f6468cbc6592786ed2ce11 [term 1 LEADER]: Becoming Leader. State: Replica: c1badb26e1f6468cbc6592786ed2ce11, State: Running, Role: LEADER
I20260811 08:12:36.074208 25881 sys_catalog.cc:564] T 00000000000000000000000000000000 P c1badb26e1f6468cbc6592786ed2ce11 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:12:36.074277 25885 consensus_queue.cc:237] T 00000000000000000000000000000000 P c1badb26e1f6468cbc6592786ed2ce11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1badb26e1f6468cbc6592786ed2ce11" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 44281 } }
I20260811 08:12:36.074687 25892 sys_catalog.cc:455] T 00000000000000000000000000000000 P c1badb26e1f6468cbc6592786ed2ce11 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c1badb26e1f6468cbc6592786ed2ce11. Latest consensus state: current_term: 1 leader_uuid: "c1badb26e1f6468cbc6592786ed2ce11" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1badb26e1f6468cbc6592786ed2ce11" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 44281 } } }
I20260811 08:12:36.074812 25892 sys_catalog.cc:458] T 00000000000000000000000000000000 P c1badb26e1f6468cbc6592786ed2ce11 [sys.catalog]: This master's current role is: LEADER
I20260811 08:12:36.074747 25886 sys_catalog.cc:455] T 00000000000000000000000000000000 P c1badb26e1f6468cbc6592786ed2ce11 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c1badb26e1f6468cbc6592786ed2ce11" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1badb26e1f6468cbc6592786ed2ce11" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 44281 } } }
I20260811 08:12:36.074996 25886 sys_catalog.cc:458] T 00000000000000000000000000000000 P c1badb26e1f6468cbc6592786ed2ce11 [sys.catalog]: This master's current role is: LEADER
I20260811 08:12:36.075366 25905 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:12:36.075861 25905 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:12:36.076779 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 25767
I20260811 08:12:36.076891 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435717191469-28623-0/minicluster-data/master-0/wal/instance
I20260811 08:12:36.077101 28623 external_mini_cluster.cc:1428] Setting key c1eef8097ae115cb9a853674bbc7e42d
I20260811 08:12:36.077383 25905 catalog_manager.cc:1347] Generated new cluster ID: ffd8a7562d2141b3ae5ddaa2ca125f05
I20260811 08:12:36.077431 25905 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:12:36.083009 25924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:36.077786 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52350 (local address 127.27.243.254:44281)
0811 08:12:36.077957 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0811 08:12:36.077966 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 08:12:36.077995 (+ 29us) server_negotiation.cc:407] Connection header received
0811 08:12:36.078103 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:12:36.078110 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:12:36.078183 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:12:36.078298 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:12:36.078542 (+ 244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:36.079885 (+ 1343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:36.080959 (+ 1074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:36.081595 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:36.082005 (+ 410us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:36.082337 (+ 332us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:12:36.082340 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:12:36.082340 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:12:36.082538 (+ 198us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:12:36.082575 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:12:36.082588 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:12:36.082646 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 08:12:36.082747 (+ 101us) server_negotiation.cc:299] Negotiation successful
0811 08:12:36.082819 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":105,"thread_start_us":72,"threads_started":1}
I20260811 08:12:36.087198 25905 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:12:36.087848 25905 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:12:36.096679 25905 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c1badb26e1f6468cbc6592786ed2ce11: Generated new TSK 0
I20260811 08:12:36.096902 25905 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 08:12:36.098932 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435717191469-28623-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435717191469-28623-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435717191469-28623-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435717191469-28623-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.243.193:0
--local_ip_for_outbound_sockets=127.27.243.193
--webserver_interface=127.27.243.193
--webserver_port=0
--tserver_master_addrs=127.27.243.254:44281
--builtin_ntp_servers=127.27.243.212:46463
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 08:12:36.185250 25926 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:12:36.185437 25926 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:12:36.185457 25926 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:12:36.186585 25926 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:12:36.186625 25926 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:12:36.186648 25926 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.243.193
I20260811 08:12:36.187949 25926 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:46463
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435717191469-28623-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435717191469-28623-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.243.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435717191469-28623-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.243.193
--webserver_port=0
--tserver_master_addrs=127.27.243.254:44281
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25926
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.243.193
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435717191469-28623-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:12:36.188163 25926 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:12:36.188441 25926 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:12:36.193056 25940 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:12:36.193066 25942 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:12:36.193068 25946 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:12:36.193477 25926 server_base.cc:1034] running on GCE node
I20260811 08:12:36.193692 25926 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:12:36.193908 25926 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:12:36.195046 25926 hybrid_clock.cc:648] HybridClock initialized: now 1786435956195031 us; error 30 us; skew 500 ppm
I20260811 08:12:36.196224 25926 webserver.cc:460] Webserver started at http://127.27.243.193:45981/ using document root <none> and password file <none>
I20260811 08:12:36.196458 25926 fs_manager.cc:359] Metadata directory not provided
I20260811 08:12:36.196508 25926 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:12:36.196631 25926 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:12:36.197685 25926 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435717191469-28623-0/minicluster-data/ts-0/data/instance:
uuid: "b11177163a66441a8a48aff4d3d717ae"
format_stamp: "Formatted at 2026-08-11 08:12:36 on dist-test-slave-7lbf"
server_key: "b1879468fa37219aa239a326f63f1c3a"
server_key_iv: "ce9f206627c05e6677c8c9ecdf09827b"
server_key_version: "encryptionkey@0"
I20260811 08:12:36.198015 25926 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435717191469-28623-0/minicluster-data/ts-0/wal/instance:
uuid: "b11177163a66441a8a48aff4d3d717ae"
format_stamp: "Formatted at 2026-08-11 08:12:36 on dist-test-slave-7lbf"
server_key: "b1879468fa37219aa239a326f63f1c3a"
server_key_iv: "ce9f206627c05e6677c8c9ecdf09827b"
server_key_version: "encryptionkey@0"
I20260811 08:12:36.199208 25926 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:12:36.199877 25953 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:12:36.200063 25926 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 08:12:36.200163 25926 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435717191469-28623-0/minicluster-data/ts-0/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435717191469-28623-0/minicluster-data/ts-0/wal
uuid: "b11177163a66441a8a48aff4d3d717ae"
format_stamp: "Formatted at 2026-08-11 08:12:36 on dist-test-slave-7lbf"
server_key: "b1879468fa37219aa239a326f63f1c3a"
server_key_iv: "ce9f206627c05e6677c8c9ecdf09827b"
server_key_version: "encryptionkey@0"
I20260811 08:12:36.200242 25926 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435717191469-28623-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435717191469-28623-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435717191469-28623-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:12:36.216166 25926 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:12:36.216410 25926 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:12:36.216509 25926 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:12:36.216674 25926 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:12:36.216984 25926 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:12:36.217020 25926 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:12:36.217048 25926 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:12:36.217072 25926 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:12:36.222492 25926 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.193:42461
I20260811 08:12:36.222533 26140 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.193:42461 every 8 connection(s)
I20260811 08:12:36.222846 25926 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435717191469-28623-0/minicluster-data/ts-0/data/info.pb
I20260811 08:12:36.225026 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 25926
I20260811 08:12:36.225121 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435717191469-28623-0/minicluster-data/ts-0/wal/instance
I20260811 08:12:36.225314 28623 external_mini_cluster.cc:1428] Setting key 9badbe42d01d0bb08813890cdc153610
I20260811 08:12:36.226214 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435717191469-28623-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435717191469-28623-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435717191469-28623-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435717191469-28623-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.243.194:0
--local_ip_for_outbound_sockets=127.27.243.194
--webserver_interface=127.27.243.194
--webserver_port=0
--tserver_master_addrs=127.27.243.254:44281
--builtin_ntp_servers=127.27.243.212:46463
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 08:12:36.228145 25924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:36.223547 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.193:39165 (local address 127.27.243.254:44281)
0811 08:12:36.223609 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0811 08:12:36.223610 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 08:12:36.223831 (+ 221us) server_negotiation.cc:407] Connection header received
0811 08:12:36.224426 (+ 595us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:12:36.224427 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:12:36.224442 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:12:36.224494 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:12:36.225175 (+ 681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:36.225753 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:36.226831 (+ 1078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:36.227035 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:36.227093 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:36.227894 (+ 801us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:12:36.227895 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:12:36.227896 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:12:36.227900 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:12:36.227917 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:12:36.227921 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:12:36.227975 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 08:12:36.228040 (+ 65us) server_negotiation.cc:299] Negotiation successful
0811 08:12:36.228070 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260811 08:12:36.228298 26146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:36.223527 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:44281 (local address 127.27.243.193:39165)
0811 08:12:36.223717 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0811 08:12:36.223751 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0811 08:12:36.224307 (+ 556us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:12:36.224562 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:12:36.224565 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:12:36.224573 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:12:36.225065 (+ 492us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:12:36.225069 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:12:36.225848 (+ 779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:12:36.225848 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:12:36.226751 (+ 903us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:12:36.226754 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:12:36.227108 (+ 354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:12:36.227109 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:12:36.227229 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:36.227731 (+ 502us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 08:12:36.227732 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:12:36.227774 (+ 42us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 08:12:36.227811 (+ 37us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:12:36.227981 (+ 170us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:12:36.227984 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:12:36.227986 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 08:12:36.228031 (+ 45us) client_negotiation.cc:240] Negotiation successful
0811 08:12:36.228115 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":90,"threads_started":1}
I20260811 08:12:36.228708 26141 heartbeater.cc:347] Connected to a master server at 127.27.243.254:44281
I20260811 08:12:36.228796 26141 heartbeater.cc:464] Registering TS with master...
I20260811 08:12:36.228976 26141 heartbeater.cc:511] Master 127.27.243.254:44281 requested a full tablet report, sending...
I20260811 08:12:36.229465 25819 ts_manager.cc:194] Registered new tserver with Master: b11177163a66441a8a48aff4d3d717ae (127.27.243.193:42461)
I20260811 08:12:36.230074 25819 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.27.243.193:39165
W20260811 08:12:36.307925 26151 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:12:36.308127 26151 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:12:36.308156 26151 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:12:36.309252 26151 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:12:36.309289 26151 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:12:36.309322 26151 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.243.194
I20260811 08:12:36.310693 26151 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:46463
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435717191469-28623-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435717191469-28623-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.243.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435717191469-28623-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.243.194
--webserver_port=0
--tserver_master_addrs=127.27.243.254:44281
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26151
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.243.194
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435717191469-28623-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:12:36.310928 26151 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:12:36.311198 26151 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:12:36.315950 26158 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:12:36.315992 26162 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:12:36.316113 26151 server_base.cc:1034] running on GCE node
W20260811 08:12:36.315961 26166 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:12:36.316358 26151 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:12:36.316581 26151 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:12:36.317718 26151 hybrid_clock.cc:648] HybridClock initialized: now 1786435956317703 us; error 29 us; skew 500 ppm
I20260811 08:12:36.318933 26151 webserver.cc:460] Webserver started at http://127.27.243.194:34259/ using document root <none> and password file <none>
I20260811 08:12:36.319134 26151 fs_manager.cc:359] Metadata directory not provided
I20260811 08:12:36.319178 26151 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:12:36.319298 26151 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:12:36.320302 26151 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435717191469-28623-0/minicluster-data/ts-1/data/instance:
uuid: "21480547c48e4c5fb6a0d4f0345a1802"
format_stamp: "Formatted at 2026-08-11 08:12:36 on dist-test-slave-7lbf"
server_key: "29dae0fb17cf119d0922b24ad64b6ece"
server_key_iv: "ffc9f5aa80fde7d90cfcfd22cd4b9d0c"
server_key_version: "encryptionkey@0"
I20260811 08:12:36.320624 26151 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435717191469-28623-0/minicluster-data/ts-1/wal/instance:
uuid: "21480547c48e4c5fb6a0d4f0345a1802"
format_stamp: "Formatted at 2026-08-11 08:12:36 on dist-test-slave-7lbf"
server_key: "29dae0fb17cf119d0922b24ad64b6ece"
server_key_iv: "ffc9f5aa80fde7d90cfcfd22cd4b9d0c"
server_key_version: "encryptionkey@0"
I20260811 08:12:36.321903 26151 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 08:12:36.322556 26177 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:12:36.322687 26151 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 08:12:36.322768 26151 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435717191469-28623-0/minicluster-data/ts-1/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435717191469-28623-0/minicluster-data/ts-1/wal
uuid: "21480547c48e4c5fb6a0d4f0345a1802"
format_stamp: "Formatted at 2026-08-11 08:12:36 on dist-test-slave-7lbf"
server_key: "29dae0fb17cf119d0922b24ad64b6ece"
server_key_iv: "ffc9f5aa80fde7d90cfcfd22cd4b9d0c"
server_key_version: "encryptionkey@0"
I20260811 08:12:36.322841 26151 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435717191469-28623-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435717191469-28623-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435717191469-28623-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:12:36.329787 26151 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:12:36.330037 26151 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:12:36.330156 26151 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:12:36.330345 26151 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:12:36.330644 26151 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:12:36.330678 26151 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:12:36.330703 26151 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:12:36.330729 26151 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:12:36.336413 26151 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.194:43337
I20260811 08:12:36.336475 26381 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.194:43337 every 8 connection(s)
I20260811 08:12:36.336760 26151 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435717191469-28623-0/minicluster-data/ts-1/data/info.pb
I20260811 08:12:36.341636 25924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:36.337484 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.194:39825 (local address 127.27.243.254:44281)
0811 08:12:36.337566 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0811 08:12:36.337568 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:12:36.337768 (+ 200us) server_negotiation.cc:407] Connection header received
0811 08:12:36.338256 (+ 488us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:12:36.338257 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:12:36.338267 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:12:36.338317 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:12:36.338932 (+ 615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:36.339417 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:36.340408 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:36.340601 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:36.340653 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:36.341409 (+ 756us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:12:36.341410 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:12:36.341410 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:12:36.341413 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:12:36.341424 (+ 11us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:12:36.341427 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:12:36.341456 (+ 29us) server_negotiation.cc:1035] Waiting for connection context
0811 08:12:36.341541 (+ 85us) server_negotiation.cc:299] Negotiation successful
0811 08:12:36.341565 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 08:12:36.341845 26384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:36.337458 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:44281 (local address 127.27.243.194:39825)
0811 08:12:36.337649 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0811 08:12:36.337687 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 08:12:36.338178 (+ 491us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:12:36.338377 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:12:36.338380 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:12:36.338388 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:12:36.338873 (+ 485us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:12:36.338877 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:12:36.339512 (+ 635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:12:36.339513 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:12:36.340324 (+ 811us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:12:36.340327 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:12:36.340662 (+ 335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:12:36.340663 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:12:36.340767 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:36.341295 (+ 528us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 08:12:36.341295 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:12:36.341324 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 08:12:36.341348 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:12:36.341465 (+ 117us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:12:36.341467 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:12:36.341469 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 08:12:36.341509 (+ 40us) client_negotiation.cc:240] Negotiation successful
0811 08:12:36.341640 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":94,"threads_started":1}
I20260811 08:12:36.342163 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 26151
I20260811 08:12:36.342267 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435717191469-28623-0/minicluster-data/ts-1/wal/instance
I20260811 08:12:36.342326 26382 heartbeater.cc:347] Connected to a master server at 127.27.243.254:44281
I20260811 08:12:36.342417 26382 heartbeater.cc:464] Registering TS with master...
I20260811 08:12:36.342495 28623 external_mini_cluster.cc:1428] Setting key 03f0cad13de53bb723089860fc6144e4
I20260811 08:12:36.342600 26382 heartbeater.cc:511] Master 127.27.243.254:44281 requested a full tablet report, sending...
I20260811 08:12:36.342973 25818 ts_manager.cc:194] Registered new tserver with Master: 21480547c48e4c5fb6a0d4f0345a1802 (127.27.243.194:43337)
I20260811 08:12:36.343326 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435717191469-28623-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435717191469-28623-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435717191469-28623-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435717191469-28623-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.243.195:0
--local_ip_for_outbound_sockets=127.27.243.195
--webserver_interface=127.27.243.195
--webserver_port=0
--tserver_master_addrs=127.27.243.254:44281
--builtin_ntp_servers=127.27.243.212:46463
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 08:12:36.343321 25818 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.27.243.194:39825
W20260811 08:12:36.424203 26385 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:12:36.424405 26385 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:12:36.424433 26385 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:12:36.425580 26385 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:12:36.425617 26385 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:12:36.425648 26385 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.243.195
I20260811 08:12:36.426987 26385 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:46463
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435717191469-28623-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435717191469-28623-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.243.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435717191469-28623-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.243.195
--webserver_port=0
--tserver_master_addrs=127.27.243.254:44281
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26385
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.243.195
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435717191469-28623-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:12:36.427218 26385 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:12:36.427484 26385 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:12:36.432252 26401 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:12:36.432386 26398 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:12:36.432416 26385 server_base.cc:1034] running on GCE node
W20260811 08:12:36.432260 26399 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:12:36.432660 26385 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:12:36.432895 26385 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:12:36.434031 26385 hybrid_clock.cc:648] HybridClock initialized: now 1786435956434014 us; error 41 us; skew 500 ppm
I20260811 08:12:36.435199 26385 webserver.cc:460] Webserver started at http://127.27.243.195:34635/ using document root <none> and password file <none>
I20260811 08:12:36.435436 26385 fs_manager.cc:359] Metadata directory not provided
I20260811 08:12:36.435482 26385 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:12:36.435586 26385 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:12:36.436625 26385 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435717191469-28623-0/minicluster-data/ts-2/data/instance:
uuid: "0b6de141ca4a4a10b9bb67d1155a2b8b"
format_stamp: "Formatted at 2026-08-11 08:12:36 on dist-test-slave-7lbf"
server_key: "1d3899193731acdac1b1362fc5709388"
server_key_iv: "3449759d765d0022b7666c0224acae24"
server_key_version: "encryptionkey@0"
I20260811 08:12:36.436926 26385 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435717191469-28623-0/minicluster-data/ts-2/wal/instance:
uuid: "0b6de141ca4a4a10b9bb67d1155a2b8b"
format_stamp: "Formatted at 2026-08-11 08:12:36 on dist-test-slave-7lbf"
server_key: "1d3899193731acdac1b1362fc5709388"
server_key_iv: "3449759d765d0022b7666c0224acae24"
server_key_version: "encryptionkey@0"
I20260811 08:12:36.438227 26385 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 08:12:36.438925 26416 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:12:36.439059 26385 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 08:12:36.439142 26385 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435717191469-28623-0/minicluster-data/ts-2/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435717191469-28623-0/minicluster-data/ts-2/wal
uuid: "0b6de141ca4a4a10b9bb67d1155a2b8b"
format_stamp: "Formatted at 2026-08-11 08:12:36 on dist-test-slave-7lbf"
server_key: "1d3899193731acdac1b1362fc5709388"
server_key_iv: "3449759d765d0022b7666c0224acae24"
server_key_version: "encryptionkey@0"
I20260811 08:12:36.439203 26385 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435717191469-28623-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435717191469-28623-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435717191469-28623-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:12:36.461076 26385 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:12:36.461371 26385 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:12:36.461503 26385 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:12:36.461756 26385 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:12:36.462074 26385 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:12:36.462108 26385 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:12:36.462137 26385 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:12:36.462154 26385 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:12:36.467842 26385 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.195:43525
I20260811 08:12:36.467882 26622 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.195:43525 every 8 connection(s)
I20260811 08:12:36.468209 26385 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435717191469-28623-0/minicluster-data/ts-2/data/info.pb
I20260811 08:12:36.468773 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 26385
I20260811 08:12:36.468870 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435717191469-28623-0/minicluster-data/ts-2/wal/instance
I20260811 08:12:36.469095 28623 external_mini_cluster.cc:1428] Setting key 3712b3331d1b86f0eb9b1c05ef5ab9a2
I20260811 08:12:36.473443 25924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:36.468927 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.195:40195 (local address 127.27.243.254:44281)
0811 08:12:36.468988 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0811 08:12:36.468991 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:12:36.469292 (+ 301us) server_negotiation.cc:407] Connection header received
0811 08:12:36.469893 (+ 601us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:12:36.469894 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:12:36.469905 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:12:36.469966 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:12:36.470668 (+ 702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:36.471202 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:36.472193 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:36.472397 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:36.472451 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:36.473190 (+ 739us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:12:36.473192 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:12:36.473192 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:12:36.473196 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:12:36.473210 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:12:36.473215 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:12:36.473265 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0811 08:12:36.473358 (+ 93us) server_negotiation.cc:299] Negotiation successful
0811 08:12:36.473385 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 08:12:36.473678 26628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:36.468957 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:44281 (local address 127.27.243.195:40195)
0811 08:12:36.469154 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0811 08:12:36.469197 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 08:12:36.469806 (+ 609us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:12:36.470036 (+ 230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:12:36.470041 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:12:36.470051 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:12:36.470568 (+ 517us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:12:36.470573 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:12:36.471284 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:12:36.471284 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:12:36.472114 (+ 830us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:12:36.472117 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:12:36.472469 (+ 352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:12:36.472470 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:12:36.472584 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:36.473042 (+ 458us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 08:12:36.473042 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:12:36.473071 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 08:12:36.473094 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:12:36.473278 (+ 184us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:12:36.473283 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:12:36.473285 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 08:12:36.473360 (+ 75us) client_negotiation.cc:240] Negotiation successful
0811 08:12:36.473447 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":80,"threads_started":1}
I20260811 08:12:36.474092 26624 heartbeater.cc:347] Connected to a master server at 127.27.243.254:44281
I20260811 08:12:36.474206 26624 heartbeater.cc:464] Registering TS with master...
I20260811 08:12:36.474359 26624 heartbeater.cc:511] Master 127.27.243.254:44281 requested a full tablet report, sending...
I20260811 08:12:36.474675 25818 ts_manager.cc:194] Registered new tserver with Master: 0b6de141ca4a4a10b9bb67d1155a2b8b (127.27.243.195:43525)
I20260811 08:12:36.475034 25818 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.27.243.195:40195
I20260811 08:12:36.480790 28623 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 08:12:36.485011 25924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:36.482214 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52354 (local address 127.27.243.254:44281)
0811 08:12:36.482298 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0811 08:12:36.482300 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:12:36.482406 (+ 106us) server_negotiation.cc:407] Connection header received
0811 08:12:36.482469 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:12:36.482470 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:12:36.482481 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:12:36.482523 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:12:36.482674 (+ 151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:36.483179 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:36.483919 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:36.484104 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:36.484157 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:36.484784 (+ 627us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:12:36.484786 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:12:36.484786 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:12:36.484790 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:12:36.484804 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:12:36.484808 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:12:36.484861 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 08:12:36.484912 (+ 51us) server_negotiation.cc:299] Negotiation successful
0811 08:12:36.484937 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260811 08:12:36.486672 25818 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52354:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 08:12:36.488272 25818 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 08:12:36.494665 26640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:36.490515 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.194:43337 (local address 127.0.0.1:58530)
0811 08:12:36.491071 (+ 556us) negotiation.cc:107] Waiting for socket to connect
0811 08:12:36.491086 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 08:12:36.491139 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:12:36.491417 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:12:36.491418 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:12:36.491421 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:12:36.491470 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:12:36.491472 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:12:36.492387 (+ 915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:12:36.492388 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:12:36.493605 (+ 1217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:12:36.493608 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:12:36.494361 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:12:36.494362 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:12:36.494442 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:36.494456 (+ 14us) client_negotiation.cc:769] Sending connection context
0811 08:12:36.494533 (+ 77us) client_negotiation.cc:240] Negotiation successful
0811 08:12:36.494588 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":542,"thread_start_us":100,"threads_started":1}
I20260811 08:12:36.494679 26643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:36.490650 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58530 (local address 127.27.243.194:43337)
0811 08:12:36.490978 (+ 328us) server_negotiation.cc:206] Beginning negotiation
0811 08:12:36.490982 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 08:12:36.491201 (+ 219us) server_negotiation.cc:407] Connection header received
0811 08:12:36.491251 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:12:36.491253 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:12:36.491269 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:12:36.491344 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:12:36.491586 (+ 242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:36.492299 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:36.493714 (+ 1415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:36.494264 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:36.494353 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:36.494448 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0811 08:12:36.494549 (+ 101us) server_negotiation.cc:299] Negotiation successful
0811 08:12:36.494592 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":288,"thread_start_us":84,"threads_started":1}
I20260811 08:12:36.494823 26645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:36.490780 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57576 (local address 127.27.243.195:43525)
0811 08:12:36.490943 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0811 08:12:36.490948 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 08:12:36.491146 (+ 198us) server_negotiation.cc:407] Connection header received
0811 08:12:36.491268 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:12:36.491270 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:12:36.491300 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:12:36.491352 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:12:36.491548 (+ 196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:36.492597 (+ 1049us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:36.493694 (+ 1097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:36.494358 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:36.494431 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:36.494513 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0811 08:12:36.494699 (+ 186us) server_negotiation.cc:299] Negotiation successful
0811 08:12:36.494741 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126,"thread_start_us":83,"threads_started":1}
I20260811 08:12:36.495051 26646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:36.490864 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51612 (local address 127.27.243.193:42461)
0811 08:12:36.491049 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0811 08:12:36.491053 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 08:12:36.491062 (+ 9us) server_negotiation.cc:407] Connection header received
0811 08:12:36.491125 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:12:36.491127 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:12:36.491143 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:12:36.491213 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:12:36.491426 (+ 213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:36.492572 (+ 1146us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:36.493877 (+ 1305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:36.494580 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:36.494643 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:36.494723 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 08:12:36.494920 (+ 197us) server_negotiation.cc:299] Negotiation successful
0811 08:12:36.494966 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":147,"thread_start_us":112,"threads_started":1}
I20260811 08:12:36.495023 26642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:36.490513 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.193:42461 (local address 127.0.0.1:51612)
0811 08:12:36.490845 (+ 332us) negotiation.cc:107] Waiting for socket to connect
0811 08:12:36.490887 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 08:12:36.490963 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:12:36.491293 (+ 330us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:12:36.491297 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:12:36.491299 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:12:36.491362 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:12:36.491364 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:12:36.492672 (+ 1308us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:12:36.492673 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:12:36.493795 (+ 1122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:12:36.493797 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:12:36.494754 (+ 957us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:12:36.494755 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:12:36.494814 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:36.494818 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 08:12:36.494886 (+ 68us) client_negotiation.cc:240] Negotiation successful
0811 08:12:36.494928 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":296,"mutex_wait_us":24,"thread_start_us":123,"threads_started":1}
I20260811 08:12:36.495072 26641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:36.490515 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.195:43525 (local address 127.0.0.1:57576)
0811 08:12:36.491074 (+ 559us) negotiation.cc:107] Waiting for socket to connect
0811 08:12:36.491084 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 08:12:36.491173 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:12:36.491436 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:12:36.491437 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:12:36.491439 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:12:36.491471 (+ 32us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:12:36.491472 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:12:36.492680 (+ 1208us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:12:36.492681 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:12:36.493612 (+ 931us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:12:36.493615 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:12:36.494551 (+ 936us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:12:36.494552 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:12:36.494607 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:36.494611 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 08:12:36.494938 (+ 327us) client_negotiation.cc:240] Negotiation successful
0811 08:12:36.494973 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":546,"mutex_wait_us":22,"thread_start_us":105,"threads_started":1}
I20260811 08:12:36.495934 26267 tablet_service.cc:1467] Processing CreateTablet for tablet 5563e10590974ba08a77905792df24bb (DEFAULT_TABLE table=test-table [id=f660003ecca7489a8cbeba95ee6b7c4f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:12:36.495934 26027 tablet_service.cc:1467] Processing CreateTablet for tablet 5563e10590974ba08a77905792df24bb (DEFAULT_TABLE table=test-table [id=f660003ecca7489a8cbeba95ee6b7c4f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:12:36.496323 26267 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5563e10590974ba08a77905792df24bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:12:36.496323 26027 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5563e10590974ba08a77905792df24bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:12:36.499854 26647 tablet_bootstrap.cc:492] T 5563e10590974ba08a77905792df24bb P 21480547c48e4c5fb6a0d4f0345a1802: Bootstrap starting.
I20260811 08:12:36.500299 26500 tablet_service.cc:1467] Processing CreateTablet for tablet 5563e10590974ba08a77905792df24bb (DEFAULT_TABLE table=test-table [id=f660003ecca7489a8cbeba95ee6b7c4f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:12:36.500505 26647 tablet_bootstrap.cc:654] T 5563e10590974ba08a77905792df24bb P 21480547c48e4c5fb6a0d4f0345a1802: Neither blocks nor log segments found. Creating new log.
I20260811 08:12:36.500625 26500 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5563e10590974ba08a77905792df24bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:12:36.500792 26647 log.cc:824] T 5563e10590974ba08a77905792df24bb P 21480547c48e4c5fb6a0d4f0345a1802: Log is configured to *not* fsync() on all Append() calls
I20260811 08:12:36.501097 26648 tablet_bootstrap.cc:492] T 5563e10590974ba08a77905792df24bb P b11177163a66441a8a48aff4d3d717ae: Bootstrap starting.
I20260811 08:12:36.501576 26647 tablet_bootstrap.cc:492] T 5563e10590974ba08a77905792df24bb P 21480547c48e4c5fb6a0d4f0345a1802: No bootstrap required, opened a new log
I20260811 08:12:36.501663 26647 ts_tablet_manager.cc:1397] T 5563e10590974ba08a77905792df24bb P 21480547c48e4c5fb6a0d4f0345a1802: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 08:12:36.501681 26648 tablet_bootstrap.cc:654] T 5563e10590974ba08a77905792df24bb P b11177163a66441a8a48aff4d3d717ae: Neither blocks nor log segments found. Creating new log.
I20260811 08:12:36.502125 26648 log.cc:824] T 5563e10590974ba08a77905792df24bb P b11177163a66441a8a48aff4d3d717ae: Log is configured to *not* fsync() on all Append() calls
I20260811 08:12:36.502760 26648 tablet_bootstrap.cc:492] T 5563e10590974ba08a77905792df24bb P b11177163a66441a8a48aff4d3d717ae: No bootstrap required, opened a new log
I20260811 08:12:36.502820 26648 ts_tablet_manager.cc:1397] T 5563e10590974ba08a77905792df24bb P b11177163a66441a8a48aff4d3d717ae: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 08:12:36.504184 26653 tablet_bootstrap.cc:492] T 5563e10590974ba08a77905792df24bb P 0b6de141ca4a4a10b9bb67d1155a2b8b: Bootstrap starting.
I20260811 08:12:36.504297 26647 raft_consensus.cc:348] T 5563e10590974ba08a77905792df24bb P 21480547c48e4c5fb6a0d4f0345a1802 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b11177163a66441a8a48aff4d3d717ae" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 42461 } } peers { permanent_uuid: "21480547c48e4c5fb6a0d4f0345a1802" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 43337 } } peers { permanent_uuid: "0b6de141ca4a4a10b9bb67d1155a2b8b" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 43525 } }
I20260811 08:12:36.504441 26647 raft_consensus.cc:374] T 5563e10590974ba08a77905792df24bb P 21480547c48e4c5fb6a0d4f0345a1802 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:12:36.504477 26647 raft_consensus.cc:729] T 5563e10590974ba08a77905792df24bb P 21480547c48e4c5fb6a0d4f0345a1802 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21480547c48e4c5fb6a0d4f0345a1802, State: Initialized, Role: FOLLOWER
I20260811 08:12:36.504591 26647 consensus_queue.cc:260] T 5563e10590974ba08a77905792df24bb P 21480547c48e4c5fb6a0d4f0345a1802 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b11177163a66441a8a48aff4d3d717ae" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 42461 } } peers { permanent_uuid: "21480547c48e4c5fb6a0d4f0345a1802" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 43337 } } peers { permanent_uuid: "0b6de141ca4a4a10b9bb67d1155a2b8b" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 43525 } }
I20260811 08:12:36.504868 26653 tablet_bootstrap.cc:654] T 5563e10590974ba08a77905792df24bb P 0b6de141ca4a4a10b9bb67d1155a2b8b: Neither blocks nor log segments found. Creating new log.
I20260811 08:12:36.504860 26647 ts_tablet_manager.cc:1428] T 5563e10590974ba08a77905792df24bb P 21480547c48e4c5fb6a0d4f0345a1802: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 08:12:36.504766 26648 raft_consensus.cc:348] T 5563e10590974ba08a77905792df24bb P b11177163a66441a8a48aff4d3d717ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b11177163a66441a8a48aff4d3d717ae" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 42461 } } peers { permanent_uuid: "21480547c48e4c5fb6a0d4f0345a1802" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 43337 } } peers { permanent_uuid: "0b6de141ca4a4a10b9bb67d1155a2b8b" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 43525 } }
I20260811 08:12:36.504894 26382 heartbeater.cc:503] Master 127.27.243.254:44281 was elected leader, sending a full tablet report...
I20260811 08:12:36.504911 26648 raft_consensus.cc:374] T 5563e10590974ba08a77905792df24bb P b11177163a66441a8a48aff4d3d717ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:12:36.504946 26648 raft_consensus.cc:729] T 5563e10590974ba08a77905792df24bb P b11177163a66441a8a48aff4d3d717ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b11177163a66441a8a48aff4d3d717ae, State: Initialized, Role: FOLLOWER
I20260811 08:12:36.505064 26648 consensus_queue.cc:260] T 5563e10590974ba08a77905792df24bb P b11177163a66441a8a48aff4d3d717ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b11177163a66441a8a48aff4d3d717ae" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 42461 } } peers { permanent_uuid: "21480547c48e4c5fb6a0d4f0345a1802" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 43337 } } peers { permanent_uuid: "0b6de141ca4a4a10b9bb67d1155a2b8b" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 43525 } }
I20260811 08:12:36.505232 26653 log.cc:824] T 5563e10590974ba08a77905792df24bb P 0b6de141ca4a4a10b9bb67d1155a2b8b: Log is configured to *not* fsync() on all Append() calls
I20260811 08:12:36.505292 26648 ts_tablet_manager.cc:1428] T 5563e10590974ba08a77905792df24bb P b11177163a66441a8a48aff4d3d717ae: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260811 08:12:36.505427 26141 heartbeater.cc:503] Master 127.27.243.254:44281 was elected leader, sending a full tablet report...
I20260811 08:12:36.505998 26653 tablet_bootstrap.cc:492] T 5563e10590974ba08a77905792df24bb P 0b6de141ca4a4a10b9bb67d1155a2b8b: No bootstrap required, opened a new log
I20260811 08:12:36.506080 26653 ts_tablet_manager.cc:1397] T 5563e10590974ba08a77905792df24bb P 0b6de141ca4a4a10b9bb67d1155a2b8b: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 08:12:36.507863 26653 raft_consensus.cc:348] T 5563e10590974ba08a77905792df24bb P 0b6de141ca4a4a10b9bb67d1155a2b8b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b11177163a66441a8a48aff4d3d717ae" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 42461 } } peers { permanent_uuid: "21480547c48e4c5fb6a0d4f0345a1802" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 43337 } } peers { permanent_uuid: "0b6de141ca4a4a10b9bb67d1155a2b8b" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 43525 } }
I20260811 08:12:36.507989 26653 raft_consensus.cc:374] T 5563e10590974ba08a77905792df24bb P 0b6de141ca4a4a10b9bb67d1155a2b8b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:12:36.508013 26653 raft_consensus.cc:729] T 5563e10590974ba08a77905792df24bb P 0b6de141ca4a4a10b9bb67d1155a2b8b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b6de141ca4a4a10b9bb67d1155a2b8b, State: Initialized, Role: FOLLOWER
I20260811 08:12:36.508095 26653 consensus_queue.cc:260] T 5563e10590974ba08a77905792df24bb P 0b6de141ca4a4a10b9bb67d1155a2b8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b11177163a66441a8a48aff4d3d717ae" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 42461 } } peers { permanent_uuid: "21480547c48e4c5fb6a0d4f0345a1802" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 43337 } } peers { permanent_uuid: "0b6de141ca4a4a10b9bb67d1155a2b8b" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 43525 } }
I20260811 08:12:36.508322 26653 ts_tablet_manager.cc:1428] T 5563e10590974ba08a77905792df24bb P 0b6de141ca4a4a10b9bb67d1155a2b8b: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260811 08:12:36.508425 26624 heartbeater.cc:503] Master 127.27.243.254:44281 was elected leader, sending a full tablet report...
I20260811 08:12:36.584030 26654 raft_consensus.cc:482] T 5563e10590974ba08a77905792df24bb P 21480547c48e4c5fb6a0d4f0345a1802 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:12:36.584178 26654 raft_consensus.cc:504] T 5563e10590974ba08a77905792df24bb P 21480547c48e4c5fb6a0d4f0345a1802 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b11177163a66441a8a48aff4d3d717ae" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 42461 } } peers { permanent_uuid: "21480547c48e4c5fb6a0d4f0345a1802" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 43337 } } peers { permanent_uuid: "0b6de141ca4a4a10b9bb67d1155a2b8b" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 43525 } }
I20260811 08:12:36.584563 26654 leader_election.cc:288] T 5563e10590974ba08a77905792df24bb P 21480547c48e4c5fb6a0d4f0345a1802 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b11177163a66441a8a48aff4d3d717ae (127.27.243.193:42461), 0b6de141ca4a4a10b9bb67d1155a2b8b (127.27.243.195:43525)
W20260811 08:12:36.587307 26383 tablet.cc:2369] T 5563e10590974ba08a77905792df24bb P 21480547c48e4c5fb6a0d4f0345a1802: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 08:12:36.587487 26646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:36.584824 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.194:43207 (local address 127.27.243.193:42461)
0811 08:12:36.584892 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0811 08:12:36.584894 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:12:36.585025 (+ 131us) server_negotiation.cc:407] Connection header received
0811 08:12:36.585089 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:12:36.585090 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:12:36.585102 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:12:36.585163 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:12:36.585299 (+ 136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:36.585807 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:36.586803 (+ 996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:36.587164 (+ 361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:36.587248 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:36.587255 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0811 08:12:36.587390 (+ 135us) server_negotiation.cc:299] Negotiation successful
0811 08:12:36.587426 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 08:12:36.587499 26661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:36.584765 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.193:42461 (local address 127.27.243.194:43207)
0811 08:12:36.584946 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0811 08:12:36.584958 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 08:12:36.585025 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:12:36.585171 (+ 146us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:12:36.585171 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:12:36.585173 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:12:36.585236 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:12:36.585238 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:12:36.585878 (+ 640us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:12:36.585879 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:12:36.586716 (+ 837us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:12:36.586718 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:12:36.587260 (+ 542us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:12:36.587261 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:12:36.587325 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:36.587328 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 08:12:36.587371 (+ 43us) client_negotiation.cc:240] Negotiation successful
0811 08:12:36.587411 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":167,"mutex_wait_us":19,"thread_start_us":96,"threads_started":1}
I20260811 08:12:36.587738 26384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:36.584754 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.195:43525 (local address 127.27.243.194:58721)
0811 08:12:36.584816 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0811 08:12:36.584829 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 08:12:36.584930 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:12:36.585100 (+ 170us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:12:36.585101 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:12:36.585103 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:12:36.585185 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:12:36.585188 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:12:36.585932 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:12:36.585933 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:12:36.586714 (+ 781us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:12:36.586716 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:12:36.587527 (+ 811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:12:36.587528 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:12:36.587594 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:36.587598 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 08:12:36.587646 (+ 48us) client_negotiation.cc:240] Negotiation successful
0811 08:12:36.587684 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39,"mutex_wait_us":28}
I20260811 08:12:36.587764 26645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:36.584911 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.194:58721 (local address 127.27.243.195:43525)
0811 08:12:36.584980 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0811 08:12:36.584982 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:12:36.584992 (+ 10us) server_negotiation.cc:407] Connection header received
0811 08:12:36.585027 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:12:36.585028 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:12:36.585038 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:12:36.585092 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:12:36.585248 (+ 156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:36.585806 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:36.586811 (+ 1005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:36.587162 (+ 351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:36.587217 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:36.587234 (+ 17us) server_negotiation.cc:1035] Waiting for connection context
0811 08:12:36.587665 (+ 431us) server_negotiation.cc:299] Negotiation successful
0811 08:12:36.587706 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 08:12:36.587834 26055 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5563e10590974ba08a77905792df24bb" candidate_uuid: "21480547c48e4c5fb6a0d4f0345a1802" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b11177163a66441a8a48aff4d3d717ae" is_pre_election: true
I20260811 08:12:36.588006 26055 raft_consensus.cc:2454] T 5563e10590974ba08a77905792df24bb P b11177163a66441a8a48aff4d3d717ae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21480547c48e4c5fb6a0d4f0345a1802 in term 0.
I20260811 08:12:36.588235 26182 leader_election.cc:302] T 5563e10590974ba08a77905792df24bb P 21480547c48e4c5fb6a0d4f0345a1802 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21480547c48e4c5fb6a0d4f0345a1802, b11177163a66441a8a48aff4d3d717ae; no voters:
I20260811 08:12:36.588219 26538 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5563e10590974ba08a77905792df24bb" candidate_uuid: "21480547c48e4c5fb6a0d4f0345a1802" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b6de141ca4a4a10b9bb67d1155a2b8b" is_pre_election: true
I20260811 08:12:36.588335 26538 raft_consensus.cc:2454] T 5563e10590974ba08a77905792df24bb P 0b6de141ca4a4a10b9bb67d1155a2b8b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21480547c48e4c5fb6a0d4f0345a1802 in term 0.
I20260811 08:12:36.588370 26654 raft_consensus.cc:2781] T 5563e10590974ba08a77905792df24bb P 21480547c48e4c5fb6a0d4f0345a1802 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 08:12:36.588433 26654 raft_consensus.cc:482] T 5563e10590974ba08a77905792df24bb P 21480547c48e4c5fb6a0d4f0345a1802 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 08:12:36.588464 26654 raft_consensus.cc:3037] T 5563e10590974ba08a77905792df24bb P 21480547c48e4c5fb6a0d4f0345a1802 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:12:36.589166 26654 raft_consensus.cc:504] T 5563e10590974ba08a77905792df24bb P 21480547c48e4c5fb6a0d4f0345a1802 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b11177163a66441a8a48aff4d3d717ae" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 42461 } } peers { permanent_uuid: "21480547c48e4c5fb6a0d4f0345a1802" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 43337 } } peers { permanent_uuid: "0b6de141ca4a4a10b9bb67d1155a2b8b" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 43525 } }
I20260811 08:12:36.589290 26654 leader_election.cc:288] T 5563e10590974ba08a77905792df24bb P 21480547c48e4c5fb6a0d4f0345a1802 [CANDIDATE]: Term 1 election: Requested vote from peers b11177163a66441a8a48aff4d3d717ae (127.27.243.193:42461), 0b6de141ca4a4a10b9bb67d1155a2b8b (127.27.243.195:43525)
I20260811 08:12:36.589427 26538 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5563e10590974ba08a77905792df24bb" candidate_uuid: "21480547c48e4c5fb6a0d4f0345a1802" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b6de141ca4a4a10b9bb67d1155a2b8b"
I20260811 08:12:36.589452 26055 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5563e10590974ba08a77905792df24bb" candidate_uuid: "21480547c48e4c5fb6a0d4f0345a1802" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b11177163a66441a8a48aff4d3d717ae"
I20260811 08:12:36.589497 26538 raft_consensus.cc:3037] T 5563e10590974ba08a77905792df24bb P 0b6de141ca4a4a10b9bb67d1155a2b8b [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:12:36.589545 26055 raft_consensus.cc:3037] T 5563e10590974ba08a77905792df24bb P b11177163a66441a8a48aff4d3d717ae [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:12:36.590212 26538 raft_consensus.cc:2454] T 5563e10590974ba08a77905792df24bb P 0b6de141ca4a4a10b9bb67d1155a2b8b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21480547c48e4c5fb6a0d4f0345a1802 in term 1.
I20260811 08:12:36.590389 26055 raft_consensus.cc:2454] T 5563e10590974ba08a77905792df24bb P b11177163a66441a8a48aff4d3d717ae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21480547c48e4c5fb6a0d4f0345a1802 in term 1.
I20260811 08:12:36.590399 26183 leader_election.cc:302] T 5563e10590974ba08a77905792df24bb P 21480547c48e4c5fb6a0d4f0345a1802 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b6de141ca4a4a10b9bb67d1155a2b8b, 21480547c48e4c5fb6a0d4f0345a1802; no voters:
I20260811 08:12:36.590570 26654 raft_consensus.cc:2781] T 5563e10590974ba08a77905792df24bb P 21480547c48e4c5fb6a0d4f0345a1802 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:12:36.590716 26654 raft_consensus.cc:686] T 5563e10590974ba08a77905792df24bb P 21480547c48e4c5fb6a0d4f0345a1802 [term 1 LEADER]: Becoming Leader. State: Replica: 21480547c48e4c5fb6a0d4f0345a1802, State: Running, Role: LEADER
I20260811 08:12:36.590853 26654 consensus_queue.cc:237] T 5563e10590974ba08a77905792df24bb P 21480547c48e4c5fb6a0d4f0345a1802 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b11177163a66441a8a48aff4d3d717ae" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 42461 } } peers { permanent_uuid: "21480547c48e4c5fb6a0d4f0345a1802" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 43337 } } peers { permanent_uuid: "0b6de141ca4a4a10b9bb67d1155a2b8b" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 43525 } }
I20260811 08:12:36.591704 25819 catalog_manager.cc:5495] T 5563e10590974ba08a77905792df24bb P 21480547c48e4c5fb6a0d4f0345a1802 reported cstate change: term changed from 0 to 1, leader changed from <none> to 21480547c48e4c5fb6a0d4f0345a1802 (127.27.243.194). New cstate: current_term: 1 leader_uuid: "21480547c48e4c5fb6a0d4f0345a1802" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b11177163a66441a8a48aff4d3d717ae" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 42461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "21480547c48e4c5fb6a0d4f0345a1802" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 43337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b6de141ca4a4a10b9bb67d1155a2b8b" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 43525 } health_report { overall_health: UNKNOWN } } }
I20260811 08:12:36.608775 26643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:36.606577 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58536 (local address 127.27.243.194:43337)
0811 08:12:36.606622 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 08:12:36.606623 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 08:12:36.606632 (+ 9us) server_negotiation.cc:407] Connection header received
0811 08:12:36.606678 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:12:36.606679 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:12:36.606695 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:12:36.606755 (+ 60us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:12:36.606891 (+ 136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:36.607351 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:36.608090 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:36.608292 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:36.608358 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:36.608494 (+ 136us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:12:36.608588 (+ 94us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:12:36.608649 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 08:12:36.608685 (+ 36us) server_negotiation.cc:299] Negotiation successful
0811 08:12:36.608701 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 08:12:36.610517 26538 raft_consensus.cc:1261] T 5563e10590974ba08a77905792df24bb P 0b6de141ca4a4a10b9bb67d1155a2b8b [term 1 FOLLOWER]: Refusing update from remote peer 21480547c48e4c5fb6a0d4f0345a1802: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:12:36.610523 26055 raft_consensus.cc:1261] T 5563e10590974ba08a77905792df24bb P b11177163a66441a8a48aff4d3d717ae [term 1 FOLLOWER]: Refusing update from remote peer 21480547c48e4c5fb6a0d4f0345a1802: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:12:36.610915 26663 consensus_queue.cc:1035] T 5563e10590974ba08a77905792df24bb P 21480547c48e4c5fb6a0d4f0345a1802 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b6de141ca4a4a10b9bb67d1155a2b8b" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 43525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:12:36.611052 26654 consensus_queue.cc:1035] T 5563e10590974ba08a77905792df24bb P 21480547c48e4c5fb6a0d4f0345a1802 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b11177163a66441a8a48aff4d3d717ae" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 42461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:12:36.613605 26674 mvcc.cc:205] Tried to move back new op lower bound from 7317241678274072576 to 7317241678196752384. Current Snapshot: MvccSnapshot[applied={T|T < 7317241678274072576}]
I20260811 08:12:36.614158 26673 mvcc.cc:205] Tried to move back new op lower bound from 7317241678274072576 to 7317241678196752384. Current Snapshot: MvccSnapshot[applied={T|T < 7317241678274072576}]
I20260811 08:12:36.616185 25819 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:52354:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:12:36.616272 25819 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:52354:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:12:36.617059 25819 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c1badb26e1f6468cbc6592786ed2ce11: Sending DeleteTablet for 3 replicas of tablet 5563e10590974ba08a77905792df24bb
I20260811 08:12:36.617429 26027 tablet_service.cc:1514] Processing DeleteTablet for tablet 5563e10590974ba08a77905792df24bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:12:36 UTC) from {username='slave'} at 127.0.0.1:51612
I20260811 08:12:36.617691 26688 tablet_replica.cc:330] T 5563e10590974ba08a77905792df24bb P b11177163a66441a8a48aff4d3d717ae: stopping tablet replica
I20260811 08:12:36.617700 26500 tablet_service.cc:1514] Processing DeleteTablet for tablet 5563e10590974ba08a77905792df24bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:12:36 UTC) from {username='slave'} at 127.0.0.1:57576
I20260811 08:12:36.617740 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 25926
I20260811 08:12:36.623762 26267 tablet_service.cc:1514] Processing DeleteTablet for tablet 5563e10590974ba08a77905792df24bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:12:36 UTC) from {username='slave'} at 127.0.0.1:58530
I20260811 08:12:36.625321 26691 tablet_replica.cc:330] T 5563e10590974ba08a77905792df24bb P 21480547c48e4c5fb6a0d4f0345a1802: stopping tablet replica
I20260811 08:12:36.625418 26691 raft_consensus.cc:2229] T 5563e10590974ba08a77905792df24bb P 21480547c48e4c5fb6a0d4f0345a1802 [term 1 LEADER]: Raft consensus shutting down.
I20260811 08:12:36.625559 26691 raft_consensus.cc:2258] T 5563e10590974ba08a77905792df24bb P 21480547c48e4c5fb6a0d4f0345a1802 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:12:36.626955 26691 ts_tablet_manager.cc:1905] T 5563e10590974ba08a77905792df24bb P 21480547c48e4c5fb6a0d4f0345a1802: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:12:36.628643 26691 ts_tablet_manager.cc:1918] T 5563e10590974ba08a77905792df24bb P 21480547c48e4c5fb6a0d4f0345a1802: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:12:36.628736 26691 log.cc:1196] T 5563e10590974ba08a77905792df24bb P 21480547c48e4c5fb6a0d4f0345a1802: Deleting WAL directory at /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435717191469-28623-0/minicluster-data/ts-1/wal/wals/5563e10590974ba08a77905792df24bb
I20260811 08:12:36.629033 26691 ts_tablet_manager.cc:1939] T 5563e10590974ba08a77905792df24bb P 21480547c48e4c5fb6a0d4f0345a1802: Deleting consensus metadata
I20260811 08:12:36.629681 25790 catalog_manager.cc:4841] TS 21480547c48e4c5fb6a0d4f0345a1802 (127.27.243.194:43337): tablet 5563e10590974ba08a77905792df24bb (table test-table [id=f660003ecca7489a8cbeba95ee6b7c4f]) successfully deleted
I20260811 08:12:36.629933 26689 tablet_replica.cc:330] T 5563e10590974ba08a77905792df24bb P 0b6de141ca4a4a10b9bb67d1155a2b8b: stopping tablet replica
I20260811 08:12:36.630059 26689 raft_consensus.cc:2229] T 5563e10590974ba08a77905792df24bb P 0b6de141ca4a4a10b9bb67d1155a2b8b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:12:36.630172 26689 raft_consensus.cc:2258] T 5563e10590974ba08a77905792df24bb P 0b6de141ca4a4a10b9bb67d1155a2b8b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:12:36.630693 26689 ts_tablet_manager.cc:1905] T 5563e10590974ba08a77905792df24bb P 0b6de141ca4a4a10b9bb67d1155a2b8b: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260811 08:12:36.632174 25787 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.27.243.193:42461 (error 108)
I20260811 08:12:36.632326 26689 ts_tablet_manager.cc:1918] T 5563e10590974ba08a77905792df24bb P 0b6de141ca4a4a10b9bb67d1155a2b8b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:12:36.632416 26689 log.cc:1196] T 5563e10590974ba08a77905792df24bb P 0b6de141ca4a4a10b9bb67d1155a2b8b: Deleting WAL directory at /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435717191469-28623-0/minicluster-data/ts-2/wal/wals/5563e10590974ba08a77905792df24bb
I20260811 08:12:36.632680 26689 ts_tablet_manager.cc:1939] T 5563e10590974ba08a77905792df24bb P 0b6de141ca4a4a10b9bb67d1155a2b8b: Deleting consensus metadata
I20260811 08:12:36.632819 26642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:36.632649 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.193:42461 (local address 127.0.0.1:51628)
0811 08:12:36.632713 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0811 08:12:36.632783 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.193:42461: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260811 08:12:36.632893 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 26151
I20260811 08:12:36.635337 25789 catalog_manager.cc:4841] TS 0b6de141ca4a4a10b9bb67d1155a2b8b (127.27.243.195:43525): tablet 5563e10590974ba08a77905792df24bb (table test-table [id=f660003ecca7489a8cbeba95ee6b7c4f]) successfully deleted
W20260811 08:12:36.638016 25787 catalog_manager.cc:4584] TS b11177163a66441a8a48aff4d3d717ae (127.27.243.193:42461): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 5563e10590974ba08a77905792df24bb: Network error: Client connection negotiation failed: client connection to 127.27.243.193:42461: connect: Connection refused (error 111)
I20260811 08:12:36.640268 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 26385
I20260811 08:12:36.650106 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 25767
2026-08-11T08:12:36Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (768 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435717191469-28623-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:12:36 dist-test-slave-7lbf krb5kdc[26700](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:12:36 dist-test-slave-7lbf krb5kdc[26700](info): set up 2 sockets
Aug 11 08:12:36 dist-test-slave-7lbf krb5kdc[26700](info): commencing operation
krb5kdc: starting...
W20260811 08:12:37.818846 28623 mini_kdc.cc:121] Time spent starting KDC: real 1.140s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435717191469-28623-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435717191469-28623-0/krb5kdc/test-user.keytab.
Aug 11 08:12:37 dist-test-slave-7lbf krb5kdc[26700](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435957, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:12:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:12:37Z Disabled control of system clock
WARNING: no policy specified for kudu/127.27.243.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.243.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.243.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab.
Entry for principal kudu/127.27.243.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab.
I20260811 08:12:37.934088 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435717191469-28623-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435717191469-28623-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435717191469-28623-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.243.254:33315
--webserver_interface=127.27.243.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab
--principal=kudu/127.27.243.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:43269
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.243.254:33315
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:12:38.013841 26722 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:12:38.014037 26722 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:12:38.014066 26722 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:12:38.015201 26722 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:12:38.015240 26722 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:12:38.015259 26722 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:12:38.015275 26722 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:12:38.015288 26722 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:12:38.016769 26722 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:43269
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435717191469-28623-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435717191469-28623-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.243.254:33315
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab
--principal=kudu/127.27.243.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.243.254:33315
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.243.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26722
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435717191469-28623-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:12:38.017016 26722 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:12:38.017216 26722 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:12:38.021795 26728 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:12:38.021852 26731 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:12:38.021852 26735 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:12:38.022019 26722 server_base.cc:1034] running on GCE node
I20260811 08:12:38.022239 26722 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:12:38.022502 26722 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:12:38.023638 26722 hybrid_clock.cc:648] HybridClock initialized: now 1786435958023640 us; error 52 us; skew 500 ppm
Aug 11 08:12:38 dist-test-slave-7lbf krb5kdc[26700](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435958, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:12:38.026031 26722 init.cc:377] Logged in from keytab as kudu/127.27.243.254@KRBTEST.COM (short username kudu)
I20260811 08:12:38.026439 26722 webserver.cc:460] Webserver started at http://127.27.243.254:41835/ using document root <none> and password file <none>
I20260811 08:12:38.026652 26722 fs_manager.cc:359] Metadata directory not provided
I20260811 08:12:38.026698 26722 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:12:38.026821 26722 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:12:38.027802 26722 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435717191469-28623-0/minicluster-data/master-0/data/instance:
uuid: "5594a89020e540269de3df92ecf0ba2c"
format_stamp: "Formatted at 2026-08-11 08:12:38 on dist-test-slave-7lbf"
server_key: "fb68ef107cc2c69ca02a92d5b01dc458"
server_key_iv: "d8835c81fe1bcd1bb036a42c8532fc58"
server_key_version: "encryptionkey@0"
I20260811 08:12:38.028167 26722 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435717191469-28623-0/minicluster-data/master-0/wal/instance:
uuid: "5594a89020e540269de3df92ecf0ba2c"
format_stamp: "Formatted at 2026-08-11 08:12:38 on dist-test-slave-7lbf"
server_key: "fb68ef107cc2c69ca02a92d5b01dc458"
server_key_iv: "d8835c81fe1bcd1bb036a42c8532fc58"
server_key_version: "encryptionkey@0"
I20260811 08:12:38.029392 26722 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 08:12:38.030088 26744 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:12:38.030234 26722 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 08:12:38.030328 26722 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435717191469-28623-0/minicluster-data/master-0/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435717191469-28623-0/minicluster-data/master-0/wal
uuid: "5594a89020e540269de3df92ecf0ba2c"
format_stamp: "Formatted at 2026-08-11 08:12:38 on dist-test-slave-7lbf"
server_key: "fb68ef107cc2c69ca02a92d5b01dc458"
server_key_iv: "d8835c81fe1bcd1bb036a42c8532fc58"
server_key_version: "encryptionkey@0"
I20260811 08:12:38.030392 26722 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435717191469-28623-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435717191469-28623-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435717191469-28623-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:12:38.056934 26722 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:12:38.058799 26722 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:12:38.058969 26722 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:12:38.062709 26722 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.254:33315
I20260811 08:12:38.062752 26835 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.254:33315 every 8 connection(s)
I20260811 08:12:38.063074 26722 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
I20260811 08:12:38.063881 26838 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:12:38.066221 26838 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5594a89020e540269de3df92ecf0ba2c: Bootstrap starting.
I20260811 08:12:38.066778 26838 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5594a89020e540269de3df92ecf0ba2c: Neither blocks nor log segments found. Creating new log.
I20260811 08:12:38.067086 26838 log.cc:824] T 00000000000000000000000000000000 P 5594a89020e540269de3df92ecf0ba2c: Log is configured to *not* fsync() on all Append() calls
I20260811 08:12:38.067742 26838 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5594a89020e540269de3df92ecf0ba2c: No bootstrap required, opened a new log
I20260811 08:12:38.068572 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 26722
I20260811 08:12:38.068696 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435717191469-28623-0/minicluster-data/master-0/wal/instance
I20260811 08:12:38.068868 28623 external_mini_cluster.cc:1428] Setting key d142c53a56e8ecb68a00b8ff9a37ee72
I20260811 08:12:38.069545 26838 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5594a89020e540269de3df92ecf0ba2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5594a89020e540269de3df92ecf0ba2c" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 33315 } }
I20260811 08:12:38.069700 26838 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5594a89020e540269de3df92ecf0ba2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:12:38.069734 26838 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5594a89020e540269de3df92ecf0ba2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5594a89020e540269de3df92ecf0ba2c, State: Initialized, Role: FOLLOWER
I20260811 08:12:38.069859 26838 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5594a89020e540269de3df92ecf0ba2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5594a89020e540269de3df92ecf0ba2c" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 33315 } }
I20260811 08:12:38.069940 26838 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5594a89020e540269de3df92ecf0ba2c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:12:38.069972 26838 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5594a89020e540269de3df92ecf0ba2c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:12:38.070020 26838 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5594a89020e540269de3df92ecf0ba2c [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:12:38.070999 26838 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5594a89020e540269de3df92ecf0ba2c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5594a89020e540269de3df92ecf0ba2c" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 33315 } }
I20260811 08:12:38.071100 26838 leader_election.cc:302] T 00000000000000000000000000000000 P 5594a89020e540269de3df92ecf0ba2c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5594a89020e540269de3df92ecf0ba2c; no voters:
I20260811 08:12:38.071250 26838 leader_election.cc:288] T 00000000000000000000000000000000 P 5594a89020e540269de3df92ecf0ba2c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:12:38.071292 26846 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5594a89020e540269de3df92ecf0ba2c [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:12:38.071415 26846 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5594a89020e540269de3df92ecf0ba2c [term 1 LEADER]: Becoming Leader. State: Replica: 5594a89020e540269de3df92ecf0ba2c, State: Running, Role: LEADER
I20260811 08:12:38.071512 26838 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5594a89020e540269de3df92ecf0ba2c [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:12:38.071496 26846 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5594a89020e540269de3df92ecf0ba2c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5594a89020e540269de3df92ecf0ba2c" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 33315 } }
I20260811 08:12:38.071832 26846 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5594a89020e540269de3df92ecf0ba2c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5594a89020e540269de3df92ecf0ba2c. Latest consensus state: current_term: 1 leader_uuid: "5594a89020e540269de3df92ecf0ba2c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5594a89020e540269de3df92ecf0ba2c" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 33315 } } }
I20260811 08:12:38.071913 26846 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5594a89020e540269de3df92ecf0ba2c [sys.catalog]: This master's current role is: LEADER
I20260811 08:12:38.072077 26849 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5594a89020e540269de3df92ecf0ba2c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5594a89020e540269de3df92ecf0ba2c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5594a89020e540269de3df92ecf0ba2c" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 33315 } } }
I20260811 08:12:38.072156 26849 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5594a89020e540269de3df92ecf0ba2c [sys.catalog]: This master's current role is: LEADER
I20260811 08:12:38.072273 26853 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:12:38.073046 26853 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:12:38.074667 26853 catalog_manager.cc:1347] Generated new cluster ID: 68ec31419ac04bf9a6fe97d4315ef352
I20260811 08:12:38.074724 26853 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 08:12:38 dist-test-slave-7lbf krb5kdc[26700](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435957, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.243.254@KRBTEST.COM
I20260811 08:12:38.079062 26845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:38.069359 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46016 (local address 127.27.243.254:33315)
0811 08:12:38.069545 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0811 08:12:38.069554 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 08:12:38.069588 (+ 34us) server_negotiation.cc:407] Connection header received
0811 08:12:38.069683 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:12:38.069688 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:12:38.069736 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:12:38.069877 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:12:38.070637 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:38.071714 (+ 1077us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:38.072812 (+ 1098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:38.073487 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:38.073624 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:38.075904 (+ 2280us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:12:38.075915 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:12:38.075915 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:12:38.075927 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:12:38.077405 (+ 1478us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:12:38.077791 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:12:38.077794 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:12:38.077795 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:12:38.077915 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:12:38.078094 (+ 179us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:12:38.078095 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:12:38.078095 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:12:38.078337 (+ 242us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:12:38.078503 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0811 08:12:38.078602 (+ 99us) server_negotiation.cc:299] Negotiation successful
0811 08:12:38.078734 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":116,"thread_start_us":75,"threads_started":1}
I20260811 08:12:38.089282 26853 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:12:38.090006 26853 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:12:38.100893 26853 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5594a89020e540269de3df92ecf0ba2c: Generated new TSK 0
I20260811 08:12:38.101069 26853 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.27.243.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.243.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.243.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.193.keytab.
Entry for principal kudu/127.27.243.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.193.keytab.
I20260811 08:12:38.137641 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435717191469-28623-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435717191469-28623-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435717191469-28623-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435717191469-28623-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.243.193:0
--local_ip_for_outbound_sockets=127.27.243.193
--webserver_interface=127.27.243.193
--webserver_port=0
--tserver_master_addrs=127.27.243.254:33315
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.193.keytab
--principal=kudu/127.27.243.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:43269
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:12:38.243502 26881 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:12:38.243705 26881 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:12:38.243727 26881 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:12:38.244815 26881 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:12:38.244855 26881 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:12:38.244882 26881 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.243.193
I20260811 08:12:38.246321 26881 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:43269
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435717191469-28623-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435717191469-28623-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.193.keytab
--principal=kudu/127.27.243.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.243.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435717191469-28623-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.243.193
--webserver_port=0
--tserver_master_addrs=127.27.243.254:33315
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26881
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.243.193
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435717191469-28623-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:12:38.246508 26881 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:12:38.246690 26881 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:12:38.251435 26895 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:12:38.251439 26888 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:12:38.251469 26892 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:12:38.251677 26881 server_base.cc:1034] running on GCE node
I20260811 08:12:38.251906 26881 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:12:38.252116 26881 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:12:38.253273 26881 hybrid_clock.cc:648] HybridClock initialized: now 1786435958253257 us; error 24 us; skew 500 ppm
Aug 11 08:12:38 dist-test-slave-7lbf krb5kdc[26700](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435958, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:12:38.255834 26881 init.cc:377] Logged in from keytab as kudu/127.27.243.193@KRBTEST.COM (short username kudu)
I20260811 08:12:38.256258 26881 webserver.cc:460] Webserver started at http://127.27.243.193:46669/ using document root <none> and password file <none>
I20260811 08:12:38.256466 26881 fs_manager.cc:359] Metadata directory not provided
I20260811 08:12:38.256513 26881 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:12:38.256639 26881 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:12:38.257700 26881 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435717191469-28623-0/minicluster-data/ts-0/data/instance:
uuid: "e1b1aa1a8c3c4c948593aea8a926a16d"
format_stamp: "Formatted at 2026-08-11 08:12:38 on dist-test-slave-7lbf"
server_key: "58b16dbbefa5e25ba1714b9e91616df8"
server_key_iv: "e054338f0654ea139397df6dabdb15ff"
server_key_version: "encryptionkey@0"
I20260811 08:12:38.258035 26881 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435717191469-28623-0/minicluster-data/ts-0/wal/instance:
uuid: "e1b1aa1a8c3c4c948593aea8a926a16d"
format_stamp: "Formatted at 2026-08-11 08:12:38 on dist-test-slave-7lbf"
server_key: "58b16dbbefa5e25ba1714b9e91616df8"
server_key_iv: "e054338f0654ea139397df6dabdb15ff"
server_key_version: "encryptionkey@0"
I20260811 08:12:38.259244 26881 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:12:38.259892 26903 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:12:38.260043 26881 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 08:12:38.260128 26881 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435717191469-28623-0/minicluster-data/ts-0/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435717191469-28623-0/minicluster-data/ts-0/wal
uuid: "e1b1aa1a8c3c4c948593aea8a926a16d"
format_stamp: "Formatted at 2026-08-11 08:12:38 on dist-test-slave-7lbf"
server_key: "58b16dbbefa5e25ba1714b9e91616df8"
server_key_iv: "e054338f0654ea139397df6dabdb15ff"
server_key_version: "encryptionkey@0"
I20260811 08:12:38.260190 26881 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435717191469-28623-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435717191469-28623-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435717191469-28623-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:12:38.281400 26881 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:12:38.283316 26881 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:12:38.283454 26881 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:12:38.283667 26881 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:12:38.283972 26881 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:12:38.284008 26881 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:12:38.284044 26881 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:12:38.284065 26881 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:12:38.289460 26881 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.193:45791
I20260811 08:12:38.289546 27113 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.193:45791 every 8 connection(s)
I20260811 08:12:38.289832 26881 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435717191469-28623-0/minicluster-data/ts-0/data/info.pb
I20260811 08:12:38.293977 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 26881
I20260811 08:12:38.294099 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435717191469-28623-0/minicluster-data/ts-0/wal/instance
I20260811 08:12:38.294317 28623 external_mini_cluster.cc:1428] Setting key 729b4791c58fc8718b5b61b4bb4b47d2
Aug 11 08:12:38 dist-test-slave-7lbf krb5kdc[26700](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435958, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.193@KRBTEST.COM for kudu/127.27.243.254@KRBTEST.COM
I20260811 08:12:38.299077 26845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:38.290514 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.193:45019 (local address 127.27.243.254:33315)
0811 08:12:38.290572 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0811 08:12:38.290578 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 08:12:38.290801 (+ 223us) server_negotiation.cc:407] Connection header received
0811 08:12:38.291306 (+ 505us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:12:38.291307 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:12:38.291326 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:12:38.291378 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:12:38.292275 (+ 897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:38.292768 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:38.293779 (+ 1011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:38.293987 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:38.294043 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:38.296277 (+ 2234us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:12:38.296278 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:12:38.296279 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:12:38.296289 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:12:38.297635 (+ 1346us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:12:38.298096 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:12:38.298097 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:12:38.298097 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:12:38.298159 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:12:38.298455 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:12:38.298456 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:12:38.298456 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:12:38.298586 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:12:38.298651 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 08:12:38.298909 (+ 258us) server_negotiation.cc:299] Negotiation successful
0811 08:12:38.298992 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260811 08:12:38.299335 27117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:38.290496 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:33315 (local address 127.27.243.193:45019)
0811 08:12:38.290682 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0811 08:12:38.290718 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 08:12:38.291205 (+ 487us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:12:38.291447 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:12:38.291451 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:12:38.291998 (+ 547us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:12:38.292181 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:12:38.292186 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:12:38.292851 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:12:38.292852 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:12:38.293701 (+ 849us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:12:38.293704 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:12:38.294058 (+ 354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:12:38.294059 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:12:38.294195 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:38.294697 (+ 502us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:12:38.294706 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:12:38.296171 (+ 1465us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:12:38.297712 (+ 1541us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:12:38.297721 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:12:38.297724 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:12:38.298024 (+ 300us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:12:38.298257 (+ 233us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:12:38.298258 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:12:38.298259 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:12:38.298388 (+ 129us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:12:38.298644 (+ 256us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:12:38.298647 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:12:38.298756 (+ 109us) client_negotiation.cc:769] Sending connection context
0811 08:12:38.298874 (+ 118us) client_negotiation.cc:240] Negotiation successful
0811 08:12:38.299011 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":96,"threads_started":1}
I20260811 08:12:38.299809 27114 heartbeater.cc:347] Connected to a master server at 127.27.243.254:33315
I20260811 08:12:38.299897 27114 heartbeater.cc:464] Registering TS with master...
I20260811 08:12:38.300061 27114 heartbeater.cc:511] Master 127.27.243.254:33315 requested a full tablet report, sending...
I20260811 08:12:38.300552 26775 ts_manager.cc:194] Registered new tserver with Master: e1b1aa1a8c3c4c948593aea8a926a16d (127.27.243.193:45791)
I20260811 08:12:38.301108 26775 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.243.193@KRBTEST.COM'} at 127.27.243.193:45019
WARNING: no policy specified for kudu/127.27.243.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.243.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.243.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.194.keytab.
Entry for principal kudu/127.27.243.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.194.keytab.
I20260811 08:12:38.319789 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435717191469-28623-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435717191469-28623-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435717191469-28623-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435717191469-28623-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.243.194:0
--local_ip_for_outbound_sockets=127.27.243.194
--webserver_interface=127.27.243.194
--webserver_port=0
--tserver_master_addrs=127.27.243.254:33315
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.194.keytab
--principal=kudu/127.27.243.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:43269
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:12:38.400679 27120 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:12:38.400884 27120 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:12:38.400913 27120 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:12:38.402109 27120 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:12:38.402150 27120 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:12:38.402184 27120 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.243.194
I20260811 08:12:38.403605 27120 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:43269
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435717191469-28623-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435717191469-28623-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.194.keytab
--principal=kudu/127.27.243.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.243.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435717191469-28623-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.243.194
--webserver_port=0
--tserver_master_addrs=127.27.243.254:33315
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27120
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.243.194
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435717191469-28623-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:12:38.403846 27120 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:12:38.404047 27120 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:12:38.408761 27130 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:12:38.408771 27129 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:12:38.408771 27135 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:12:38.409020 27120 server_base.cc:1034] running on GCE node
I20260811 08:12:38.409233 27120 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:12:38.409447 27120 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:12:38.410589 27120 hybrid_clock.cc:648] HybridClock initialized: now 1786435958410578 us; error 43 us; skew 500 ppm
Aug 11 08:12:38 dist-test-slave-7lbf krb5kdc[26700](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435958, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:12:38.412999 27120 init.cc:377] Logged in from keytab as kudu/127.27.243.194@KRBTEST.COM (short username kudu)
I20260811 08:12:38.413363 27120 webserver.cc:460] Webserver started at http://127.27.243.194:44323/ using document root <none> and password file <none>
I20260811 08:12:38.413576 27120 fs_manager.cc:359] Metadata directory not provided
I20260811 08:12:38.413621 27120 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:12:38.413712 27120 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:12:38.414672 27120 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435717191469-28623-0/minicluster-data/ts-1/data/instance:
uuid: "6b143ad456394f698ace54c6684c832b"
format_stamp: "Formatted at 2026-08-11 08:12:38 on dist-test-slave-7lbf"
server_key: "64d143bd6f5be8f2a64db37769a36b31"
server_key_iv: "76d89ec9127bea932b7c76275442f59a"
server_key_version: "encryptionkey@0"
I20260811 08:12:38.414958 27120 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435717191469-28623-0/minicluster-data/ts-1/wal/instance:
uuid: "6b143ad456394f698ace54c6684c832b"
format_stamp: "Formatted at 2026-08-11 08:12:38 on dist-test-slave-7lbf"
server_key: "64d143bd6f5be8f2a64db37769a36b31"
server_key_iv: "76d89ec9127bea932b7c76275442f59a"
server_key_version: "encryptionkey@0"
I20260811 08:12:38.416077 27120 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 08:12:38.416671 27146 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:12:38.416823 27120 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 08:12:38.416913 27120 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435717191469-28623-0/minicluster-data/ts-1/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435717191469-28623-0/minicluster-data/ts-1/wal
uuid: "6b143ad456394f698ace54c6684c832b"
format_stamp: "Formatted at 2026-08-11 08:12:38 on dist-test-slave-7lbf"
server_key: "64d143bd6f5be8f2a64db37769a36b31"
server_key_iv: "76d89ec9127bea932b7c76275442f59a"
server_key_version: "encryptionkey@0"
I20260811 08:12:38.416973 27120 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435717191469-28623-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435717191469-28623-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435717191469-28623-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:12:38.440239 27120 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:12:38.442030 27120 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:12:38.442139 27120 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:12:38.442332 27120 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:12:38.442602 27120 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:12:38.442638 27120 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:12:38.442659 27120 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:12:38.442673 27120 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:12:38.448228 27120 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.194:36883
I20260811 08:12:38.448297 27365 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.194:36883 every 8 connection(s)
I20260811 08:12:38.448575 27120 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435717191469-28623-0/minicluster-data/ts-1/data/info.pb
Aug 11 08:12:38 dist-test-slave-7lbf krb5kdc[26700](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435958, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.194@KRBTEST.COM for kudu/127.27.243.254@KRBTEST.COM
I20260811 08:12:38.455013 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 27120
I20260811 08:12:38.455128 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435717191469-28623-0/minicluster-data/ts-1/wal/instance
I20260811 08:12:38.455299 28623 external_mini_cluster.cc:1428] Setting key 4efb69974571c2d88c67995d4389411b
I20260811 08:12:38.457347 26845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:38.449215 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.194:55121 (local address 127.27.243.254:33315)
0811 08:12:38.449266 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 08:12:38.449268 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:12:38.449469 (+ 201us) server_negotiation.cc:407] Connection header received
0811 08:12:38.450004 (+ 535us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:12:38.450005 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:12:38.450019 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:12:38.450068 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:12:38.451009 (+ 941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:38.451528 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:38.452499 (+ 971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:38.452707 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:38.452764 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:38.454738 (+ 1974us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:12:38.454739 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:12:38.454739 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:12:38.454746 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:12:38.456031 (+ 1285us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:12:38.456446 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:12:38.456447 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:12:38.456448 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:12:38.456505 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:12:38.456754 (+ 249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:12:38.456755 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:12:38.456755 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:12:38.456887 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:12:38.456939 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 08:12:38.457211 (+ 272us) server_negotiation.cc:299] Negotiation successful
0811 08:12:38.457275 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 08:12:38.457583 27369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:38.449183 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:33315 (local address 127.27.243.194:55121)
0811 08:12:38.449331 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0811 08:12:38.449390 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0811 08:12:38.449907 (+ 517us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:12:38.450147 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:12:38.450152 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:12:38.450729 (+ 577us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:12:38.450915 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:12:38.450920 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:12:38.451613 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:12:38.451614 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:12:38.452418 (+ 804us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:12:38.452420 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:12:38.452777 (+ 357us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:12:38.452778 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:12:38.452905 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:38.453301 (+ 396us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:12:38.453309 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:12:38.454644 (+ 1335us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:12:38.456100 (+ 1456us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:12:38.456107 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:12:38.456110 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:12:38.456374 (+ 264us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:12:38.456566 (+ 192us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:12:38.456567 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:12:38.456567 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:12:38.456700 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:12:38.456942 (+ 242us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:12:38.456947 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:12:38.457095 (+ 148us) client_negotiation.cc:769] Sending connection context
0811 08:12:38.457197 (+ 102us) client_negotiation.cc:240] Negotiation successful
0811 08:12:38.457351 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":75,"threads_started":1}
I20260811 08:12:38.458034 27367 heartbeater.cc:347] Connected to a master server at 127.27.243.254:33315
I20260811 08:12:38.458133 27367 heartbeater.cc:464] Registering TS with master...
I20260811 08:12:38.458312 27367 heartbeater.cc:511] Master 127.27.243.254:33315 requested a full tablet report, sending...
I20260811 08:12:38.458668 26775 ts_manager.cc:194] Registered new tserver with Master: 6b143ad456394f698ace54c6684c832b (127.27.243.194:36883)
I20260811 08:12:38.459030 26775 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.243.194@KRBTEST.COM'} at 127.27.243.194:55121
WARNING: no policy specified for kudu/127.27.243.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.243.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.243.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.195.keytab.
Entry for principal kudu/127.27.243.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.195.keytab.
I20260811 08:12:38.480253 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435717191469-28623-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435717191469-28623-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435717191469-28623-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435717191469-28623-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.243.195:0
--local_ip_for_outbound_sockets=127.27.243.195
--webserver_interface=127.27.243.195
--webserver_port=0
--tserver_master_addrs=127.27.243.254:33315
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.195.keytab
--principal=kudu/127.27.243.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:43269
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:12:38.560842 27373 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:12:38.561028 27373 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:12:38.561051 27373 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:12:38.562179 27373 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:12:38.562217 27373 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:12:38.562242 27373 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.243.195
I20260811 08:12:38.563692 27373 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:43269
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435717191469-28623-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435717191469-28623-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.195.keytab
--principal=kudu/127.27.243.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.243.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435717191469-28623-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.243.195
--webserver_port=0
--tserver_master_addrs=127.27.243.254:33315
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27373
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.243.195
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435717191469-28623-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:12:38.563902 27373 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:12:38.564100 27373 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:12:38.568857 27386 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:12:38.568975 27373 server_base.cc:1034] running on GCE node
W20260811 08:12:38.568871 27395 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:12:38.568874 27384 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:12:38.569275 27373 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:12:38.569501 27373 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:12:38.570659 27373 hybrid_clock.cc:648] HybridClock initialized: now 1786435958570648 us; error 31 us; skew 500 ppm
Aug 11 08:12:38 dist-test-slave-7lbf krb5kdc[26700](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435958, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:12:38.573225 27373 init.cc:377] Logged in from keytab as kudu/127.27.243.195@KRBTEST.COM (short username kudu)
I20260811 08:12:38.573681 27373 webserver.cc:460] Webserver started at http://127.27.243.195:39021/ using document root <none> and password file <none>
I20260811 08:12:38.573865 27373 fs_manager.cc:359] Metadata directory not provided
I20260811 08:12:38.573904 27373 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:12:38.573995 27373 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:12:38.574963 27373 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435717191469-28623-0/minicluster-data/ts-2/data/instance:
uuid: "92700a1c31ff498e90611b13ba54ad70"
format_stamp: "Formatted at 2026-08-11 08:12:38 on dist-test-slave-7lbf"
server_key: "8535b2785d38c1ed2a4bcc53d33c76be"
server_key_iv: "09b5b44d232b4e7e40f3dc3b41ae4acd"
server_key_version: "encryptionkey@0"
I20260811 08:12:38.575254 27373 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435717191469-28623-0/minicluster-data/ts-2/wal/instance:
uuid: "92700a1c31ff498e90611b13ba54ad70"
format_stamp: "Formatted at 2026-08-11 08:12:38 on dist-test-slave-7lbf"
server_key: "8535b2785d38c1ed2a4bcc53d33c76be"
server_key_iv: "09b5b44d232b4e7e40f3dc3b41ae4acd"
server_key_version: "encryptionkey@0"
I20260811 08:12:38.576460 27373 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260811 08:12:38.577128 27402 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:12:38.577267 27373 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 08:12:38.577348 27373 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435717191469-28623-0/minicluster-data/ts-2/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435717191469-28623-0/minicluster-data/ts-2/wal
uuid: "92700a1c31ff498e90611b13ba54ad70"
format_stamp: "Formatted at 2026-08-11 08:12:38 on dist-test-slave-7lbf"
server_key: "8535b2785d38c1ed2a4bcc53d33c76be"
server_key_iv: "09b5b44d232b4e7e40f3dc3b41ae4acd"
server_key_version: "encryptionkey@0"
I20260811 08:12:38.577404 27373 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435717191469-28623-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435717191469-28623-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435717191469-28623-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:12:38.586829 27373 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:12:38.588519 27373 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:12:38.588624 27373 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:12:38.588792 27373 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:12:38.589046 27373 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:12:38.589075 27373 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:12:38.589094 27373 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:12:38.589105 27373 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:12:38.594610 27373 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.195:46521
I20260811 08:12:38.594708 27595 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.195:46521 every 8 connection(s)
I20260811 08:12:38.594954 27373 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435717191469-28623-0/minicluster-data/ts-2/data/info.pb
I20260811 08:12:38.595772 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 27373
I20260811 08:12:38.595844 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435717191469-28623-0/minicluster-data/ts-2/wal/instance
I20260811 08:12:38.596007 28623 external_mini_cluster.cc:1428] Setting key af1f98527712ebc70061e679f9165c94
Aug 11 08:12:38 dist-test-slave-7lbf krb5kdc[26700](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435958, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.195@KRBTEST.COM for kudu/127.27.243.254@KRBTEST.COM
I20260811 08:12:38.603456 26845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:38.595655 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.195:37255 (local address 127.27.243.254:33315)
0811 08:12:38.595719 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0811 08:12:38.595721 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:12:38.595881 (+ 160us) server_negotiation.cc:407] Connection header received
0811 08:12:38.596457 (+ 576us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:12:38.596459 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:12:38.596471 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:12:38.596525 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:12:38.597485 (+ 960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:38.598013 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:38.598959 (+ 946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:38.599135 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:38.599176 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:38.601222 (+ 2046us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:12:38.601223 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:12:38.601223 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:12:38.601230 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:12:38.602351 (+ 1121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:12:38.602701 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:12:38.602701 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:12:38.602702 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:12:38.602746 (+ 44us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:12:38.602975 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:12:38.602976 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:12:38.602976 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:12:38.603079 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:12:38.603131 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 08:12:38.603335 (+ 204us) server_negotiation.cc:299] Negotiation successful
0811 08:12:38.603394 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 08:12:38.603645 27599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:38.595595 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:33315 (local address 127.27.243.195:37255)
0811 08:12:38.595753 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0811 08:12:38.595794 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 08:12:38.596373 (+ 579us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:12:38.596613 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:12:38.596618 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:12:38.597202 (+ 584us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:12:38.597401 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:12:38.597406 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:12:38.598092 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:12:38.598093 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:12:38.598894 (+ 801us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:12:38.598897 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:12:38.599187 (+ 290us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:12:38.599187 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:12:38.599282 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:38.599751 (+ 469us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:12:38.599759 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:12:38.601143 (+ 1384us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:12:38.602423 (+ 1280us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:12:38.602430 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:12:38.602432 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:12:38.602641 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:12:38.602790 (+ 149us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:12:38.602790 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:12:38.602790 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:12:38.602918 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:12:38.603129 (+ 211us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:12:38.603133 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:12:38.603241 (+ 108us) client_negotiation.cc:769] Sending connection context
0811 08:12:38.603317 (+ 76us) client_negotiation.cc:240] Negotiation successful
0811 08:12:38.603435 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":87,"threads_started":1}
I20260811 08:12:38.604069 27596 heartbeater.cc:347] Connected to a master server at 127.27.243.254:33315
I20260811 08:12:38.604157 27596 heartbeater.cc:464] Registering TS with master...
I20260811 08:12:38.604298 27596 heartbeater.cc:511] Master 127.27.243.254:33315 requested a full tablet report, sending...
I20260811 08:12:38.604629 26775 ts_manager.cc:194] Registered new tserver with Master: 92700a1c31ff498e90611b13ba54ad70 (127.27.243.195:46521)
I20260811 08:12:38.604984 26775 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.243.195@KRBTEST.COM'} at 127.27.243.195:37255
I20260811 08:12:38.607620 28623 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 08:12:38.614513 26845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:38.608819 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46022 (local address 127.27.243.254:33315)
0811 08:12:38.608855 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0811 08:12:38.608857 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:12:38.609014 (+ 157us) server_negotiation.cc:407] Connection header received
0811 08:12:38.609072 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:12:38.609073 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:12:38.609083 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:12:38.609126 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:12:38.609693 (+ 567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:38.610144 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:38.610842 (+ 698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:38.611028 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:38.611080 (+ 52us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:38.612247 (+ 1167us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:12:38.612248 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:12:38.612249 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:12:38.612255 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:12:38.613336 (+ 1081us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:12:38.613755 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:12:38.613756 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:12:38.613756 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:12:38.613804 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:12:38.613991 (+ 187us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:12:38.613992 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:12:38.613992 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:12:38.614121 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:12:38.614215 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0811 08:12:38.614367 (+ 152us) server_negotiation.cc:299] Negotiation successful
0811 08:12:38.614426 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 08:12:38.615892 26775 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46022:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 08:12:38.617465 26775 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 08:12:38.624030 27622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:38.619887 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.195:46521 (local address 127.0.0.1:37236)
0811 08:12:38.620343 (+ 456us) negotiation.cc:107] Waiting for socket to connect
0811 08:12:38.620352 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 08:12:38.620537 (+ 185us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:12:38.620737 (+ 200us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:12:38.620738 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:12:38.620740 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:12:38.620788 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:12:38.620790 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:12:38.621660 (+ 870us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:12:38.621661 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:12:38.622890 (+ 1229us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:12:38.622894 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:12:38.623723 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:12:38.623724 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:12:38.623802 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:38.623817 (+ 15us) client_negotiation.cc:769] Sending connection context
0811 08:12:38.623896 (+ 79us) client_negotiation.cc:240] Negotiation successful
0811 08:12:38.623949 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":442,"thread_start_us":69,"threads_started":1}
I20260811 08:12:38.624158 27620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:38.619825 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55504 (local address 127.27.243.194:36883)
0811 08:12:38.620045 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0811 08:12:38.620050 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 08:12:38.620419 (+ 369us) server_negotiation.cc:407] Connection header received
0811 08:12:38.620501 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:12:38.620503 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:12:38.620519 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:12:38.620590 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:12:38.620775 (+ 185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:38.621907 (+ 1132us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:38.623170 (+ 1263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:38.623833 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:38.623902 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:38.623955 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 08:12:38.624048 (+ 93us) server_negotiation.cc:299] Negotiation successful
0811 08:12:38.624082 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":178,"thread_start_us":88,"threads_started":1}
I20260811 08:12:38.624526 27624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:38.620006 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37236 (local address 127.27.243.195:46521)
0811 08:12:38.620155 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0811 08:12:38.620159 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 08:12:38.620507 (+ 348us) server_negotiation.cc:407] Connection header received
0811 08:12:38.620643 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:12:38.620645 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:12:38.620661 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:12:38.620739 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:12:38.620846 (+ 107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:38.621554 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:38.622972 (+ 1418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:38.623627 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:38.623703 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:38.623757 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 08:12:38.624386 (+ 629us) server_negotiation.cc:299] Negotiation successful
0811 08:12:38.624434 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":122,"thread_start_us":93,"threads_started":1}
I20260811 08:12:38.624136 27612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:38.619697 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.194:36883 (local address 127.0.0.1:55504)
0811 08:12:38.620294 (+ 597us) negotiation.cc:107] Waiting for socket to connect
0811 08:12:38.620303 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 08:12:38.620364 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:12:38.620671 (+ 307us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:12:38.620672 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:12:38.620673 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:12:38.620704 (+ 31us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:12:38.620705 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:12:38.622012 (+ 1307us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:12:38.622014 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:12:38.623082 (+ 1068us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:12:38.623085 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:12:38.623906 (+ 821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:12:38.623907 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:12:38.623971 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:38.623975 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 08:12:38.624023 (+ 48us) client_negotiation.cc:240] Negotiation successful
0811 08:12:38.624066 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":572,"thread_start_us":73,"threads_started":1}
I20260811 08:12:38.625396 27485 tablet_service.cc:1467] Processing CreateTablet for tablet 65fc0b43c3fd46519501e14a39f7984c (DEFAULT_TABLE table=test-table [id=a5666609c9f44f97adca6babaec1e271]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:12:38.625751 27485 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 65fc0b43c3fd46519501e14a39f7984c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:12:38.625919 27254 tablet_service.cc:1467] Processing CreateTablet for tablet 65fc0b43c3fd46519501e14a39f7984c (DEFAULT_TABLE table=test-table [id=a5666609c9f44f97adca6babaec1e271]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:12:38.626210 27254 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 65fc0b43c3fd46519501e14a39f7984c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:12:38.628659 27625 tablet_bootstrap.cc:492] T 65fc0b43c3fd46519501e14a39f7984c P 92700a1c31ff498e90611b13ba54ad70: Bootstrap starting.
I20260811 08:12:38.628724 27626 tablet_bootstrap.cc:492] T 65fc0b43c3fd46519501e14a39f7984c P 6b143ad456394f698ace54c6684c832b: Bootstrap starting.
I20260811 08:12:38.629149 27613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:38.619694 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.193:45791 (local address 127.0.0.1:40446)
0811 08:12:38.620117 (+ 423us) negotiation.cc:107] Waiting for socket to connect
0811 08:12:38.620156 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 08:12:38.620228 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:12:38.620592 (+ 364us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:12:38.620595 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:12:38.620597 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:12:38.620667 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:12:38.620669 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:12:38.623169 (+ 2500us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:12:38.623169 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:12:38.623893 (+ 724us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:12:38.623896 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:12:38.628884 (+ 4988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:12:38.628885 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:12:38.628966 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:38.628971 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 08:12:38.629027 (+ 56us) client_negotiation.cc:240] Negotiation successful
0811 08:12:38.629075 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":389,"thread_start_us":57,"threads_started":1}
I20260811 08:12:38.629390 27615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:38.619816 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40446 (local address 127.27.243.193:45791)
0811 08:12:38.620223 (+ 407us) server_negotiation.cc:206] Beginning negotiation
0811 08:12:38.620227 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 08:12:38.620240 (+ 13us) server_negotiation.cc:407] Connection header received
0811 08:12:38.620340 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:12:38.620343 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:12:38.620360 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:12:38.620452 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:12:38.620745 (+ 293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:38.621898 (+ 1153us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:38.623987 (+ 2089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:38.624792 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:38.628773 (+ 3981us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:38.628843 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 08:12:38.629265 (+ 422us) server_negotiation.cc:299] Negotiation successful
0811 08:12:38.629312 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":367,"thread_start_us":88,"threads_started":1}
I20260811 08:12:38.629410 27625 tablet_bootstrap.cc:654] T 65fc0b43c3fd46519501e14a39f7984c P 92700a1c31ff498e90611b13ba54ad70: Neither blocks nor log segments found. Creating new log.
I20260811 08:12:38.629479 27626 tablet_bootstrap.cc:654] T 65fc0b43c3fd46519501e14a39f7984c P 6b143ad456394f698ace54c6684c832b: Neither blocks nor log segments found. Creating new log.
I20260811 08:12:38.629979 27626 log.cc:824] T 65fc0b43c3fd46519501e14a39f7984c P 6b143ad456394f698ace54c6684c832b: Log is configured to *not* fsync() on all Append() calls
I20260811 08:12:38.630119 26992 tablet_service.cc:1467] Processing CreateTablet for tablet 65fc0b43c3fd46519501e14a39f7984c (DEFAULT_TABLE table=test-table [id=a5666609c9f44f97adca6babaec1e271]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:12:38.630239 27625 log.cc:824] T 65fc0b43c3fd46519501e14a39f7984c P 92700a1c31ff498e90611b13ba54ad70: Log is configured to *not* fsync() on all Append() calls
I20260811 08:12:38.630478 26992 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 65fc0b43c3fd46519501e14a39f7984c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:12:38.630749 27626 tablet_bootstrap.cc:492] T 65fc0b43c3fd46519501e14a39f7984c P 6b143ad456394f698ace54c6684c832b: No bootstrap required, opened a new log
I20260811 08:12:38.630817 27626 ts_tablet_manager.cc:1397] T 65fc0b43c3fd46519501e14a39f7984c P 6b143ad456394f698ace54c6684c832b: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 08:12:38.631028 27625 tablet_bootstrap.cc:492] T 65fc0b43c3fd46519501e14a39f7984c P 92700a1c31ff498e90611b13ba54ad70: No bootstrap required, opened a new log
I20260811 08:12:38.631107 27625 ts_tablet_manager.cc:1397] T 65fc0b43c3fd46519501e14a39f7984c P 92700a1c31ff498e90611b13ba54ad70: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 08:12:38.632462 27626 raft_consensus.cc:348] T 65fc0b43c3fd46519501e14a39f7984c P 6b143ad456394f698ace54c6684c832b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b1aa1a8c3c4c948593aea8a926a16d" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 45791 } } peers { permanent_uuid: "92700a1c31ff498e90611b13ba54ad70" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 46521 } } peers { permanent_uuid: "6b143ad456394f698ace54c6684c832b" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 36883 } }
I20260811 08:12:38.632632 27626 raft_consensus.cc:374] T 65fc0b43c3fd46519501e14a39f7984c P 6b143ad456394f698ace54c6684c832b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:12:38.632670 27626 raft_consensus.cc:729] T 65fc0b43c3fd46519501e14a39f7984c P 6b143ad456394f698ace54c6684c832b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b143ad456394f698ace54c6684c832b, State: Initialized, Role: FOLLOWER
I20260811 08:12:38.632802 27626 consensus_queue.cc:260] T 65fc0b43c3fd46519501e14a39f7984c P 6b143ad456394f698ace54c6684c832b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b1aa1a8c3c4c948593aea8a926a16d" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 45791 } } peers { permanent_uuid: "92700a1c31ff498e90611b13ba54ad70" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 46521 } } peers { permanent_uuid: "6b143ad456394f698ace54c6684c832b" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 36883 } }
I20260811 08:12:38.633061 27626 ts_tablet_manager.cc:1428] T 65fc0b43c3fd46519501e14a39f7984c P 6b143ad456394f698ace54c6684c832b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 08:12:38.633181 27367 heartbeater.cc:503] Master 127.27.243.254:33315 was elected leader, sending a full tablet report...
I20260811 08:12:38.633074 27625 raft_consensus.cc:348] T 65fc0b43c3fd46519501e14a39f7984c P 92700a1c31ff498e90611b13ba54ad70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b1aa1a8c3c4c948593aea8a926a16d" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 45791 } } peers { permanent_uuid: "92700a1c31ff498e90611b13ba54ad70" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 46521 } } peers { permanent_uuid: "6b143ad456394f698ace54c6684c832b" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 36883 } }
I20260811 08:12:38.633244 27625 raft_consensus.cc:374] T 65fc0b43c3fd46519501e14a39f7984c P 92700a1c31ff498e90611b13ba54ad70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:12:38.633306 27625 raft_consensus.cc:729] T 65fc0b43c3fd46519501e14a39f7984c P 92700a1c31ff498e90611b13ba54ad70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92700a1c31ff498e90611b13ba54ad70, State: Initialized, Role: FOLLOWER
I20260811 08:12:38.633435 27625 consensus_queue.cc:260] T 65fc0b43c3fd46519501e14a39f7984c P 92700a1c31ff498e90611b13ba54ad70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b1aa1a8c3c4c948593aea8a926a16d" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 45791 } } peers { permanent_uuid: "92700a1c31ff498e90611b13ba54ad70" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 46521 } } peers { permanent_uuid: "6b143ad456394f698ace54c6684c832b" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 36883 } }
I20260811 08:12:38.633765 27625 ts_tablet_manager.cc:1428] T 65fc0b43c3fd46519501e14a39f7984c P 92700a1c31ff498e90611b13ba54ad70: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260811 08:12:38.633812 27596 heartbeater.cc:503] Master 127.27.243.254:33315 was elected leader, sending a full tablet report...
I20260811 08:12:38.634022 27632 tablet_bootstrap.cc:492] T 65fc0b43c3fd46519501e14a39f7984c P e1b1aa1a8c3c4c948593aea8a926a16d: Bootstrap starting.
I20260811 08:12:38.634750 27632 tablet_bootstrap.cc:654] T 65fc0b43c3fd46519501e14a39f7984c P e1b1aa1a8c3c4c948593aea8a926a16d: Neither blocks nor log segments found. Creating new log.
I20260811 08:12:38.635238 27632 log.cc:824] T 65fc0b43c3fd46519501e14a39f7984c P e1b1aa1a8c3c4c948593aea8a926a16d: Log is configured to *not* fsync() on all Append() calls
I20260811 08:12:38.635946 27632 tablet_bootstrap.cc:492] T 65fc0b43c3fd46519501e14a39f7984c P e1b1aa1a8c3c4c948593aea8a926a16d: No bootstrap required, opened a new log
I20260811 08:12:38.636003 27632 ts_tablet_manager.cc:1397] T 65fc0b43c3fd46519501e14a39f7984c P e1b1aa1a8c3c4c948593aea8a926a16d: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 08:12:38.637316 27632 raft_consensus.cc:348] T 65fc0b43c3fd46519501e14a39f7984c P e1b1aa1a8c3c4c948593aea8a926a16d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b1aa1a8c3c4c948593aea8a926a16d" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 45791 } } peers { permanent_uuid: "92700a1c31ff498e90611b13ba54ad70" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 46521 } } peers { permanent_uuid: "6b143ad456394f698ace54c6684c832b" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 36883 } }
I20260811 08:12:38.637454 27632 raft_consensus.cc:374] T 65fc0b43c3fd46519501e14a39f7984c P e1b1aa1a8c3c4c948593aea8a926a16d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:12:38.637485 27632 raft_consensus.cc:729] T 65fc0b43c3fd46519501e14a39f7984c P e1b1aa1a8c3c4c948593aea8a926a16d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1b1aa1a8c3c4c948593aea8a926a16d, State: Initialized, Role: FOLLOWER
I20260811 08:12:38.637648 27632 consensus_queue.cc:260] T 65fc0b43c3fd46519501e14a39f7984c P e1b1aa1a8c3c4c948593aea8a926a16d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b1aa1a8c3c4c948593aea8a926a16d" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 45791 } } peers { permanent_uuid: "92700a1c31ff498e90611b13ba54ad70" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 46521 } } peers { permanent_uuid: "6b143ad456394f698ace54c6684c832b" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 36883 } }
I20260811 08:12:38.637903 27632 ts_tablet_manager.cc:1428] T 65fc0b43c3fd46519501e14a39f7984c P e1b1aa1a8c3c4c948593aea8a926a16d: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260811 08:12:38.637950 27114 heartbeater.cc:503] Master 127.27.243.254:33315 was elected leader, sending a full tablet report...
W20260811 08:12:38.699157 27368 tablet.cc:2369] T 65fc0b43c3fd46519501e14a39f7984c P 6b143ad456394f698ace54c6684c832b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 08:12:38.713156 27629 raft_consensus.cc:482] T 65fc0b43c3fd46519501e14a39f7984c P 6b143ad456394f698ace54c6684c832b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:12:38.713299 27629 raft_consensus.cc:504] T 65fc0b43c3fd46519501e14a39f7984c P 6b143ad456394f698ace54c6684c832b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b1aa1a8c3c4c948593aea8a926a16d" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 45791 } } peers { permanent_uuid: "92700a1c31ff498e90611b13ba54ad70" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 46521 } } peers { permanent_uuid: "6b143ad456394f698ace54c6684c832b" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 36883 } }
I20260811 08:12:38.713737 27629 leader_election.cc:288] T 65fc0b43c3fd46519501e14a39f7984c P 6b143ad456394f698ace54c6684c832b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1b1aa1a8c3c4c948593aea8a926a16d (127.27.243.193:45791), 92700a1c31ff498e90611b13ba54ad70 (127.27.243.195:46521)
I20260811 08:12:38.716766 27369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:38.713912 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.193:45791 (local address 127.27.243.194:59409)
0811 08:12:38.713968 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0811 08:12:38.713980 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 08:12:38.714024 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:12:38.714225 (+ 201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:12:38.714226 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:12:38.714228 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:12:38.714298 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:12:38.714300 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:12:38.715059 (+ 759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:12:38.715060 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:12:38.715912 (+ 852us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:12:38.715915 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:12:38.716524 (+ 609us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:12:38.716525 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:12:38.716601 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:38.716605 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 08:12:38.716657 (+ 52us) client_negotiation.cc:240] Negotiation successful
0811 08:12:38.716696 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33,"mutex_wait_us":33}
I20260811 08:12:38.716776 27615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:38.714004 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.194:59409 (local address 127.27.243.193:45791)
0811 08:12:38.714068 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0811 08:12:38.714070 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:12:38.714081 (+ 11us) server_negotiation.cc:407] Connection header received
0811 08:12:38.714113 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:12:38.714114 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:12:38.714125 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:12:38.714202 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:12:38.714408 (+ 206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:38.714961 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:38.716015 (+ 1054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:38.716446 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:38.716502 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:38.716510 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 08:12:38.716668 (+ 158us) server_negotiation.cc:299] Negotiation successful
0811 08:12:38.716709 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 08:12:38.716858 27624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:38.714142 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.194:51067 (local address 127.27.243.195:46521)
0811 08:12:38.714209 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0811 08:12:38.714211 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:12:38.714317 (+ 106us) server_negotiation.cc:407] Connection header received
0811 08:12:38.714367 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:12:38.714368 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:12:38.714379 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:12:38.714429 (+ 50us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:12:38.714627 (+ 198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:38.715127 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:38.716133 (+ 1006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:38.716534 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:38.716601 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:38.716609 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 08:12:38.716753 (+ 144us) server_negotiation.cc:299] Negotiation successful
0811 08:12:38.716790 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260811 08:12:38.716882 27637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:38.714049 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.195:46521 (local address 127.27.243.194:51067)
0811 08:12:38.714247 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0811 08:12:38.714259 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 08:12:38.714319 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:12:38.714447 (+ 128us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:12:38.714448 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:12:38.714449 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:12:38.714526 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:12:38.714528 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:12:38.715233 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:12:38.715234 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:12:38.716047 (+ 813us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:12:38.716050 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:12:38.716615 (+ 565us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:12:38.716616 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:12:38.716680 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:38.716685 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 08:12:38.716736 (+ 51us) client_negotiation.cc:240] Negotiation successful
0811 08:12:38.716772 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":176,"mutex_wait_us":2,"thread_start_us":115,"threads_started":1}
I20260811 08:12:38.717180 27022 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "65fc0b43c3fd46519501e14a39f7984c" candidate_uuid: "6b143ad456394f698ace54c6684c832b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1b1aa1a8c3c4c948593aea8a926a16d" is_pre_election: true
I20260811 08:12:38.717171 27529 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "65fc0b43c3fd46519501e14a39f7984c" candidate_uuid: "6b143ad456394f698ace54c6684c832b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92700a1c31ff498e90611b13ba54ad70" is_pre_election: true
I20260811 08:12:38.717329 27022 raft_consensus.cc:2454] T 65fc0b43c3fd46519501e14a39f7984c P e1b1aa1a8c3c4c948593aea8a926a16d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b143ad456394f698ace54c6684c832b in term 0.
I20260811 08:12:38.717329 27529 raft_consensus.cc:2454] T 65fc0b43c3fd46519501e14a39f7984c P 92700a1c31ff498e90611b13ba54ad70 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b143ad456394f698ace54c6684c832b in term 0.
I20260811 08:12:38.717588 27150 leader_election.cc:302] T 65fc0b43c3fd46519501e14a39f7984c P 6b143ad456394f698ace54c6684c832b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b143ad456394f698ace54c6684c832b, e1b1aa1a8c3c4c948593aea8a926a16d; no voters:
I20260811 08:12:38.717711 27629 raft_consensus.cc:2781] T 65fc0b43c3fd46519501e14a39f7984c P 6b143ad456394f698ace54c6684c832b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 08:12:38.717775 27629 raft_consensus.cc:482] T 65fc0b43c3fd46519501e14a39f7984c P 6b143ad456394f698ace54c6684c832b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 08:12:38.717854 27629 raft_consensus.cc:3037] T 65fc0b43c3fd46519501e14a39f7984c P 6b143ad456394f698ace54c6684c832b [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:12:38.718559 27629 raft_consensus.cc:504] T 65fc0b43c3fd46519501e14a39f7984c P 6b143ad456394f698ace54c6684c832b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b1aa1a8c3c4c948593aea8a926a16d" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 45791 } } peers { permanent_uuid: "92700a1c31ff498e90611b13ba54ad70" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 46521 } } peers { permanent_uuid: "6b143ad456394f698ace54c6684c832b" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 36883 } }
I20260811 08:12:38.718675 27629 leader_election.cc:288] T 65fc0b43c3fd46519501e14a39f7984c P 6b143ad456394f698ace54c6684c832b [CANDIDATE]: Term 1 election: Requested vote from peers e1b1aa1a8c3c4c948593aea8a926a16d (127.27.243.193:45791), 92700a1c31ff498e90611b13ba54ad70 (127.27.243.195:46521)
I20260811 08:12:38.718819 27022 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "65fc0b43c3fd46519501e14a39f7984c" candidate_uuid: "6b143ad456394f698ace54c6684c832b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1b1aa1a8c3c4c948593aea8a926a16d"
I20260811 08:12:38.718855 27529 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "65fc0b43c3fd46519501e14a39f7984c" candidate_uuid: "6b143ad456394f698ace54c6684c832b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92700a1c31ff498e90611b13ba54ad70"
I20260811 08:12:38.718915 27529 raft_consensus.cc:3037] T 65fc0b43c3fd46519501e14a39f7984c P 92700a1c31ff498e90611b13ba54ad70 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:12:38.718916 27022 raft_consensus.cc:3037] T 65fc0b43c3fd46519501e14a39f7984c P e1b1aa1a8c3c4c948593aea8a926a16d [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:12:38.719848 27529 raft_consensus.cc:2454] T 65fc0b43c3fd46519501e14a39f7984c P 92700a1c31ff498e90611b13ba54ad70 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b143ad456394f698ace54c6684c832b in term 1.
I20260811 08:12:38.719905 27022 raft_consensus.cc:2454] T 65fc0b43c3fd46519501e14a39f7984c P e1b1aa1a8c3c4c948593aea8a926a16d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b143ad456394f698ace54c6684c832b in term 1.
I20260811 08:12:38.720050 27150 leader_election.cc:302] T 65fc0b43c3fd46519501e14a39f7984c P 6b143ad456394f698ace54c6684c832b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b143ad456394f698ace54c6684c832b, e1b1aa1a8c3c4c948593aea8a926a16d; no voters:
I20260811 08:12:38.720153 27629 raft_consensus.cc:2781] T 65fc0b43c3fd46519501e14a39f7984c P 6b143ad456394f698ace54c6684c832b [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:12:38.720327 27629 raft_consensus.cc:686] T 65fc0b43c3fd46519501e14a39f7984c P 6b143ad456394f698ace54c6684c832b [term 1 LEADER]: Becoming Leader. State: Replica: 6b143ad456394f698ace54c6684c832b, State: Running, Role: LEADER
I20260811 08:12:38.720436 27629 consensus_queue.cc:237] T 65fc0b43c3fd46519501e14a39f7984c P 6b143ad456394f698ace54c6684c832b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b1aa1a8c3c4c948593aea8a926a16d" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 45791 } } peers { permanent_uuid: "92700a1c31ff498e90611b13ba54ad70" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 46521 } } peers { permanent_uuid: "6b143ad456394f698ace54c6684c832b" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 36883 } }
I20260811 08:12:38.721396 26774 catalog_manager.cc:5495] T 65fc0b43c3fd46519501e14a39f7984c P 6b143ad456394f698ace54c6684c832b reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b143ad456394f698ace54c6684c832b (127.27.243.194). New cstate: current_term: 1 leader_uuid: "6b143ad456394f698ace54c6684c832b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b1aa1a8c3c4c948593aea8a926a16d" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 45791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92700a1c31ff498e90611b13ba54ad70" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 46521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b143ad456394f698ace54c6684c832b" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 36883 } health_report { overall_health: HEALTHY } } }
I20260811 08:12:38.738826 27620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:38.736559 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55512 (local address 127.27.243.194:36883)
0811 08:12:38.736606 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 08:12:38.736608 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:12:38.736618 (+ 10us) server_negotiation.cc:407] Connection header received
0811 08:12:38.736675 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:12:38.736676 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:12:38.736692 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:12:38.736749 (+ 57us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:12:38.736858 (+ 109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:38.737314 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:38.738119 (+ 805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:38.738303 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:38.738358 (+ 55us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:38.738503 (+ 145us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:12:38.738590 (+ 87us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:12:38.738672 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0811 08:12:38.738737 (+ 65us) server_negotiation.cc:299] Negotiation successful
0811 08:12:38.738748 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 08:12:38.740533 27529 raft_consensus.cc:1261] T 65fc0b43c3fd46519501e14a39f7984c P 92700a1c31ff498e90611b13ba54ad70 [term 1 FOLLOWER]: Refusing update from remote peer 6b143ad456394f698ace54c6684c832b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:12:38.740535 27022 raft_consensus.cc:1261] T 65fc0b43c3fd46519501e14a39f7984c P e1b1aa1a8c3c4c948593aea8a926a16d [term 1 FOLLOWER]: Refusing update from remote peer 6b143ad456394f698ace54c6684c832b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:12:38.740914 27639 consensus_queue.cc:1035] T 65fc0b43c3fd46519501e14a39f7984c P 6b143ad456394f698ace54c6684c832b [LEADER]: Connected to new peer: Peer: permanent_uuid: "92700a1c31ff498e90611b13ba54ad70" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 46521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:12:38.741039 27629 consensus_queue.cc:1035] T 65fc0b43c3fd46519501e14a39f7984c P 6b143ad456394f698ace54c6684c832b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1b1aa1a8c3c4c948593aea8a926a16d" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 45791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:12:38.743598 27644 mvcc.cc:205] Tried to move back new op lower bound from 7317241686998540288 to 7317241686919495680. Current Snapshot: MvccSnapshot[applied={T|T < 7317241686998540288}]
I20260811 08:12:38.743805 27645 mvcc.cc:205] Tried to move back new op lower bound from 7317241686998540288 to 7317241686919495680. Current Snapshot: MvccSnapshot[applied={T|T < 7317241686998540288}]
I20260811 08:12:38.744464 27642 mvcc.cc:205] Tried to move back new op lower bound from 7317241686998540288 to 7317241686919495680. Current Snapshot: MvccSnapshot[applied={T|T < 7317241686998540288 or (T in {7317241686998540288})}]
I20260811 08:12:38.745560 26775 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46022:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:12:38.745682 26775 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46022:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:12:38.746480 26775 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5594a89020e540269de3df92ecf0ba2c: Sending DeleteTablet for 3 replicas of tablet 65fc0b43c3fd46519501e14a39f7984c
I20260811 08:12:38.746819 27485 tablet_service.cc:1514] Processing DeleteTablet for tablet 65fc0b43c3fd46519501e14a39f7984c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:12:38 UTC) from {username='kudu', principal='kudu/127.27.243.254@KRBTEST.COM'} at 127.0.0.1:37236
I20260811 08:12:38.746866 26992 tablet_service.cc:1514] Processing DeleteTablet for tablet 65fc0b43c3fd46519501e14a39f7984c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:12:38 UTC) from {username='kudu', principal='kudu/127.27.243.254@KRBTEST.COM'} at 127.0.0.1:40446
I20260811 08:12:38.746847 27254 tablet_service.cc:1514] Processing DeleteTablet for tablet 65fc0b43c3fd46519501e14a39f7984c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:12:38 UTC) from {username='kudu', principal='kudu/127.27.243.254@KRBTEST.COM'} at 127.0.0.1:55504
I20260811 08:12:38.747148 27659 tablet_replica.cc:330] T 65fc0b43c3fd46519501e14a39f7984c P 6b143ad456394f698ace54c6684c832b: stopping tablet replica
I20260811 08:12:38.747251 27659 raft_consensus.cc:2229] T 65fc0b43c3fd46519501e14a39f7984c P 6b143ad456394f698ace54c6684c832b [term 1 LEADER]: Raft consensus shutting down.
I20260811 08:12:38.747344 27659 raft_consensus.cc:2258] T 65fc0b43c3fd46519501e14a39f7984c P 6b143ad456394f698ace54c6684c832b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:12:38.747390 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 26881
I20260811 08:12:38.754195 27659 ts_tablet_manager.cc:1905] T 65fc0b43c3fd46519501e14a39f7984c P 6b143ad456394f698ace54c6684c832b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:12:38.756121 27659 ts_tablet_manager.cc:1918] T 65fc0b43c3fd46519501e14a39f7984c P 6b143ad456394f698ace54c6684c832b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:12:38.756289 27659 log.cc:1196] T 65fc0b43c3fd46519501e14a39f7984c P 6b143ad456394f698ace54c6684c832b: Deleting WAL directory at /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435717191469-28623-0/minicluster-data/ts-1/wal/wals/65fc0b43c3fd46519501e14a39f7984c
I20260811 08:12:38.756671 27659 ts_tablet_manager.cc:1939] T 65fc0b43c3fd46519501e14a39f7984c P 6b143ad456394f698ace54c6684c832b: Deleting consensus metadata
I20260811 08:12:38.757481 26751 catalog_manager.cc:4841] TS 6b143ad456394f698ace54c6684c832b (127.27.243.194:36883): tablet 65fc0b43c3fd46519501e14a39f7984c (table test-table [id=a5666609c9f44f97adca6babaec1e271]) successfully deleted
I20260811 08:12:38.757620 27657 tablet_replica.cc:330] T 65fc0b43c3fd46519501e14a39f7984c P 92700a1c31ff498e90611b13ba54ad70: stopping tablet replica
I20260811 08:12:38.757742 27657 raft_consensus.cc:2229] T 65fc0b43c3fd46519501e14a39f7984c P 92700a1c31ff498e90611b13ba54ad70 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:12:38.757864 27657 raft_consensus.cc:2258] T 65fc0b43c3fd46519501e14a39f7984c P 92700a1c31ff498e90611b13ba54ad70 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:12:38.759819 27657 ts_tablet_manager.cc:1905] T 65fc0b43c3fd46519501e14a39f7984c P 92700a1c31ff498e90611b13ba54ad70: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:12:38.761377 27657 ts_tablet_manager.cc:1918] T 65fc0b43c3fd46519501e14a39f7984c P 92700a1c31ff498e90611b13ba54ad70: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:12:38.761452 27657 log.cc:1196] T 65fc0b43c3fd46519501e14a39f7984c P 92700a1c31ff498e90611b13ba54ad70: Deleting WAL directory at /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435717191469-28623-0/minicluster-data/ts-2/wal/wals/65fc0b43c3fd46519501e14a39f7984c
I20260811 08:12:38.761746 27657 ts_tablet_manager.cc:1939] T 65fc0b43c3fd46519501e14a39f7984c P 92700a1c31ff498e90611b13ba54ad70: Deleting consensus metadata
I20260811 08:12:38.762181 26752 catalog_manager.cc:4841] TS 92700a1c31ff498e90611b13ba54ad70 (127.27.243.195:46521): tablet 65fc0b43c3fd46519501e14a39f7984c (table test-table [id=a5666609c9f44f97adca6babaec1e271]) successfully deleted
W20260811 08:12:38.764290 26752 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.27.243.193:45791 (error 108)
I20260811 08:12:38.764418 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 27120
I20260811 08:12:38.772284 27613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:38.772117 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.193:45791 (local address 127.0.0.1:40448)
0811 08:12:38.772193 (+ 76us) negotiation.cc:107] Waiting for socket to connect
0811 08:12:38.772244 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.193:45791: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260811 08:12:38.772418 26752 catalog_manager.cc:4584] TS e1b1aa1a8c3c4c948593aea8a926a16d (127.27.243.193:45791): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 65fc0b43c3fd46519501e14a39f7984c: Network error: Client connection negotiation failed: client connection to 127.27.243.193:45791: connect: Connection refused (error 111)
I20260811 08:12:38.790031 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 27373
I20260811 08:12:38.797577 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 26722
2026-08-11T08:12:38Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (2148 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-11T08:12:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:12:38Z Disabled control of system clock
I20260811 08:12:38.835220 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435717191469-28623-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435717191469-28623-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435717191469-28623-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.243.254:40613
--webserver_interface=127.27.243.254
--webserver_port=0
--builtin_ntp_servers=127.27.243.212:40619
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.243.254:40613
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 08:12:38.916946 27677 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:12:38.917160 27677 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:12:38.917181 27677 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:12:38.918340 27677 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:12:38.918388 27677 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:12:38.918401 27677 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:12:38.918416 27677 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:12:38.918428 27677 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:12:38.920099 27677 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:40619
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435717191469-28623-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435717191469-28623-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.243.254:40613
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.243.254:40613
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.243.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27677
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435717191469-28623-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:12:38.920354 27677 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:12:38.920644 27677 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:12:38.925251 27692 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:12:38.925310 27686 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:12:38.925263 27685 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:12:38.925292 27677 server_base.cc:1034] running on GCE node
I20260811 08:12:38.925665 27677 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:12:38.925954 27677 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:12:38.927107 27677 hybrid_clock.cc:648] HybridClock initialized: now 1786435958927071 us; error 52 us; skew 500 ppm
I20260811 08:12:38.931569 27677 webserver.cc:460] Webserver started at http://127.27.243.254:37417/ using document root <none> and password file <none>
I20260811 08:12:38.931787 27677 fs_manager.cc:359] Metadata directory not provided
I20260811 08:12:38.931834 27677 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:12:38.931959 27677 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:12:38.933005 27677 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435717191469-28623-0/minicluster-data/master-0/data/instance:
uuid: "005e60e2870b4f48bd76c93ba9c3a378"
format_stamp: "Formatted at 2026-08-11 08:12:38 on dist-test-slave-7lbf"
server_key: "c50d760f81b4706891b290ffd7129f9e"
server_key_iv: "ca75a92bdc8c21ea256122a8e98e1002"
server_key_version: "encryptionkey@0"
I20260811 08:12:38.933339 27677 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435717191469-28623-0/minicluster-data/master-0/wal/instance:
uuid: "005e60e2870b4f48bd76c93ba9c3a378"
format_stamp: "Formatted at 2026-08-11 08:12:38 on dist-test-slave-7lbf"
server_key: "c50d760f81b4706891b290ffd7129f9e"
server_key_iv: "ca75a92bdc8c21ea256122a8e98e1002"
server_key_version: "encryptionkey@0"
I20260811 08:12:38.934585 27677 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:12:38.935393 27700 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:12:38.935562 27677 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:12:38.935652 27677 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435717191469-28623-0/minicluster-data/master-0/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435717191469-28623-0/minicluster-data/master-0/wal
uuid: "005e60e2870b4f48bd76c93ba9c3a378"
format_stamp: "Formatted at 2026-08-11 08:12:38 on dist-test-slave-7lbf"
server_key: "c50d760f81b4706891b290ffd7129f9e"
server_key_iv: "ca75a92bdc8c21ea256122a8e98e1002"
server_key_version: "encryptionkey@0"
I20260811 08:12:38.935714 27677 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435717191469-28623-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435717191469-28623-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435717191469-28623-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:12:38.950649 27677 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:12:38.950907 27677 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:12:38.951032 27677 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:12:38.954866 27677 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.254:40613
I20260811 08:12:38.954921 27783 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.254:40613 every 8 connection(s)
I20260811 08:12:38.955206 27677 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
I20260811 08:12:38.956112 27784 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:12:38.958422 27784 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 005e60e2870b4f48bd76c93ba9c3a378: Bootstrap starting.
I20260811 08:12:38.959010 27784 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 005e60e2870b4f48bd76c93ba9c3a378: Neither blocks nor log segments found. Creating new log.
I20260811 08:12:38.959280 27784 log.cc:824] T 00000000000000000000000000000000 P 005e60e2870b4f48bd76c93ba9c3a378: Log is configured to *not* fsync() on all Append() calls
I20260811 08:12:38.959535 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 27677
I20260811 08:12:38.959635 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435717191469-28623-0/minicluster-data/master-0/wal/instance
I20260811 08:12:38.959781 28623 external_mini_cluster.cc:1428] Setting key ef275c25ab9e5a42bb98bad5fd38b5b4
I20260811 08:12:38.960073 27784 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 005e60e2870b4f48bd76c93ba9c3a378: No bootstrap required, opened a new log
I20260811 08:12:38.962563 27784 raft_consensus.cc:348] T 00000000000000000000000000000000 P 005e60e2870b4f48bd76c93ba9c3a378 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "005e60e2870b4f48bd76c93ba9c3a378" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 40613 } }
I20260811 08:12:38.962718 27784 raft_consensus.cc:374] T 00000000000000000000000000000000 P 005e60e2870b4f48bd76c93ba9c3a378 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:12:38.962762 27784 raft_consensus.cc:729] T 00000000000000000000000000000000 P 005e60e2870b4f48bd76c93ba9c3a378 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 005e60e2870b4f48bd76c93ba9c3a378, State: Initialized, Role: FOLLOWER
I20260811 08:12:38.962893 27784 consensus_queue.cc:260] T 00000000000000000000000000000000 P 005e60e2870b4f48bd76c93ba9c3a378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "005e60e2870b4f48bd76c93ba9c3a378" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 40613 } }
I20260811 08:12:38.962970 27784 raft_consensus.cc:388] T 00000000000000000000000000000000 P 005e60e2870b4f48bd76c93ba9c3a378 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:12:38.963006 27784 raft_consensus.cc:482] T 00000000000000000000000000000000 P 005e60e2870b4f48bd76c93ba9c3a378 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:12:38.963050 27784 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 005e60e2870b4f48bd76c93ba9c3a378 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:12:38.963686 27784 raft_consensus.cc:504] T 00000000000000000000000000000000 P 005e60e2870b4f48bd76c93ba9c3a378 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "005e60e2870b4f48bd76c93ba9c3a378" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 40613 } }
I20260811 08:12:38.963785 27784 leader_election.cc:302] T 00000000000000000000000000000000 P 005e60e2870b4f48bd76c93ba9c3a378 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 005e60e2870b4f48bd76c93ba9c3a378; no voters:
I20260811 08:12:38.963944 27784 leader_election.cc:288] T 00000000000000000000000000000000 P 005e60e2870b4f48bd76c93ba9c3a378 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:12:38.963985 27792 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 005e60e2870b4f48bd76c93ba9c3a378 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:12:38.964133 27792 raft_consensus.cc:686] T 00000000000000000000000000000000 P 005e60e2870b4f48bd76c93ba9c3a378 [term 1 LEADER]: Becoming Leader. State: Replica: 005e60e2870b4f48bd76c93ba9c3a378, State: Running, Role: LEADER
I20260811 08:12:38.964200 27784 sys_catalog.cc:564] T 00000000000000000000000000000000 P 005e60e2870b4f48bd76c93ba9c3a378 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:12:38.964308 27792 consensus_queue.cc:237] T 00000000000000000000000000000000 P 005e60e2870b4f48bd76c93ba9c3a378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "005e60e2870b4f48bd76c93ba9c3a378" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 40613 } }
I20260811 08:12:38.964613 27792 sys_catalog.cc:455] T 00000000000000000000000000000000 P 005e60e2870b4f48bd76c93ba9c3a378 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 005e60e2870b4f48bd76c93ba9c3a378. Latest consensus state: current_term: 1 leader_uuid: "005e60e2870b4f48bd76c93ba9c3a378" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "005e60e2870b4f48bd76c93ba9c3a378" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 40613 } } }
I20260811 08:12:38.964709 27792 sys_catalog.cc:458] T 00000000000000000000000000000000 P 005e60e2870b4f48bd76c93ba9c3a378 [sys.catalog]: This master's current role is: LEADER
I20260811 08:12:38.964892 27795 sys_catalog.cc:455] T 00000000000000000000000000000000 P 005e60e2870b4f48bd76c93ba9c3a378 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "005e60e2870b4f48bd76c93ba9c3a378" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "005e60e2870b4f48bd76c93ba9c3a378" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 40613 } } }
I20260811 08:12:38.965029 27795 sys_catalog.cc:458] T 00000000000000000000000000000000 P 005e60e2870b4f48bd76c93ba9c3a378 [sys.catalog]: This master's current role is: LEADER
I20260811 08:12:38.965049 27804 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:12:38.965646 27804 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:12:38.965866 27789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:38.960257 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53266 (local address 127.27.243.254:40613)
0811 08:12:38.960458 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0811 08:12:38.960465 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 08:12:38.960489 (+ 24us) server_negotiation.cc:407] Connection header received
0811 08:12:38.961233 (+ 744us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:12:38.961240 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:12:38.961296 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:12:38.961428 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:12:38.961702 (+ 274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:38.962583 (+ 881us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:38.963649 (+ 1066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:38.964153 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:38.964611 (+ 458us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:38.964923 (+ 312us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:12:38.964927 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:12:38.964928 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:12:38.965121 (+ 193us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:12:38.965167 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:12:38.965182 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:12:38.965506 (+ 324us) server_negotiation.cc:1035] Waiting for connection context
0811 08:12:38.965561 (+ 55us) server_negotiation.cc:299] Negotiation successful
0811 08:12:38.965638 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":74,"threads_started":1}
I20260811 08:12:38.967612 27804 catalog_manager.cc:1347] Generated new cluster ID: 1bcf5489b0f340b88f28d3524614a558
I20260811 08:12:38.967669 27804 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:12:38.988395 27804 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:12:38.988900 27804 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:12:38.993384 27804 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 005e60e2870b4f48bd76c93ba9c3a378: Generated new TSK 0
I20260811 08:12:38.993568 27804 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 08:12:39.000679 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435717191469-28623-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435717191469-28623-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435717191469-28623-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435717191469-28623-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.243.193:0
--local_ip_for_outbound_sockets=127.27.243.193
--webserver_interface=127.27.243.193
--webserver_port=0
--tserver_master_addrs=127.27.243.254:40613
--builtin_ntp_servers=127.27.243.212:40619
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 08:12:39.082752 27820 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:12:39.082944 27820 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:12:39.082964 27820 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:12:39.084056 27820 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:12:39.084096 27820 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:12:39.084120 27820 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.243.193
I20260811 08:12:39.085412 27820 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:40619
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435717191469-28623-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435717191469-28623-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.243.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435717191469-28623-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.243.193
--webserver_port=0
--tserver_master_addrs=127.27.243.254:40613
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27820
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.243.193
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435717191469-28623-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:12:39.085655 27820 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:12:39.085932 27820 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:12:39.091120 27827 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:12:39.091174 27830 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:12:39.091504 27826 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:12:39.091475 27820 server_base.cc:1034] running on GCE node
I20260811 08:12:39.091887 27820 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:12:39.092156 27820 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:12:39.093335 27820 hybrid_clock.cc:648] HybridClock initialized: now 1786435959093320 us; error 33 us; skew 500 ppm
I20260811 08:12:39.094583 27820 webserver.cc:460] Webserver started at http://127.27.243.193:34079/ using document root <none> and password file <none>
I20260811 08:12:39.094798 27820 fs_manager.cc:359] Metadata directory not provided
I20260811 08:12:39.094858 27820 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:12:39.094982 27820 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:12:39.096026 27820 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435717191469-28623-0/minicluster-data/ts-0/data/instance:
uuid: "2d132ec9fea2462e9ddb213443fb1ab7"
format_stamp: "Formatted at 2026-08-11 08:12:39 on dist-test-slave-7lbf"
server_key: "da771b10ffaa8daae12e8e93d9adefc3"
server_key_iv: "bea51c83ec7b46573824246621390b23"
server_key_version: "encryptionkey@0"
I20260811 08:12:39.096370 27820 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435717191469-28623-0/minicluster-data/ts-0/wal/instance:
uuid: "2d132ec9fea2462e9ddb213443fb1ab7"
format_stamp: "Formatted at 2026-08-11 08:12:39 on dist-test-slave-7lbf"
server_key: "da771b10ffaa8daae12e8e93d9adefc3"
server_key_iv: "bea51c83ec7b46573824246621390b23"
server_key_version: "encryptionkey@0"
I20260811 08:12:39.097622 27820 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 08:12:39.098361 27840 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:12:39.098521 27820 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 08:12:39.098604 27820 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435717191469-28623-0/minicluster-data/ts-0/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435717191469-28623-0/minicluster-data/ts-0/wal
uuid: "2d132ec9fea2462e9ddb213443fb1ab7"
format_stamp: "Formatted at 2026-08-11 08:12:39 on dist-test-slave-7lbf"
server_key: "da771b10ffaa8daae12e8e93d9adefc3"
server_key_iv: "bea51c83ec7b46573824246621390b23"
server_key_version: "encryptionkey@0"
I20260811 08:12:39.098673 27820 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435717191469-28623-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435717191469-28623-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435717191469-28623-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:12:39.114660 27820 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:12:39.114936 27820 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:12:39.115068 27820 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:12:39.115279 27820 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:12:39.115599 27820 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:12:39.115633 27820 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:12:39.115661 27820 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:12:39.115684 27820 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:12:39.121249 27820 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.193:37243
I20260811 08:12:39.121306 28014 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.193:37243 every 8 connection(s)
I20260811 08:12:39.121640 27820 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435717191469-28623-0/minicluster-data/ts-0/data/info.pb
I20260811 08:12:39.126703 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 27820
I20260811 08:12:39.126832 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435717191469-28623-0/minicluster-data/ts-0/wal/instance
I20260811 08:12:39.127004 27789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:39.122378 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.193:36141 (local address 127.27.243.254:40613)
0811 08:12:39.122443 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0811 08:12:39.122445 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:12:39.122686 (+ 241us) server_negotiation.cc:407] Connection header received
0811 08:12:39.123239 (+ 553us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:12:39.123240 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:12:39.123260 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:12:39.123338 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:12:39.124021 (+ 683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:39.124556 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:39.125575 (+ 1019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:39.125791 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:39.125850 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:39.126667 (+ 817us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:12:39.126668 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:12:39.126669 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:12:39.126673 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:12:39.126689 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:12:39.126693 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:12:39.126740 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0811 08:12:39.126913 (+ 173us) server_negotiation.cc:299] Negotiation successful
0811 08:12:39.126943 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260811 08:12:39.127058 28623 external_mini_cluster.cc:1428] Setting key f05d313ad580a780cb04a4b9f387c5e9
I20260811 08:12:39.127244 28020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:39.122364 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:40613 (local address 127.27.243.193:36141)
0811 08:12:39.122564 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0811 08:12:39.122598 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0811 08:12:39.123132 (+ 534us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:12:39.123408 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:12:39.123412 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:12:39.123421 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:12:39.123923 (+ 502us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:12:39.123928 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:12:39.124659 (+ 731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:12:39.124660 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:12:39.125461 (+ 801us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:12:39.125464 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:12:39.125878 (+ 414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:12:39.125879 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:12:39.126005 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:39.126506 (+ 501us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 08:12:39.126507 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:12:39.126547 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 08:12:39.126576 (+ 29us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:12:39.126747 (+ 171us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:12:39.126755 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:12:39.126758 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 08:12:39.126894 (+ 136us) client_negotiation.cc:240] Negotiation successful
0811 08:12:39.127012 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":85,"threads_started":1}
I20260811 08:12:39.127674 28016 heartbeater.cc:347] Connected to a master server at 127.27.243.254:40613
I20260811 08:12:39.127765 28016 heartbeater.cc:464] Registering TS with master...
I20260811 08:12:39.127938 28016 heartbeater.cc:511] Master 127.27.243.254:40613 requested a full tablet report, sending...
I20260811 08:12:39.128464 27724 ts_manager.cc:194] Registered new tserver with Master: 2d132ec9fea2462e9ddb213443fb1ab7 (127.27.243.193:37243)
I20260811 08:12:39.128608 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435717191469-28623-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435717191469-28623-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435717191469-28623-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435717191469-28623-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.243.194:0
--local_ip_for_outbound_sockets=127.27.243.194
--webserver_interface=127.27.243.194
--webserver_port=0
--tserver_master_addrs=127.27.243.254:40613
--builtin_ntp_servers=127.27.243.212:40619
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 08:12:39.129263 27724 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.27.243.193:36141
W20260811 08:12:39.210213 28021 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:12:39.210412 28021 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:12:39.210430 28021 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:12:39.211622 28021 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:12:39.211664 28021 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:12:39.211687 28021 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.243.194
I20260811 08:12:39.213013 28021 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:40619
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435717191469-28623-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435717191469-28623-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.243.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435717191469-28623-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.243.194
--webserver_port=0
--tserver_master_addrs=127.27.243.254:40613
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28021
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.243.194
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435717191469-28623-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:12:39.213236 28021 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:12:39.213542 28021 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:12:39.218250 28030 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:12:39.218279 28032 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:12:39.218297 28034 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:12:39.218528 28021 server_base.cc:1034] running on GCE node
I20260811 08:12:39.218741 28021 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:12:39.219004 28021 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:12:39.220160 28021 hybrid_clock.cc:648] HybridClock initialized: now 1786435959220148 us; error 35 us; skew 500 ppm
I20260811 08:12:39.221474 28021 webserver.cc:460] Webserver started at http://127.27.243.194:42669/ using document root <none> and password file <none>
I20260811 08:12:39.221737 28021 fs_manager.cc:359] Metadata directory not provided
I20260811 08:12:39.221791 28021 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:12:39.221994 28021 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:12:39.223061 28021 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435717191469-28623-0/minicluster-data/ts-1/data/instance:
uuid: "c554a14010e54aada86b7a2e7ee5e11f"
format_stamp: "Formatted at 2026-08-11 08:12:39 on dist-test-slave-7lbf"
server_key: "66944feeaa3e1942602d8291163217f5"
server_key_iv: "354e0fcd19d045f180b7002f41536e02"
server_key_version: "encryptionkey@0"
I20260811 08:12:39.223394 28021 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435717191469-28623-0/minicluster-data/ts-1/wal/instance:
uuid: "c554a14010e54aada86b7a2e7ee5e11f"
format_stamp: "Formatted at 2026-08-11 08:12:39 on dist-test-slave-7lbf"
server_key: "66944feeaa3e1942602d8291163217f5"
server_key_iv: "354e0fcd19d045f180b7002f41536e02"
server_key_version: "encryptionkey@0"
I20260811 08:12:39.224694 28021 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 08:12:39.225497 28051 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:12:39.225672 28021 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 08:12:39.225757 28021 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435717191469-28623-0/minicluster-data/ts-1/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435717191469-28623-0/minicluster-data/ts-1/wal
uuid: "c554a14010e54aada86b7a2e7ee5e11f"
format_stamp: "Formatted at 2026-08-11 08:12:39 on dist-test-slave-7lbf"
server_key: "66944feeaa3e1942602d8291163217f5"
server_key_iv: "354e0fcd19d045f180b7002f41536e02"
server_key_version: "encryptionkey@0"
I20260811 08:12:39.225831 28021 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435717191469-28623-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435717191469-28623-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435717191469-28623-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:12:39.241802 28021 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:12:39.242080 28021 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:12:39.242206 28021 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:12:39.242414 28021 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:12:39.242726 28021 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:12:39.242759 28021 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:12:39.242787 28021 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:12:39.242805 28021 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:12:39.248381 28021 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.194:37917
I20260811 08:12:39.248446 28242 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.194:37917 every 8 connection(s)
I20260811 08:12:39.248737 28021 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435717191469-28623-0/minicluster-data/ts-1/data/info.pb
I20260811 08:12:39.253630 27789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:39.249409 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.194:35375 (local address 127.27.243.254:40613)
0811 08:12:39.249490 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0811 08:12:39.249493 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:12:39.249732 (+ 239us) server_negotiation.cc:407] Connection header received
0811 08:12:39.250224 (+ 492us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:12:39.250225 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:12:39.250235 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:12:39.250284 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:12:39.250938 (+ 654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:39.251432 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:39.252402 (+ 970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:39.252599 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:39.252650 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:39.253413 (+ 763us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:12:39.253414 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:12:39.253414 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:12:39.253419 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:12:39.253432 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:12:39.253435 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:12:39.253474 (+ 39us) server_negotiation.cc:1035] Waiting for connection context
0811 08:12:39.253550 (+ 76us) server_negotiation.cc:299] Negotiation successful
0811 08:12:39.253570 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260811 08:12:39.253902 28250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:39.249399 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:40613 (local address 127.27.243.194:35375)
0811 08:12:39.249621 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0811 08:12:39.249654 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0811 08:12:39.250149 (+ 495us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:12:39.250341 (+ 192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:12:39.250344 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:12:39.250353 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:12:39.250853 (+ 500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:12:39.250858 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:12:39.251515 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:12:39.251516 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:12:39.252325 (+ 809us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:12:39.252328 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:12:39.252660 (+ 332us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:12:39.252660 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:12:39.252763 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:39.253284 (+ 521us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 08:12:39.253285 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:12:39.253318 (+ 33us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 08:12:39.253341 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:12:39.253482 (+ 141us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:12:39.253484 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:12:39.253486 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 08:12:39.253552 (+ 66us) client_negotiation.cc:240] Negotiation successful
0811 08:12:39.253648 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":84,"threads_started":1}
I20260811 08:12:39.254184 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 28021
I20260811 08:12:39.254307 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435717191469-28623-0/minicluster-data/ts-1/wal/instance
I20260811 08:12:39.254422 28243 heartbeater.cc:347] Connected to a master server at 127.27.243.254:40613
I20260811 08:12:39.254534 28243 heartbeater.cc:464] Registering TS with master...
I20260811 08:12:39.254549 28623 external_mini_cluster.cc:1428] Setting key 4cbe65c4801433684a07a8bb3c183ddf
I20260811 08:12:39.254738 28243 heartbeater.cc:511] Master 127.27.243.254:40613 requested a full tablet report, sending...
I20260811 08:12:39.255213 27724 ts_manager.cc:194] Registered new tserver with Master: c554a14010e54aada86b7a2e7ee5e11f (127.27.243.194:37917)
I20260811 08:12:39.255506 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435717191469-28623-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435717191469-28623-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435717191469-28623-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435717191469-28623-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.243.195:0
--local_ip_for_outbound_sockets=127.27.243.195
--webserver_interface=127.27.243.195
--webserver_port=0
--tserver_master_addrs=127.27.243.254:40613
--builtin_ntp_servers=127.27.243.212:40619
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 08:12:39.255684 27724 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.27.243.194:35375
W20260811 08:12:39.337177 28251 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:12:39.337368 28251 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:12:39.337387 28251 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:12:39.338581 28251 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:12:39.338625 28251 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:12:39.338649 28251 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.243.195
I20260811 08:12:39.339969 28251 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:40619
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435717191469-28623-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435717191469-28623-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.243.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435717191469-28623-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.243.195
--webserver_port=0
--tserver_master_addrs=127.27.243.254:40613
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28251
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.243.195
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435717191469-28623-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:12:39.340162 28251 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:12:39.340397 28251 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:12:39.345134 28259 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:12:39.345229 28251 server_base.cc:1034] running on GCE node
W20260811 08:12:39.345147 28263 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:12:39.345147 28261 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:12:39.345604 28251 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:12:39.345846 28251 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:12:39.346992 28251 hybrid_clock.cc:648] HybridClock initialized: now 1786435959346980 us; error 31 us; skew 500 ppm
I20260811 08:12:39.348147 28251 webserver.cc:460] Webserver started at http://127.27.243.195:33739/ using document root <none> and password file <none>
I20260811 08:12:39.348381 28251 fs_manager.cc:359] Metadata directory not provided
I20260811 08:12:39.348428 28251 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:12:39.348548 28251 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:12:39.349663 28251 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435717191469-28623-0/minicluster-data/ts-2/data/instance:
uuid: "371192f9ba8b44be8360c51690d0b369"
format_stamp: "Formatted at 2026-08-11 08:12:39 on dist-test-slave-7lbf"
server_key: "8496f0aae2931871f1b1dbb8adb234b7"
server_key_iv: "2ceafa97ef378db4b403b83ff2b5cf85"
server_key_version: "encryptionkey@0"
I20260811 08:12:39.349992 28251 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435717191469-28623-0/minicluster-data/ts-2/wal/instance:
uuid: "371192f9ba8b44be8360c51690d0b369"
format_stamp: "Formatted at 2026-08-11 08:12:39 on dist-test-slave-7lbf"
server_key: "8496f0aae2931871f1b1dbb8adb234b7"
server_key_iv: "2ceafa97ef378db4b403b83ff2b5cf85"
server_key_version: "encryptionkey@0"
I20260811 08:12:39.351207 28251 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 08:12:39.351861 28275 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:12:39.352020 28251 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 08:12:39.352100 28251 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435717191469-28623-0/minicluster-data/ts-2/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435717191469-28623-0/minicluster-data/ts-2/wal
uuid: "371192f9ba8b44be8360c51690d0b369"
format_stamp: "Formatted at 2026-08-11 08:12:39 on dist-test-slave-7lbf"
server_key: "8496f0aae2931871f1b1dbb8adb234b7"
server_key_iv: "2ceafa97ef378db4b403b83ff2b5cf85"
server_key_version: "encryptionkey@0"
I20260811 08:12:39.352171 28251 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435717191469-28623-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435717191469-28623-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435717191469-28623-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:12:39.366773 28251 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:12:39.367055 28251 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:12:39.367173 28251 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:12:39.367388 28251 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:12:39.367703 28251 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:12:39.367736 28251 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:12:39.367766 28251 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:12:39.367797 28251 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:12:39.373358 28251 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.195:35455
I20260811 08:12:39.373420 28446 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.195:35455 every 8 connection(s)
I20260811 08:12:39.373745 28251 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435717191469-28623-0/minicluster-data/ts-2/data/info.pb
I20260811 08:12:39.379004 27789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:39.374531 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.195:55537 (local address 127.27.243.254:40613)
0811 08:12:39.374616 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0811 08:12:39.374618 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:12:39.374792 (+ 174us) server_negotiation.cc:407] Connection header received
0811 08:12:39.375352 (+ 560us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:12:39.375354 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:12:39.375366 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:12:39.375419 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:12:39.376132 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:39.376650 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:39.377677 (+ 1027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:39.377888 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:39.377945 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:39.378735 (+ 790us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:12:39.378736 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:12:39.378736 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:12:39.378741 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:12:39.378757 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:12:39.378761 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:12:39.378807 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0811 08:12:39.378892 (+ 85us) server_negotiation.cc:299] Negotiation successful
0811 08:12:39.378922 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260811 08:12:39.379210 28451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:39.374459 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:40613 (local address 127.27.243.195:55537)
0811 08:12:39.374675 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0811 08:12:39.374712 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 08:12:39.375244 (+ 532us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:12:39.375495 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:12:39.375499 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:12:39.375507 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:12:39.376039 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:12:39.376045 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:12:39.376744 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:12:39.376745 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:12:39.377600 (+ 855us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:12:39.377604 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:12:39.377962 (+ 358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:12:39.377963 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:12:39.378092 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:39.378601 (+ 509us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 08:12:39.378601 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:12:39.378631 (+ 30us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 08:12:39.378655 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:12:39.378824 (+ 169us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:12:39.378828 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:12:39.378832 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 08:12:39.378890 (+ 58us) client_negotiation.cc:240] Negotiation successful
0811 08:12:39.378992 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":91,"threads_started":1}
I20260811 08:12:39.379804 28449 heartbeater.cc:347] Connected to a master server at 127.27.243.254:40613
I20260811 08:12:39.379906 28449 heartbeater.cc:464] Registering TS with master...
I20260811 08:12:39.380097 28449 heartbeater.cc:511] Master 127.27.243.254:40613 requested a full tablet report, sending...
I20260811 08:12:39.380541 27724 ts_manager.cc:194] Registered new tserver with Master: 371192f9ba8b44be8360c51690d0b369 (127.27.243.195:35455)
I20260811 08:12:39.380962 27724 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.27.243.195:55537
I20260811 08:12:39.381194 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 28251
I20260811 08:12:39.381279 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435717191469-28623-0/minicluster-data/ts-2/wal/instance
I20260811 08:12:39.381474 28623 external_mini_cluster.cc:1428] Setting key aebcda80c8b9325bdb9bf19287981e9d
I20260811 08:12:39.382431 28623 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 08:12:39.386723 27789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:39.383801 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53276 (local address 127.27.243.254:40613)
0811 08:12:39.383859 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0811 08:12:39.383861 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:12:39.383915 (+ 54us) server_negotiation.cc:407] Connection header received
0811 08:12:39.383984 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:12:39.383985 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:12:39.383994 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:12:39.384046 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:12:39.384206 (+ 160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:39.384730 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:39.385486 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:39.385728 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:39.385782 (+ 54us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:39.386452 (+ 670us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:12:39.386453 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:12:39.386454 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:12:39.386458 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:12:39.386473 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:12:39.386477 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:12:39.386557 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 08:12:39.386631 (+ 74us) server_negotiation.cc:299] Negotiation successful
0811 08:12:39.386641 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 08:12:39.388454 27724 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53276:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 08:12:39.390020 27724 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 08:12:39.396323 28465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:39.392182 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.193:37243 (local address 127.0.0.1:45916)
0811 08:12:39.392582 (+ 400us) negotiation.cc:107] Waiting for socket to connect
0811 08:12:39.392621 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 08:12:39.392702 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:12:39.392984 (+ 282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:12:39.392985 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:12:39.392986 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:12:39.393150 (+ 164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:12:39.393151 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:12:39.394419 (+ 1268us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:12:39.394420 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:12:39.395145 (+ 725us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:12:39.395147 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:12:39.396026 (+ 879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:12:39.396027 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:12:39.396107 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:39.396122 (+ 15us) client_negotiation.cc:769] Sending connection context
0811 08:12:39.396195 (+ 73us) client_negotiation.cc:240] Negotiation successful
0811 08:12:39.396248 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":368,"mutex_wait_us":2,"thread_start_us":72,"threads_started":1}
I20260811 08:12:39.396332 28468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:39.392300 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45916 (local address 127.27.243.193:37243)
0811 08:12:39.392514 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0811 08:12:39.392519 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 08:12:39.392747 (+ 228us) server_negotiation.cc:407] Connection header received
0811 08:12:39.392797 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:12:39.392800 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:12:39.392818 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:12:39.392907 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:12:39.393224 (+ 317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:39.394339 (+ 1115us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:39.395230 (+ 891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:39.395935 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:39.396016 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:39.396108 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0811 08:12:39.396206 (+ 98us) server_negotiation.cc:299] Negotiation successful
0811 08:12:39.396247 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":179,"thread_start_us":107,"threads_started":1}
I20260811 08:12:39.396509 28471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:39.392396 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.195:35455 (local address 127.0.0.1:54768)
0811 08:12:39.392804 (+ 408us) negotiation.cc:107] Waiting for socket to connect
0811 08:12:39.392812 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 08:12:39.392861 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:12:39.393171 (+ 310us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:12:39.393172 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:12:39.393173 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:12:39.393217 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:12:39.393219 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:12:39.394130 (+ 911us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:12:39.394132 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:12:39.395299 (+ 1167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:12:39.395302 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:12:39.396256 (+ 954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:12:39.396257 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:12:39.396327 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:39.396332 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 08:12:39.396380 (+ 48us) client_negotiation.cc:240] Negotiation successful
0811 08:12:39.396420 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":395,"thread_start_us":64,"threads_started":1}
I20260811 08:12:39.396514 28460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:39.392182 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.194:37917 (local address 127.0.0.1:44094)
0811 08:12:39.392583 (+ 401us) negotiation.cc:107] Waiting for socket to connect
0811 08:12:39.392621 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 08:12:39.392702 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:12:39.392977 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:12:39.392981 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:12:39.392983 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:12:39.393071 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:12:39.393073 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:12:39.394396 (+ 1323us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:12:39.394397 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:12:39.395482 (+ 1085us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:12:39.395484 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:12:39.396309 (+ 825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:12:39.396309 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:12:39.396364 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:39.396368 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 08:12:39.396397 (+ 29us) client_negotiation.cc:240] Negotiation successful
0811 08:12:39.396434 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":374,"mutex_wait_us":19,"spinlock_wait_cycles":768,"thread_start_us":69,"threads_started":1}
I20260811 08:12:39.396795 28466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:39.392299 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44094 (local address 127.27.243.194:37917)
0811 08:12:39.392514 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0811 08:12:39.392519 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 08:12:39.392707 (+ 188us) server_negotiation.cc:407] Connection header received
0811 08:12:39.392838 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:12:39.392842 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:12:39.392858 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:12:39.393022 (+ 164us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:12:39.393137 (+ 115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:39.394304 (+ 1167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:39.395556 (+ 1252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:39.396215 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:39.396558 (+ 343us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:39.396659 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0811 08:12:39.396682 (+ 23us) server_negotiation.cc:299] Negotiation successful
0811 08:12:39.396719 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":179,"thread_start_us":106,"threads_started":1}
I20260811 08:12:39.396834 28472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:39.392502 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54768 (local address 127.27.243.195:35455)
0811 08:12:39.392655 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0811 08:12:39.392660 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 08:12:39.392875 (+ 215us) server_negotiation.cc:407] Connection header received
0811 08:12:39.393009 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:12:39.393012 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:12:39.393029 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:12:39.393099 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:12:39.393278 (+ 179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:39.394054 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:39.395384 (+ 1330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:39.396076 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:39.396138 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:39.396214 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 08:12:39.396698 (+ 484us) server_negotiation.cc:299] Negotiation successful
0811 08:12:39.396749 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":117,"thread_start_us":74,"threads_started":1}
I20260811 08:12:39.397411 28351 tablet_service.cc:1467] Processing CreateTablet for tablet 25022ca86ed342a2998aabb83c0a2257 (DEFAULT_TABLE table=test-table [id=30fe6406d4a94e6ab569932453f7e216]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:12:39.397425 28130 tablet_service.cc:1467] Processing CreateTablet for tablet 25022ca86ed342a2998aabb83c0a2257 (DEFAULT_TABLE table=test-table [id=30fe6406d4a94e6ab569932453f7e216]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:12:39.397431 27920 tablet_service.cc:1467] Processing CreateTablet for tablet 25022ca86ed342a2998aabb83c0a2257 (DEFAULT_TABLE table=test-table [id=30fe6406d4a94e6ab569932453f7e216]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:12:39.397774 28351 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 25022ca86ed342a2998aabb83c0a2257. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:12:39.397789 27920 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 25022ca86ed342a2998aabb83c0a2257. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:12:39.397804 28130 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 25022ca86ed342a2998aabb83c0a2257. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:12:39.400214 28473 tablet_bootstrap.cc:492] T 25022ca86ed342a2998aabb83c0a2257 P 371192f9ba8b44be8360c51690d0b369: Bootstrap starting.
I20260811 08:12:39.400825 28473 tablet_bootstrap.cc:654] T 25022ca86ed342a2998aabb83c0a2257 P 371192f9ba8b44be8360c51690d0b369: Neither blocks nor log segments found. Creating new log.
I20260811 08:12:39.401075 28474 tablet_bootstrap.cc:492] T 25022ca86ed342a2998aabb83c0a2257 P c554a14010e54aada86b7a2e7ee5e11f: Bootstrap starting.
I20260811 08:12:39.401248 28473 log.cc:824] T 25022ca86ed342a2998aabb83c0a2257 P 371192f9ba8b44be8360c51690d0b369: Log is configured to *not* fsync() on all Append() calls
I20260811 08:12:39.401643 28477 tablet_bootstrap.cc:492] T 25022ca86ed342a2998aabb83c0a2257 P 2d132ec9fea2462e9ddb213443fb1ab7: Bootstrap starting.
I20260811 08:12:39.401849 28474 tablet_bootstrap.cc:654] T 25022ca86ed342a2998aabb83c0a2257 P c554a14010e54aada86b7a2e7ee5e11f: Neither blocks nor log segments found. Creating new log.
I20260811 08:12:39.401993 28473 tablet_bootstrap.cc:492] T 25022ca86ed342a2998aabb83c0a2257 P 371192f9ba8b44be8360c51690d0b369: No bootstrap required, opened a new log
I20260811 08:12:39.402062 28473 ts_tablet_manager.cc:1397] T 25022ca86ed342a2998aabb83c0a2257 P 371192f9ba8b44be8360c51690d0b369: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 08:12:39.402174 28474 log.cc:824] T 25022ca86ed342a2998aabb83c0a2257 P c554a14010e54aada86b7a2e7ee5e11f: Log is configured to *not* fsync() on all Append() calls
I20260811 08:12:39.402259 28477 tablet_bootstrap.cc:654] T 25022ca86ed342a2998aabb83c0a2257 P 2d132ec9fea2462e9ddb213443fb1ab7: Neither blocks nor log segments found. Creating new log.
I20260811 08:12:39.402536 28477 log.cc:824] T 25022ca86ed342a2998aabb83c0a2257 P 2d132ec9fea2462e9ddb213443fb1ab7: Log is configured to *not* fsync() on all Append() calls
I20260811 08:12:39.402910 28474 tablet_bootstrap.cc:492] T 25022ca86ed342a2998aabb83c0a2257 P c554a14010e54aada86b7a2e7ee5e11f: No bootstrap required, opened a new log
I20260811 08:12:39.402989 28474 ts_tablet_manager.cc:1397] T 25022ca86ed342a2998aabb83c0a2257 P c554a14010e54aada86b7a2e7ee5e11f: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 08:12:39.403185 28477 tablet_bootstrap.cc:492] T 25022ca86ed342a2998aabb83c0a2257 P 2d132ec9fea2462e9ddb213443fb1ab7: No bootstrap required, opened a new log
I20260811 08:12:39.403244 28477 ts_tablet_manager.cc:1397] T 25022ca86ed342a2998aabb83c0a2257 P 2d132ec9fea2462e9ddb213443fb1ab7: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 08:12:39.404608 28473 raft_consensus.cc:348] T 25022ca86ed342a2998aabb83c0a2257 P 371192f9ba8b44be8360c51690d0b369 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d132ec9fea2462e9ddb213443fb1ab7" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 37243 } } peers { permanent_uuid: "c554a14010e54aada86b7a2e7ee5e11f" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 37917 } } peers { permanent_uuid: "371192f9ba8b44be8360c51690d0b369" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 35455 } }
I20260811 08:12:39.404793 28473 raft_consensus.cc:374] T 25022ca86ed342a2998aabb83c0a2257 P 371192f9ba8b44be8360c51690d0b369 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:12:39.404831 28473 raft_consensus.cc:729] T 25022ca86ed342a2998aabb83c0a2257 P 371192f9ba8b44be8360c51690d0b369 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371192f9ba8b44be8360c51690d0b369, State: Initialized, Role: FOLLOWER
I20260811 08:12:39.404973 28473 consensus_queue.cc:260] T 25022ca86ed342a2998aabb83c0a2257 P 371192f9ba8b44be8360c51690d0b369 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d132ec9fea2462e9ddb213443fb1ab7" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 37243 } } peers { permanent_uuid: "c554a14010e54aada86b7a2e7ee5e11f" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 37917 } } peers { permanent_uuid: "371192f9ba8b44be8360c51690d0b369" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 35455 } }
I20260811 08:12:39.404929 28477 raft_consensus.cc:348] T 25022ca86ed342a2998aabb83c0a2257 P 2d132ec9fea2462e9ddb213443fb1ab7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d132ec9fea2462e9ddb213443fb1ab7" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 37243 } } peers { permanent_uuid: "c554a14010e54aada86b7a2e7ee5e11f" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 37917 } } peers { permanent_uuid: "371192f9ba8b44be8360c51690d0b369" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 35455 } }
I20260811 08:12:39.405058 28477 raft_consensus.cc:374] T 25022ca86ed342a2998aabb83c0a2257 P 2d132ec9fea2462e9ddb213443fb1ab7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:12:39.405089 28477 raft_consensus.cc:729] T 25022ca86ed342a2998aabb83c0a2257 P 2d132ec9fea2462e9ddb213443fb1ab7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d132ec9fea2462e9ddb213443fb1ab7, State: Initialized, Role: FOLLOWER
I20260811 08:12:39.405238 28473 ts_tablet_manager.cc:1428] T 25022ca86ed342a2998aabb83c0a2257 P 371192f9ba8b44be8360c51690d0b369: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 08:12:39.405234 28477 consensus_queue.cc:260] T 25022ca86ed342a2998aabb83c0a2257 P 2d132ec9fea2462e9ddb213443fb1ab7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d132ec9fea2462e9ddb213443fb1ab7" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 37243 } } peers { permanent_uuid: "c554a14010e54aada86b7a2e7ee5e11f" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 37917 } } peers { permanent_uuid: "371192f9ba8b44be8360c51690d0b369" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 35455 } }
I20260811 08:12:39.405372 28449 heartbeater.cc:503] Master 127.27.243.254:40613 was elected leader, sending a full tablet report...
I20260811 08:12:39.405478 28477 ts_tablet_manager.cc:1428] T 25022ca86ed342a2998aabb83c0a2257 P 2d132ec9fea2462e9ddb213443fb1ab7: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 08:12:39.405541 28016 heartbeater.cc:503] Master 127.27.243.254:40613 was elected leader, sending a full tablet report...
I20260811 08:12:39.405738 28474 raft_consensus.cc:348] T 25022ca86ed342a2998aabb83c0a2257 P c554a14010e54aada86b7a2e7ee5e11f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d132ec9fea2462e9ddb213443fb1ab7" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 37243 } } peers { permanent_uuid: "c554a14010e54aada86b7a2e7ee5e11f" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 37917 } } peers { permanent_uuid: "371192f9ba8b44be8360c51690d0b369" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 35455 } }
I20260811 08:12:39.405903 28474 raft_consensus.cc:374] T 25022ca86ed342a2998aabb83c0a2257 P c554a14010e54aada86b7a2e7ee5e11f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:12:39.405939 28474 raft_consensus.cc:729] T 25022ca86ed342a2998aabb83c0a2257 P c554a14010e54aada86b7a2e7ee5e11f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c554a14010e54aada86b7a2e7ee5e11f, State: Initialized, Role: FOLLOWER
I20260811 08:12:39.406028 28474 consensus_queue.cc:260] T 25022ca86ed342a2998aabb83c0a2257 P c554a14010e54aada86b7a2e7ee5e11f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d132ec9fea2462e9ddb213443fb1ab7" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 37243 } } peers { permanent_uuid: "c554a14010e54aada86b7a2e7ee5e11f" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 37917 } } peers { permanent_uuid: "371192f9ba8b44be8360c51690d0b369" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 35455 } }
I20260811 08:12:39.406278 28474 ts_tablet_manager.cc:1428] T 25022ca86ed342a2998aabb83c0a2257 P c554a14010e54aada86b7a2e7ee5e11f: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 08:12:39.406417 28243 heartbeater.cc:503] Master 127.27.243.254:40613 was elected leader, sending a full tablet report...
W20260811 08:12:39.499297 28247 tablet.cc:2369] T 25022ca86ed342a2998aabb83c0a2257 P c554a14010e54aada86b7a2e7ee5e11f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 08:12:39.554801 28487 raft_consensus.cc:482] T 25022ca86ed342a2998aabb83c0a2257 P 2d132ec9fea2462e9ddb213443fb1ab7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:12:39.554929 28487 raft_consensus.cc:504] T 25022ca86ed342a2998aabb83c0a2257 P 2d132ec9fea2462e9ddb213443fb1ab7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d132ec9fea2462e9ddb213443fb1ab7" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 37243 } } peers { permanent_uuid: "c554a14010e54aada86b7a2e7ee5e11f" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 37917 } } peers { permanent_uuid: "371192f9ba8b44be8360c51690d0b369" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 35455 } }
I20260811 08:12:39.555364 28487 leader_election.cc:288] T 25022ca86ed342a2998aabb83c0a2257 P 2d132ec9fea2462e9ddb213443fb1ab7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c554a14010e54aada86b7a2e7ee5e11f (127.27.243.194:37917), 371192f9ba8b44be8360c51690d0b369 (127.27.243.195:35455)
I20260811 08:12:39.558244 28466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:39.555564 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.193:60265 (local address 127.27.243.194:37917)
0811 08:12:39.555608 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 08:12:39.555610 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:12:39.555621 (+ 11us) server_negotiation.cc:407] Connection header received
0811 08:12:39.555709 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:12:39.555710 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:12:39.555719 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:12:39.555786 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:12:39.556018 (+ 232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:39.556547 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:39.557553 (+ 1006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:39.557906 (+ 353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:39.557963 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:39.557972 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 08:12:39.558139 (+ 167us) server_negotiation.cc:299] Negotiation successful
0811 08:12:39.558176 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 08:12:39.558244 28472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:39.555623 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.193:46059 (local address 127.27.243.195:35455)
0811 08:12:39.555666 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 08:12:39.555668 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:12:39.555798 (+ 130us) server_negotiation.cc:407] Connection header received
0811 08:12:39.555921 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:12:39.555922 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:12:39.555934 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:12:39.556000 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:12:39.556134 (+ 134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:39.556629 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:39.557553 (+ 924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:39.557917 (+ 364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:39.557990 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:39.557998 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 08:12:39.558133 (+ 135us) server_negotiation.cc:299] Negotiation successful
0811 08:12:39.558169 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 08:12:39.558265 28020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:39.555501 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.194:37917 (local address 127.27.243.193:60265)
0811 08:12:39.555555 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0811 08:12:39.555569 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 08:12:39.555625 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:12:39.555849 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:12:39.555850 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:12:39.555852 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:12:39.555937 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:12:39.555940 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:12:39.556628 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:12:39.556629 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:12:39.557430 (+ 801us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:12:39.557433 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:12:39.557986 (+ 553us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:12:39.557987 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:12:39.558064 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:39.558068 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 08:12:39.558127 (+ 59us) client_negotiation.cc:240] Negotiation successful
0811 08:12:39.558169 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29,"mutex_wait_us":12}
I20260811 08:12:39.558275 28491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:39.555518 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.195:35455 (local address 127.27.243.193:46059)
0811 08:12:39.555727 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0811 08:12:39.555736 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 08:12:39.555821 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:12:39.556003 (+ 182us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:12:39.556004 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:12:39.556006 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:12:39.556077 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:12:39.556079 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:12:39.556708 (+ 629us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:12:39.556709 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:12:39.557442 (+ 733us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:12:39.557444 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:12:39.558002 (+ 558us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:12:39.558004 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:12:39.558064 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:39.558067 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 08:12:39.558112 (+ 45us) client_negotiation.cc:240] Negotiation successful
0811 08:12:39.558150 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":113,"threads_started":1}
I20260811 08:12:39.558656 28381 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "25022ca86ed342a2998aabb83c0a2257" candidate_uuid: "2d132ec9fea2462e9ddb213443fb1ab7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371192f9ba8b44be8360c51690d0b369" is_pre_election: true
I20260811 08:12:39.558657 28160 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "25022ca86ed342a2998aabb83c0a2257" candidate_uuid: "2d132ec9fea2462e9ddb213443fb1ab7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c554a14010e54aada86b7a2e7ee5e11f" is_pre_election: true
I20260811 08:12:39.558826 28160 raft_consensus.cc:2454] T 25022ca86ed342a2998aabb83c0a2257 P c554a14010e54aada86b7a2e7ee5e11f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d132ec9fea2462e9ddb213443fb1ab7 in term 0.
I20260811 08:12:39.558826 28381 raft_consensus.cc:2454] T 25022ca86ed342a2998aabb83c0a2257 P 371192f9ba8b44be8360c51690d0b369 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d132ec9fea2462e9ddb213443fb1ab7 in term 0.
I20260811 08:12:39.559082 27845 leader_election.cc:302] T 25022ca86ed342a2998aabb83c0a2257 P 2d132ec9fea2462e9ddb213443fb1ab7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d132ec9fea2462e9ddb213443fb1ab7, 371192f9ba8b44be8360c51690d0b369; no voters:
I20260811 08:12:39.559257 28487 raft_consensus.cc:2781] T 25022ca86ed342a2998aabb83c0a2257 P 2d132ec9fea2462e9ddb213443fb1ab7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 08:12:39.559316 28487 raft_consensus.cc:482] T 25022ca86ed342a2998aabb83c0a2257 P 2d132ec9fea2462e9ddb213443fb1ab7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 08:12:39.559336 28487 raft_consensus.cc:3037] T 25022ca86ed342a2998aabb83c0a2257 P 2d132ec9fea2462e9ddb213443fb1ab7 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:12:39.560105 28487 raft_consensus.cc:504] T 25022ca86ed342a2998aabb83c0a2257 P 2d132ec9fea2462e9ddb213443fb1ab7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d132ec9fea2462e9ddb213443fb1ab7" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 37243 } } peers { permanent_uuid: "c554a14010e54aada86b7a2e7ee5e11f" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 37917 } } peers { permanent_uuid: "371192f9ba8b44be8360c51690d0b369" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 35455 } }
I20260811 08:12:39.560262 28487 leader_election.cc:288] T 25022ca86ed342a2998aabb83c0a2257 P 2d132ec9fea2462e9ddb213443fb1ab7 [CANDIDATE]: Term 1 election: Requested vote from peers c554a14010e54aada86b7a2e7ee5e11f (127.27.243.194:37917), 371192f9ba8b44be8360c51690d0b369 (127.27.243.195:35455)
I20260811 08:12:39.560438 28160 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "25022ca86ed342a2998aabb83c0a2257" candidate_uuid: "2d132ec9fea2462e9ddb213443fb1ab7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c554a14010e54aada86b7a2e7ee5e11f"
I20260811 08:12:39.560448 28381 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "25022ca86ed342a2998aabb83c0a2257" candidate_uuid: "2d132ec9fea2462e9ddb213443fb1ab7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371192f9ba8b44be8360c51690d0b369"
I20260811 08:12:39.560523 28160 raft_consensus.cc:3037] T 25022ca86ed342a2998aabb83c0a2257 P c554a14010e54aada86b7a2e7ee5e11f [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:12:39.560528 28381 raft_consensus.cc:3037] T 25022ca86ed342a2998aabb83c0a2257 P 371192f9ba8b44be8360c51690d0b369 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:12:39.561265 28381 raft_consensus.cc:2454] T 25022ca86ed342a2998aabb83c0a2257 P 371192f9ba8b44be8360c51690d0b369 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d132ec9fea2462e9ddb213443fb1ab7 in term 1.
I20260811 08:12:39.561280 28160 raft_consensus.cc:2454] T 25022ca86ed342a2998aabb83c0a2257 P c554a14010e54aada86b7a2e7ee5e11f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d132ec9fea2462e9ddb213443fb1ab7 in term 1.
I20260811 08:12:39.561463 27845 leader_election.cc:302] T 25022ca86ed342a2998aabb83c0a2257 P 2d132ec9fea2462e9ddb213443fb1ab7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d132ec9fea2462e9ddb213443fb1ab7, 371192f9ba8b44be8360c51690d0b369; no voters:
I20260811 08:12:39.561568 28487 raft_consensus.cc:2781] T 25022ca86ed342a2998aabb83c0a2257 P 2d132ec9fea2462e9ddb213443fb1ab7 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:12:39.561714 28487 raft_consensus.cc:686] T 25022ca86ed342a2998aabb83c0a2257 P 2d132ec9fea2462e9ddb213443fb1ab7 [term 1 LEADER]: Becoming Leader. State: Replica: 2d132ec9fea2462e9ddb213443fb1ab7, State: Running, Role: LEADER
I20260811 08:12:39.561815 28487 consensus_queue.cc:237] T 25022ca86ed342a2998aabb83c0a2257 P 2d132ec9fea2462e9ddb213443fb1ab7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d132ec9fea2462e9ddb213443fb1ab7" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 37243 } } peers { permanent_uuid: "c554a14010e54aada86b7a2e7ee5e11f" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 37917 } } peers { permanent_uuid: "371192f9ba8b44be8360c51690d0b369" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 35455 } }
I20260811 08:12:39.562644 27724 catalog_manager.cc:5495] T 25022ca86ed342a2998aabb83c0a2257 P 2d132ec9fea2462e9ddb213443fb1ab7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2d132ec9fea2462e9ddb213443fb1ab7 (127.27.243.193). New cstate: current_term: 1 leader_uuid: "2d132ec9fea2462e9ddb213443fb1ab7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d132ec9fea2462e9ddb213443fb1ab7" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 37243 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c554a14010e54aada86b7a2e7ee5e11f" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 37917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "371192f9ba8b44be8360c51690d0b369" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 35455 } health_report { overall_health: UNKNOWN } } }
I20260811 08:12:39.579435 28468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:39.577082 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45920 (local address 127.27.243.193:37243)
0811 08:12:39.577129 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 08:12:39.577131 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:12:39.577140 (+ 9us) server_negotiation.cc:407] Connection header received
0811 08:12:39.577188 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:12:39.577189 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:12:39.577206 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:12:39.577275 (+ 69us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:12:39.577368 (+ 93us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:39.577911 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:39.578621 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:39.578827 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:39.578877 (+ 50us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:39.579124 (+ 247us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:12:39.579217 (+ 93us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:12:39.579293 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 08:12:39.579333 (+ 40us) server_negotiation.cc:299] Negotiation successful
0811 08:12:39.579343 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 08:12:39.581230 28381 raft_consensus.cc:1261] T 25022ca86ed342a2998aabb83c0a2257 P 371192f9ba8b44be8360c51690d0b369 [term 1 FOLLOWER]: Refusing update from remote peer 2d132ec9fea2462e9ddb213443fb1ab7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:12:39.581229 28160 raft_consensus.cc:1261] T 25022ca86ed342a2998aabb83c0a2257 P c554a14010e54aada86b7a2e7ee5e11f [term 1 FOLLOWER]: Refusing update from remote peer 2d132ec9fea2462e9ddb213443fb1ab7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:12:39.581602 28487 consensus_queue.cc:1035] T 25022ca86ed342a2998aabb83c0a2257 P 2d132ec9fea2462e9ddb213443fb1ab7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c554a14010e54aada86b7a2e7ee5e11f" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 37917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:12:39.581745 28492 consensus_queue.cc:1035] T 25022ca86ed342a2998aabb83c0a2257 P 2d132ec9fea2462e9ddb213443fb1ab7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "371192f9ba8b44be8360c51690d0b369" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 35455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:12:39.584317 28496 mvcc.cc:205] Tried to move back new op lower bound from 7317241690442149888 to 7317241690365812736. Current Snapshot: MvccSnapshot[applied={T|T < 7317241690442149888}]
I20260811 08:12:39.584515 28499 mvcc.cc:205] Tried to move back new op lower bound from 7317241690442149888 to 7317241690365812736. Current Snapshot: MvccSnapshot[applied={T|T < 7317241690442149888}]
I20260811 08:12:39.585253 28500 mvcc.cc:205] Tried to move back new op lower bound from 7317241690442149888 to 7317241690365812736. Current Snapshot: MvccSnapshot[applied={T|T < 7317241690442149888}]
I20260811 08:12:39.586515 27724 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:53276:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:12:39.586606 27724 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:53276:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:12:39.587328 27724 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 005e60e2870b4f48bd76c93ba9c3a378: Sending DeleteTablet for 3 replicas of tablet 25022ca86ed342a2998aabb83c0a2257
I20260811 08:12:39.587690 27920 tablet_service.cc:1514] Processing DeleteTablet for tablet 25022ca86ed342a2998aabb83c0a2257 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:12:39 UTC) from {username='slave'} at 127.0.0.1:45916
I20260811 08:12:39.587759 28130 tablet_service.cc:1514] Processing DeleteTablet for tablet 25022ca86ed342a2998aabb83c0a2257 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:12:39 UTC) from {username='slave'} at 127.0.0.1:44094
I20260811 08:12:39.587981 28513 tablet_replica.cc:330] T 25022ca86ed342a2998aabb83c0a2257 P c554a14010e54aada86b7a2e7ee5e11f: stopping tablet replica
I20260811 08:12:39.588063 28351 tablet_service.cc:1514] Processing DeleteTablet for tablet 25022ca86ed342a2998aabb83c0a2257 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:12:39 UTC) from {username='slave'} at 127.0.0.1:54768
I20260811 08:12:39.588140 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 27820
I20260811 08:12:39.596153 28518 tablet_replica.cc:330] T 25022ca86ed342a2998aabb83c0a2257 P 371192f9ba8b44be8360c51690d0b369: stopping tablet replica
I20260811 08:12:39.596161 28513 raft_consensus.cc:2229] T 25022ca86ed342a2998aabb83c0a2257 P c554a14010e54aada86b7a2e7ee5e11f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:12:39.596309 28518 raft_consensus.cc:2229] T 25022ca86ed342a2998aabb83c0a2257 P 371192f9ba8b44be8360c51690d0b369 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:12:39.596325 28513 raft_consensus.cc:2258] T 25022ca86ed342a2998aabb83c0a2257 P c554a14010e54aada86b7a2e7ee5e11f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:12:39.596427 28518 raft_consensus.cc:2258] T 25022ca86ed342a2998aabb83c0a2257 P 371192f9ba8b44be8360c51690d0b369 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:12:39.596833 28513 ts_tablet_manager.cc:1905] T 25022ca86ed342a2998aabb83c0a2257 P c554a14010e54aada86b7a2e7ee5e11f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:12:39.596911 28518 ts_tablet_manager.cc:1905] T 25022ca86ed342a2998aabb83c0a2257 P 371192f9ba8b44be8360c51690d0b369: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:12:39.598675 28513 ts_tablet_manager.cc:1918] T 25022ca86ed342a2998aabb83c0a2257 P c554a14010e54aada86b7a2e7ee5e11f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:12:39.598721 28518 ts_tablet_manager.cc:1918] T 25022ca86ed342a2998aabb83c0a2257 P 371192f9ba8b44be8360c51690d0b369: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:12:39.598760 28513 log.cc:1196] T 25022ca86ed342a2998aabb83c0a2257 P c554a14010e54aada86b7a2e7ee5e11f: Deleting WAL directory at /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435717191469-28623-0/minicluster-data/ts-1/wal/wals/25022ca86ed342a2998aabb83c0a2257
I20260811 08:12:39.598814 28518 log.cc:1196] T 25022ca86ed342a2998aabb83c0a2257 P 371192f9ba8b44be8360c51690d0b369: Deleting WAL directory at /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435717191469-28623-0/minicluster-data/ts-2/wal/wals/25022ca86ed342a2998aabb83c0a2257
I20260811 08:12:39.599066 28513 ts_tablet_manager.cc:1939] T 25022ca86ed342a2998aabb83c0a2257 P c554a14010e54aada86b7a2e7ee5e11f: Deleting consensus metadata
I20260811 08:12:39.599167 28518 ts_tablet_manager.cc:1939] T 25022ca86ed342a2998aabb83c0a2257 P 371192f9ba8b44be8360c51690d0b369: Deleting consensus metadata
I20260811 08:12:39.599545 27703 catalog_manager.cc:4841] TS c554a14010e54aada86b7a2e7ee5e11f (127.27.243.194:37917): tablet 25022ca86ed342a2998aabb83c0a2257 (table test-table [id=30fe6406d4a94e6ab569932453f7e216]) successfully deleted
I20260811 08:12:39.599747 27705 catalog_manager.cc:4841] TS 371192f9ba8b44be8360c51690d0b369 (127.27.243.195:35455): tablet 25022ca86ed342a2998aabb83c0a2257 (table test-table [id=30fe6406d4a94e6ab569932453f7e216]) successfully deleted
W20260811 08:12:39.604095 27705 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.27.243.193:37243 (error 108)
I20260811 08:12:39.604285 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 28021
I20260811 08:12:39.612311 28471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:39.612145 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.193:37243 (local address 127.0.0.1:45934)
0811 08:12:39.612201 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0811 08:12:39.612264 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.193:37243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
W20260811 08:12:39.612463 27705 catalog_manager.cc:4584] TS 2d132ec9fea2462e9ddb213443fb1ab7 (127.27.243.193:37243): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 25022ca86ed342a2998aabb83c0a2257: Network error: Client connection negotiation failed: client connection to 127.27.243.193:37243: connect: Connection refused (error 111)
I20260811 08:12:39.616636 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 28251
I20260811 08:12:39.643362 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 27677
2026-08-11T08:12:39Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (841 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435717191469-28623-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:12:39 dist-test-slave-7lbf krb5kdc[28526](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:12:39 dist-test-slave-7lbf krb5kdc[28526](info): set up 2 sockets
Aug 11 08:12:39 dist-test-slave-7lbf krb5kdc[28526](info): commencing operation
krb5kdc: starting...
W20260811 08:12:40.808593 28623 mini_kdc.cc:121] Time spent starting KDC: real 1.140s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435717191469-28623-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435717191469-28623-0/krb5kdc/test-user.keytab.
Aug 11 08:12:40 dist-test-slave-7lbf krb5kdc[28526](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435960, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:12:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:12:40Z Disabled control of system clock
WARNING: no policy specified for kudu/127.27.243.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.243.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.243.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab.
Entry for principal kudu/127.27.243.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab.
I20260811 08:12:40.929116 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435717191469-28623-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435717191469-28623-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435717191469-28623-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.243.254:37617
--webserver_interface=127.27.243.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab
--principal=kudu/127.27.243.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:46029
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.243.254:37617
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:12:41.009553 28545 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:12:41.009763 28545 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:12:41.009794 28545 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:12:41.010984 28545 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:12:41.011029 28545 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:12:41.011045 28545 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:12:41.011062 28545 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:12:41.011077 28545 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:12:41.012562 28545 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:46029
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435717191469-28623-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435717191469-28623-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.243.254:37617
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab
--principal=kudu/127.27.243.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.243.254:37617
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.243.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28545
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435717191469-28623-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:12:41.012807 28545 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:12:41.013026 28545 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:12:41.017705 28556 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:12:41.017796 28545 server_base.cc:1034] running on GCE node
W20260811 08:12:41.017719 28557 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:12:41.017719 28560 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:12:41.018224 28545 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:12:41.018527 28545 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:12:41.019670 28545 hybrid_clock.cc:648] HybridClock initialized: now 1786435961019653 us; error 37 us; skew 500 ppm
Aug 11 08:12:41 dist-test-slave-7lbf krb5kdc[28526](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435961, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:12:41.022166 28545 init.cc:377] Logged in from keytab as kudu/127.27.243.254@KRBTEST.COM (short username kudu)
I20260811 08:12:41.022590 28545 webserver.cc:460] Webserver started at http://127.27.243.254:45807/ using document root <none> and password file <none>
I20260811 08:12:41.022801 28545 fs_manager.cc:359] Metadata directory not provided
I20260811 08:12:41.022850 28545 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:12:41.022981 28545 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:12:41.024021 28545 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435717191469-28623-0/minicluster-data/master-0/data/instance:
uuid: "dd1a1b9365c149658ce1696deaf75519"
format_stamp: "Formatted at 2026-08-11 08:12:41 on dist-test-slave-7lbf"
server_key: "20732c8fee4d6317c13a668667a69c3b"
server_key_iv: "5bbe5a7bb5d236d9706062b1ea85ecc7"
server_key_version: "encryptionkey@0"
I20260811 08:12:41.024359 28545 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435717191469-28623-0/minicluster-data/master-0/wal/instance:
uuid: "dd1a1b9365c149658ce1696deaf75519"
format_stamp: "Formatted at 2026-08-11 08:12:41 on dist-test-slave-7lbf"
server_key: "20732c8fee4d6317c13a668667a69c3b"
server_key_iv: "5bbe5a7bb5d236d9706062b1ea85ecc7"
server_key_version: "encryptionkey@0"
I20260811 08:12:41.025650 28545 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 08:12:41.026347 28571 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:12:41.026495 28545 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 08:12:41.026579 28545 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435717191469-28623-0/minicluster-data/master-0/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435717191469-28623-0/minicluster-data/master-0/wal
uuid: "dd1a1b9365c149658ce1696deaf75519"
format_stamp: "Formatted at 2026-08-11 08:12:41 on dist-test-slave-7lbf"
server_key: "20732c8fee4d6317c13a668667a69c3b"
server_key_iv: "5bbe5a7bb5d236d9706062b1ea85ecc7"
server_key_version: "encryptionkey@0"
I20260811 08:12:41.026641 28545 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435717191469-28623-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435717191469-28623-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435717191469-28623-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:12:41.038446 28545 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:12:41.040256 28545 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:12:41.040388 28545 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:12:41.044257 28545 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.254:37617
I20260811 08:12:41.044296 28669 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.254:37617 every 8 connection(s)
I20260811 08:12:41.044624 28545 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
I20260811 08:12:41.045477 28670 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:12:41.047784 28670 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dd1a1b9365c149658ce1696deaf75519: Bootstrap starting.
I20260811 08:12:41.048357 28670 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dd1a1b9365c149658ce1696deaf75519: Neither blocks nor log segments found. Creating new log.
I20260811 08:12:41.048635 28670 log.cc:824] T 00000000000000000000000000000000 P dd1a1b9365c149658ce1696deaf75519: Log is configured to *not* fsync() on all Append() calls
I20260811 08:12:41.049330 28670 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dd1a1b9365c149658ce1696deaf75519: No bootstrap required, opened a new log
I20260811 08:12:41.050958 28670 raft_consensus.cc:348] T 00000000000000000000000000000000 P dd1a1b9365c149658ce1696deaf75519 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd1a1b9365c149658ce1696deaf75519" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 37617 } }
I20260811 08:12:41.051096 28670 raft_consensus.cc:374] T 00000000000000000000000000000000 P dd1a1b9365c149658ce1696deaf75519 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:12:41.051118 28670 raft_consensus.cc:729] T 00000000000000000000000000000000 P dd1a1b9365c149658ce1696deaf75519 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd1a1b9365c149658ce1696deaf75519, State: Initialized, Role: FOLLOWER
I20260811 08:12:41.051262 28670 consensus_queue.cc:260] T 00000000000000000000000000000000 P dd1a1b9365c149658ce1696deaf75519 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd1a1b9365c149658ce1696deaf75519" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 37617 } }
I20260811 08:12:41.051347 28670 raft_consensus.cc:388] T 00000000000000000000000000000000 P dd1a1b9365c149658ce1696deaf75519 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:12:41.051373 28670 raft_consensus.cc:482] T 00000000000000000000000000000000 P dd1a1b9365c149658ce1696deaf75519 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:12:41.051422 28670 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dd1a1b9365c149658ce1696deaf75519 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:12:41.051942 28670 raft_consensus.cc:504] T 00000000000000000000000000000000 P dd1a1b9365c149658ce1696deaf75519 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd1a1b9365c149658ce1696deaf75519" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 37617 } }
I20260811 08:12:41.052032 28670 leader_election.cc:302] T 00000000000000000000000000000000 P dd1a1b9365c149658ce1696deaf75519 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dd1a1b9365c149658ce1696deaf75519; no voters:
I20260811 08:12:41.052177 28670 leader_election.cc:288] T 00000000000000000000000000000000 P dd1a1b9365c149658ce1696deaf75519 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:12:41.052225 28673 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dd1a1b9365c149658ce1696deaf75519 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:12:41.052414 28670 sys_catalog.cc:564] T 00000000000000000000000000000000 P dd1a1b9365c149658ce1696deaf75519 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:12:41.052438 28673 raft_consensus.cc:686] T 00000000000000000000000000000000 P dd1a1b9365c149658ce1696deaf75519 [term 1 LEADER]: Becoming Leader. State: Replica: dd1a1b9365c149658ce1696deaf75519, State: Running, Role: LEADER
I20260811 08:12:41.052590 28673 consensus_queue.cc:237] T 00000000000000000000000000000000 P dd1a1b9365c149658ce1696deaf75519 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd1a1b9365c149658ce1696deaf75519" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 37617 } }
I20260811 08:12:41.053063 28676 sys_catalog.cc:455] T 00000000000000000000000000000000 P dd1a1b9365c149658ce1696deaf75519 [sys.catalog]: SysCatalogTable state changed. Reason: New leader dd1a1b9365c149658ce1696deaf75519. Latest consensus state: current_term: 1 leader_uuid: "dd1a1b9365c149658ce1696deaf75519" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd1a1b9365c149658ce1696deaf75519" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 37617 } } }
I20260811 08:12:41.053151 28676 sys_catalog.cc:458] T 00000000000000000000000000000000 P dd1a1b9365c149658ce1696deaf75519 [sys.catalog]: This master's current role is: LEADER
I20260811 08:12:41.053539 28675 sys_catalog.cc:455] T 00000000000000000000000000000000 P dd1a1b9365c149658ce1696deaf75519 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "dd1a1b9365c149658ce1696deaf75519" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd1a1b9365c149658ce1696deaf75519" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 37617 } } }
I20260811 08:12:41.053608 28688 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:12:41.053694 28675 sys_catalog.cc:458] T 00000000000000000000000000000000 P dd1a1b9365c149658ce1696deaf75519 [sys.catalog]: This master's current role is: LEADER
I20260811 08:12:41.053977 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 28545
I20260811 08:12:41.054098 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435717191469-28623-0/minicluster-data/master-0/wal/instance
I20260811 08:12:41.054273 28623 external_mini_cluster.cc:1428] Setting key 0a5906a5c467493deb104cac4d8cb611
I20260811 08:12:41.054198 28688 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:12:41.056169 28688 catalog_manager.cc:1347] Generated new cluster ID: 75f7d84cd91e425da42b87d8fbec3a57
I20260811 08:12:41.056221 28688 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 08:12:41 dist-test-slave-7lbf krb5kdc[28526](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435960, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.243.254@KRBTEST.COM
I20260811 08:12:41.068665 28704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:41.054729 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53514 (local address 127.27.243.254:37617)
0811 08:12:41.057918 (+ 3189us) server_negotiation.cc:206] Beginning negotiation
0811 08:12:41.057928 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 08:12:41.057960 (+ 32us) server_negotiation.cc:407] Connection header received
0811 08:12:41.058077 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:12:41.058084 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:12:41.058139 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:12:41.058273 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:12:41.059003 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:41.060810 (+ 1807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:41.061859 (+ 1049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:41.062496 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:41.062609 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:41.065323 (+ 2714us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:12:41.065328 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:12:41.065328 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:12:41.065340 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:12:41.067177 (+ 1837us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:12:41.067554 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:12:41.067556 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:12:41.067557 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:12:41.067649 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:12:41.067828 (+ 179us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:12:41.067828 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:12:41.067828 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:12:41.068104 (+ 276us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:12:41.068245 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0811 08:12:41.068335 (+ 90us) server_negotiation.cc:299] Negotiation successful
0811 08:12:41.068461 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3128,"thread_start_us":76,"threads_started":1}
I20260811 08:12:41.074304 28688 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:12:41.074782 28688 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:12:41.079140 28688 catalog_manager.cc:5868] T 00000000000000000000000000000000 P dd1a1b9365c149658ce1696deaf75519: Generated new TSK 0
I20260811 08:12:41.079326 28688 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.27.243.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.243.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.243.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.193.keytab.
Entry for principal kudu/127.27.243.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.193.keytab.
I20260811 08:12:41.107863 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435717191469-28623-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435717191469-28623-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435717191469-28623-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435717191469-28623-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.243.193:0
--local_ip_for_outbound_sockets=127.27.243.193
--webserver_interface=127.27.243.193
--webserver_port=0
--tserver_master_addrs=127.27.243.254:37617
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.193.keytab
--principal=kudu/127.27.243.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:46029
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:12:41.190909 28711 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:12:41.191118 28711 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:12:41.191140 28711 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:12:41.192314 28711 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:12:41.192360 28711 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:12:41.192386 28711 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.243.193
I20260811 08:12:41.193922 28711 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:46029
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435717191469-28623-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435717191469-28623-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.193.keytab
--principal=kudu/127.27.243.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.243.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435717191469-28623-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.243.193
--webserver_port=0
--tserver_master_addrs=127.27.243.254:37617
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28711
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.243.193
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435717191469-28623-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:12:41.194146 28711 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:12:41.194377 28711 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:12:41.199131 28716 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:12:41.199162 28723 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:12:41.199213 28717 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:12:41.199427 28711 server_base.cc:1034] running on GCE node
I20260811 08:12:41.199625 28711 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:12:41.199859 28711 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:12:41.201021 28711 hybrid_clock.cc:648] HybridClock initialized: now 1786435961201010 us; error 28 us; skew 500 ppm
Aug 11 08:12:41 dist-test-slave-7lbf krb5kdc[28526](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435961, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:12:41.203636 28711 init.cc:377] Logged in from keytab as kudu/127.27.243.193@KRBTEST.COM (short username kudu)
I20260811 08:12:41.204114 28711 webserver.cc:460] Webserver started at http://127.27.243.193:45699/ using document root <none> and password file <none>
I20260811 08:12:41.204326 28711 fs_manager.cc:359] Metadata directory not provided
I20260811 08:12:41.204376 28711 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:12:41.204507 28711 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:12:41.205600 28711 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435717191469-28623-0/minicluster-data/ts-0/data/instance:
uuid: "2ee130eb9a944a08a3238405dcd65266"
format_stamp: "Formatted at 2026-08-11 08:12:41 on dist-test-slave-7lbf"
server_key: "601d65e7ddbd714491de484c2e8cd51b"
server_key_iv: "394dc13f1ee42fc80b89743e06c38201"
server_key_version: "encryptionkey@0"
I20260811 08:12:41.205941 28711 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435717191469-28623-0/minicluster-data/ts-0/wal/instance:
uuid: "2ee130eb9a944a08a3238405dcd65266"
format_stamp: "Formatted at 2026-08-11 08:12:41 on dist-test-slave-7lbf"
server_key: "601d65e7ddbd714491de484c2e8cd51b"
server_key_iv: "394dc13f1ee42fc80b89743e06c38201"
server_key_version: "encryptionkey@0"
I20260811 08:12:41.207234 28711 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 08:12:41.207988 28732 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:12:41.208133 28711 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 08:12:41.208220 28711 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435717191469-28623-0/minicluster-data/ts-0/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435717191469-28623-0/minicluster-data/ts-0/wal
uuid: "2ee130eb9a944a08a3238405dcd65266"
format_stamp: "Formatted at 2026-08-11 08:12:41 on dist-test-slave-7lbf"
server_key: "601d65e7ddbd714491de484c2e8cd51b"
server_key_iv: "394dc13f1ee42fc80b89743e06c38201"
server_key_version: "encryptionkey@0"
I20260811 08:12:41.208279 28711 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435717191469-28623-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435717191469-28623-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435717191469-28623-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:12:41.223994 28711 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:12:41.226109 28711 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:12:41.226248 28711 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:12:41.226481 28711 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:12:41.226804 28711 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:12:41.226838 28711 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:12:41.226867 28711 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:12:41.226900 28711 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:12:41.232679 28711 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.193:43997
I20260811 08:12:41.232733 28935 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.193:43997 every 8 connection(s)
I20260811 08:12:41.233044 28711 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435717191469-28623-0/minicluster-data/ts-0/data/info.pb
I20260811 08:12:41.233284 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 28711
I20260811 08:12:41.233424 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435717191469-28623-0/minicluster-data/ts-0/wal/instance
I20260811 08:12:41.233692 28623 external_mini_cluster.cc:1428] Setting key 4a374fcdf7975b6ebbf4626604a6ff31
Aug 11 08:12:41 dist-test-slave-7lbf krb5kdc[28526](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435961, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.193@KRBTEST.COM for kudu/127.27.243.254@KRBTEST.COM
I20260811 08:12:41.242471 28704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:41.233894 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.193:36497 (local address 127.27.243.254:37617)
0811 08:12:41.233944 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 08:12:41.233946 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:12:41.234185 (+ 239us) server_negotiation.cc:407] Connection header received
0811 08:12:41.234742 (+ 557us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:12:41.234744 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:12:41.234762 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:12:41.234822 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:12:41.235767 (+ 945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:41.236269 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:41.237243 (+ 974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:41.237506 (+ 263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:41.237587 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:41.239702 (+ 2115us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:12:41.239704 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:12:41.239704 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:12:41.239712 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:12:41.241165 (+ 1453us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:12:41.241574 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:12:41.241575 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:12:41.241576 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:12:41.241638 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:12:41.241862 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:12:41.241863 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:12:41.241863 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:12:41.241995 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:12:41.242059 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0811 08:12:41.242298 (+ 239us) server_negotiation.cc:299] Negotiation successful
0811 08:12:41.242384 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 08:12:41.242543 28941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:41.233885 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:37617 (local address 127.27.243.193:36497)
0811 08:12:41.234057 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0811 08:12:41.234101 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 08:12:41.234641 (+ 540us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:12:41.234895 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:12:41.234900 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:12:41.235465 (+ 565us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:12:41.235666 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:12:41.235672 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:12:41.236355 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:12:41.236356 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:12:41.237158 (+ 802us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:12:41.237161 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:12:41.237606 (+ 445us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:12:41.237608 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:12:41.237736 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:41.238205 (+ 469us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:12:41.238214 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:12:41.239612 (+ 1398us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:12:41.241246 (+ 1634us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:12:41.241255 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:12:41.241257 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:12:41.241470 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:12:41.241700 (+ 230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:12:41.241701 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:12:41.241701 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:12:41.241804 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:12:41.242058 (+ 254us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:12:41.242062 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:12:41.242177 (+ 115us) client_negotiation.cc:769] Sending connection context
0811 08:12:41.242254 (+ 77us) client_negotiation.cc:240] Negotiation successful
0811 08:12:41.242377 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":94,"threads_started":1}
WARNING: no policy specified for kudu/127.27.243.194@KRBTEST.COM; defaulting to no policy
I20260811 08:12:41.243043 28936 heartbeater.cc:347] Connected to a master server at 127.27.243.254:37617
I20260811 08:12:41.243124 28936 heartbeater.cc:464] Registering TS with master...
I20260811 08:12:41.243295 28936 heartbeater.cc:511] Master 127.27.243.254:37617 requested a full tablet report, sending...
I20260811 08:12:41.243793 28601 ts_manager.cc:194] Registered new tserver with Master: 2ee130eb9a944a08a3238405dcd65266 (127.27.243.193:43997)
I20260811 08:12:41.244370 28601 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.243.193@KRBTEST.COM'} at 127.27.243.193:36497
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.243.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.243.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.194.keytab.
Entry for principal kudu/127.27.243.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.194.keytab.
I20260811 08:12:41.259608 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435717191469-28623-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435717191469-28623-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435717191469-28623-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435717191469-28623-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.243.194:0
--local_ip_for_outbound_sockets=127.27.243.194
--webserver_interface=127.27.243.194
--webserver_port=0
--tserver_master_addrs=127.27.243.254:37617
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.194.keytab
--principal=kudu/127.27.243.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:46029
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:12:41.341017 28945 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:12:41.341215 28945 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:12:41.341238 28945 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:12:41.342350 28945 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:12:41.342386 28945 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:12:41.342411 28945 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.243.194
I20260811 08:12:41.343783 28945 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:46029
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435717191469-28623-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435717191469-28623-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.194.keytab
--principal=kudu/127.27.243.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.243.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435717191469-28623-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.243.194
--webserver_port=0
--tserver_master_addrs=127.27.243.254:37617
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28945
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.243.194
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435717191469-28623-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:12:41.343967 28945 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:12:41.344151 28945 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:12:41.349021 28957 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:12:41.349067 28959 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:12:41.349133 28955 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:12:41.349212 28945 server_base.cc:1034] running on GCE node
I20260811 08:12:41.349398 28945 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:12:41.349647 28945 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:12:41.350801 28945 hybrid_clock.cc:648] HybridClock initialized: now 1786435961350783 us; error 30 us; skew 500 ppm
Aug 11 08:12:41 dist-test-slave-7lbf krb5kdc[28526](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435961, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:12:41.353374 28945 init.cc:377] Logged in from keytab as kudu/127.27.243.194@KRBTEST.COM (short username kudu)
I20260811 08:12:41.353873 28945 webserver.cc:460] Webserver started at http://127.27.243.194:42677/ using document root <none> and password file <none>
I20260811 08:12:41.354115 28945 fs_manager.cc:359] Metadata directory not provided
I20260811 08:12:41.354164 28945 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:12:41.354310 28945 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:12:41.355329 28945 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435717191469-28623-0/minicluster-data/ts-1/data/instance:
uuid: "d81002531c0b4ac3a0e7c8d2245cf0a4"
format_stamp: "Formatted at 2026-08-11 08:12:41 on dist-test-slave-7lbf"
server_key: "56d3e0f54459b2555a4c681c1d355542"
server_key_iv: "b6cd4c919c5d349d240e95baf7f5c3a3"
server_key_version: "encryptionkey@0"
I20260811 08:12:41.355659 28945 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435717191469-28623-0/minicluster-data/ts-1/wal/instance:
uuid: "d81002531c0b4ac3a0e7c8d2245cf0a4"
format_stamp: "Formatted at 2026-08-11 08:12:41 on dist-test-slave-7lbf"
server_key: "56d3e0f54459b2555a4c681c1d355542"
server_key_iv: "b6cd4c919c5d349d240e95baf7f5c3a3"
server_key_version: "encryptionkey@0"
I20260811 08:12:41.356938 28945 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 08:12:41.357654 28969 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:12:41.357805 28945 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 08:12:41.357895 28945 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435717191469-28623-0/minicluster-data/ts-1/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435717191469-28623-0/minicluster-data/ts-1/wal
uuid: "d81002531c0b4ac3a0e7c8d2245cf0a4"
format_stamp: "Formatted at 2026-08-11 08:12:41 on dist-test-slave-7lbf"
server_key: "56d3e0f54459b2555a4c681c1d355542"
server_key_iv: "b6cd4c919c5d349d240e95baf7f5c3a3"
server_key_version: "encryptionkey@0"
I20260811 08:12:41.357964 28945 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435717191469-28623-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435717191469-28623-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435717191469-28623-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:12:41.369177 28945 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:12:41.371253 28945 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:12:41.371397 28945 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:12:41.371613 28945 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:12:41.371918 28945 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:12:41.371953 28945 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:12:41.371982 28945 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:12:41.372004 28945 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:12:41.377914 28945 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.194:33245
I20260811 08:12:41.377964 29155 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.194:33245 every 8 connection(s)
I20260811 08:12:41.378273 28945 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435717191469-28623-0/minicluster-data/ts-1/data/info.pb
Aug 11 08:12:41 dist-test-slave-7lbf krb5kdc[28526](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435961, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.194@KRBTEST.COM for kudu/127.27.243.254@KRBTEST.COM
I20260811 08:12:41.384878 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 28945
I20260811 08:12:41.385010 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435717191469-28623-0/minicluster-data/ts-1/wal/instance
I20260811 08:12:41.385245 28623 external_mini_cluster.cc:1428] Setting key 7cf9cadf6e73987f70664236371f7f68
I20260811 08:12:41.387697 28704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:41.378989 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.194:48295 (local address 127.27.243.254:37617)
0811 08:12:41.379076 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0811 08:12:41.379078 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:12:41.379214 (+ 136us) server_negotiation.cc:407] Connection header received
0811 08:12:41.379713 (+ 499us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:12:41.379714 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:12:41.379726 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:12:41.379774 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:12:41.380727 (+ 953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:41.381251 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:41.382286 (+ 1035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:41.382491 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:41.382562 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:41.384703 (+ 2141us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:12:41.384705 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:12:41.384706 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:12:41.384714 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:12:41.386318 (+ 1604us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:12:41.386737 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:12:41.386738 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:12:41.386738 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:12:41.386804 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:12:41.387045 (+ 241us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:12:41.387046 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:12:41.387046 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:12:41.387167 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:12:41.387234 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 08:12:41.387507 (+ 273us) server_negotiation.cc:299] Negotiation successful
0811 08:12:41.387602 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260811 08:12:41.387890 29158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:41.378953 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:37617 (local address 127.27.243.194:48295)
0811 08:12:41.379095 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0811 08:12:41.379133 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 08:12:41.379625 (+ 492us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:12:41.379842 (+ 217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:12:41.379846 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:12:41.380442 (+ 596us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:12:41.380645 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:12:41.380650 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:12:41.381340 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:12:41.381341 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:12:41.382195 (+ 854us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:12:41.382198 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:12:41.382571 (+ 373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:12:41.382572 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:12:41.382667 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:41.383220 (+ 553us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:12:41.383229 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:12:41.384597 (+ 1368us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:12:41.386408 (+ 1811us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:12:41.386417 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:12:41.386419 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:12:41.386658 (+ 239us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:12:41.386869 (+ 211us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:12:41.386870 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:12:41.386870 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:12:41.386984 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:12:41.387229 (+ 245us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:12:41.387237 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:12:41.387383 (+ 146us) client_negotiation.cc:769] Sending connection context
0811 08:12:41.387480 (+ 97us) client_negotiation.cc:240] Negotiation successful
0811 08:12:41.387649 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":73,"threads_started":1}
I20260811 08:12:41.388520 29156 heartbeater.cc:347] Connected to a master server at 127.27.243.254:37617
I20260811 08:12:41.388631 29156 heartbeater.cc:464] Registering TS with master...
I20260811 08:12:41.388824 29156 heartbeater.cc:511] Master 127.27.243.254:37617 requested a full tablet report, sending...
I20260811 08:12:41.389242 28601 ts_manager.cc:194] Registered new tserver with Master: d81002531c0b4ac3a0e7c8d2245cf0a4 (127.27.243.194:33245)
I20260811 08:12:41.389683 28601 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.243.194@KRBTEST.COM'} at 127.27.243.194:48295
WARNING: no policy specified for kudu/127.27.243.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.243.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.243.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.195.keytab.
Entry for principal kudu/127.27.243.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.195.keytab.
I20260811 08:12:41.410750 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435717191469-28623-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435717191469-28623-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435717191469-28623-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435717191469-28623-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.243.195:0
--local_ip_for_outbound_sockets=127.27.243.195
--webserver_interface=127.27.243.195
--webserver_port=0
--tserver_master_addrs=127.27.243.254:37617
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.195.keytab
--principal=kudu/127.27.243.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:46029
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:12:41.491858 29161 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:12:41.492055 29161 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:12:41.492084 29161 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:12:41.493199 29161 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:12:41.493238 29161 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:12:41.493273 29161 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.243.195
I20260811 08:12:41.494694 29161 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:46029
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435717191469-28623-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435717191469-28623-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.195.keytab
--principal=kudu/127.27.243.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.243.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435717191469-28623-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.243.195
--webserver_port=0
--tserver_master_addrs=127.27.243.254:37617
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29161
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.243.195
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435717191469-28623-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:12:41.494940 29161 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:12:41.495141 29161 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:12:41.499903 29168 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:12:41.499928 29169 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:12:41.499953 29161 server_base.cc:1034] running on GCE node
W20260811 08:12:41.499928 29172 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:12:41.500308 29161 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:12:41.500519 29161 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:12:41.501641 29161 hybrid_clock.cc:648] HybridClock initialized: now 1786435961501626 us; error 29 us; skew 500 ppm
Aug 11 08:12:41 dist-test-slave-7lbf krb5kdc[28526](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435961, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:12:41.504020 29161 init.cc:377] Logged in from keytab as kudu/127.27.243.195@KRBTEST.COM (short username kudu)
I20260811 08:12:41.504451 29161 webserver.cc:460] Webserver started at http://127.27.243.195:34333/ using document root <none> and password file <none>
I20260811 08:12:41.504660 29161 fs_manager.cc:359] Metadata directory not provided
I20260811 08:12:41.504703 29161 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:12:41.504817 29161 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:12:41.505861 29161 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435717191469-28623-0/minicluster-data/ts-2/data/instance:
uuid: "c86508c9878549b9a4e68360a55d8c8d"
format_stamp: "Formatted at 2026-08-11 08:12:41 on dist-test-slave-7lbf"
server_key: "845ef22b7b5a1663cff98ed6664553f2"
server_key_iv: "398fdf8c46aa36721a73e6d68ad1f3c2"
server_key_version: "encryptionkey@0"
I20260811 08:12:41.506172 29161 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435717191469-28623-0/minicluster-data/ts-2/wal/instance:
uuid: "c86508c9878549b9a4e68360a55d8c8d"
format_stamp: "Formatted at 2026-08-11 08:12:41 on dist-test-slave-7lbf"
server_key: "845ef22b7b5a1663cff98ed6664553f2"
server_key_iv: "398fdf8c46aa36721a73e6d68ad1f3c2"
server_key_version: "encryptionkey@0"
I20260811 08:12:41.507376 29161 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 08:12:41.508070 29188 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:12:41.508271 29161 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:12:41.508361 29161 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435717191469-28623-0/minicluster-data/ts-2/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435717191469-28623-0/minicluster-data/ts-2/wal
uuid: "c86508c9878549b9a4e68360a55d8c8d"
format_stamp: "Formatted at 2026-08-11 08:12:41 on dist-test-slave-7lbf"
server_key: "845ef22b7b5a1663cff98ed6664553f2"
server_key_iv: "398fdf8c46aa36721a73e6d68ad1f3c2"
server_key_version: "encryptionkey@0"
I20260811 08:12:41.508422 29161 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435717191469-28623-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435717191469-28623-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435717191469-28623-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:12:41.532987 29161 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:12:41.535254 29161 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:12:41.535380 29161 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:12:41.535586 29161 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:12:41.535882 29161 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:12:41.535918 29161 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:12:41.535943 29161 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:12:41.535964 29161 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:12:41.542084 29161 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.195:34965
I20260811 08:12:41.542153 29384 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.195:34965 every 8 connection(s)
I20260811 08:12:41.542475 29161 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435717191469-28623-0/minicluster-data/ts-2/data/info.pb
I20260811 08:12:41.546195 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 29161
I20260811 08:12:41.546304 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435717191469-28623-0/minicluster-data/ts-2/wal/instance
I20260811 08:12:41.546504 28623 external_mini_cluster.cc:1428] Setting key ae74d80151703c49e5d3a4fc4c6f79d8
Aug 11 08:12:41 dist-test-slave-7lbf krb5kdc[28526](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435961, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.195@KRBTEST.COM for kudu/127.27.243.254@KRBTEST.COM
I20260811 08:12:41.551692 28704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:41.543180 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.195:47685 (local address 127.27.243.254:37617)
0811 08:12:41.543242 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0811 08:12:41.543244 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:12:41.543459 (+ 215us) server_negotiation.cc:407] Connection header received
0811 08:12:41.543926 (+ 467us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:12:41.543928 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:12:41.543939 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:12:41.544004 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:12:41.544982 (+ 978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:41.545479 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:41.546786 (+ 1307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:41.547059 (+ 273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:41.547122 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:41.549143 (+ 2021us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:12:41.549144 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:12:41.549145 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:12:41.549151 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:12:41.550571 (+ 1420us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:12:41.550952 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:12:41.550953 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:12:41.550953 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:12:41.551015 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:12:41.551209 (+ 194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:12:41.551209 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:12:41.551210 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:12:41.551311 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:12:41.551357 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0811 08:12:41.551565 (+ 208us) server_negotiation.cc:299] Negotiation successful
0811 08:12:41.551629 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260811 08:12:41.551892 29395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:41.543149 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:37617 (local address 127.27.243.195:47685)
0811 08:12:41.543314 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0811 08:12:41.543366 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0811 08:12:41.543838 (+ 472us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:12:41.544060 (+ 222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:12:41.544064 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:12:41.544622 (+ 558us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:12:41.544812 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:12:41.544817 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:12:41.545613 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:12:41.545614 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:12:41.546706 (+ 1092us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:12:41.546708 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:12:41.547140 (+ 432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:12:41.547141 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:12:41.547276 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:41.547734 (+ 458us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:12:41.547743 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:12:41.549064 (+ 1321us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:12:41.550641 (+ 1577us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:12:41.550648 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:12:41.550649 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:12:41.550864 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:12:41.551074 (+ 210us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:12:41.551075 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:12:41.551075 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:12:41.551164 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:12:41.551357 (+ 193us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:12:41.551360 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:12:41.551469 (+ 109us) client_negotiation.cc:769] Sending connection context
0811 08:12:41.551545 (+ 76us) client_negotiation.cc:240] Negotiation successful
0811 08:12:41.551661 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":78,"threads_started":1}
I20260811 08:12:41.552336 29385 heartbeater.cc:347] Connected to a master server at 127.27.243.254:37617
I20260811 08:12:41.552434 29385 heartbeater.cc:464] Registering TS with master...
I20260811 08:12:41.552593 29385 heartbeater.cc:511] Master 127.27.243.254:37617 requested a full tablet report, sending...
I20260811 08:12:41.552953 28601 ts_manager.cc:194] Registered new tserver with Master: c86508c9878549b9a4e68360a55d8c8d (127.27.243.195:34965)
I20260811 08:12:41.553287 28601 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.243.195@KRBTEST.COM'} at 127.27.243.195:47685
I20260811 08:12:41.558271 28623 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 08:12:41.565238 28704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:41.559585 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53526 (local address 127.27.243.254:37617)
0811 08:12:41.559643 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0811 08:12:41.559645 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:12:41.559791 (+ 146us) server_negotiation.cc:407] Connection header received
0811 08:12:41.559838 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:12:41.559839 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:12:41.559855 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:12:41.559902 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:12:41.560443 (+ 541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:41.560961 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:41.561785 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:41.562000 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:41.562052 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:41.563125 (+ 1073us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:12:41.563126 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:12:41.563126 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:12:41.563132 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:12:41.564327 (+ 1195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:12:41.564631 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:12:41.564631 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:12:41.564631 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:12:41.564677 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:12:41.564798 (+ 121us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:12:41.564799 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:12:41.564799 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:12:41.564951 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:12:41.565022 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 08:12:41.565108 (+ 86us) server_negotiation.cc:299] Negotiation successful
0811 08:12:41.565165 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 08:12:41.566767 28601 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53526:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 08:12:41.568302 28601 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 08:12:41.574525 29402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:41.570402 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.194:33245 (local address 127.0.0.1:55244)
0811 08:12:41.570720 (+ 318us) negotiation.cc:107] Waiting for socket to connect
0811 08:12:41.570762 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 08:12:41.570849 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:12:41.571160 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:12:41.571163 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:12:41.571166 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:12:41.571231 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:12:41.571233 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:12:41.572500 (+ 1267us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:12:41.572500 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:12:41.573573 (+ 1073us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:12:41.573576 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:12:41.574275 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:12:41.574276 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:12:41.574340 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:41.574344 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 08:12:41.574393 (+ 49us) client_negotiation.cc:240] Negotiation successful
0811 08:12:41.574434 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":291,"mutex_wait_us":24,"thread_start_us":79,"threads_started":1}
I20260811 08:12:41.574537 29405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:41.570514 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55244 (local address 127.27.243.194:33245)
0811 08:12:41.570723 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0811 08:12:41.570728 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 08:12:41.570836 (+ 108us) server_negotiation.cc:407] Connection header received
0811 08:12:41.570971 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:12:41.570974 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:12:41.570991 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:12:41.571046 (+ 55us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:12:41.571327 (+ 281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:41.572385 (+ 1058us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:41.573655 (+ 1270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:41.574201 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:41.574273 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:41.574328 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 08:12:41.574418 (+ 90us) server_negotiation.cc:299] Negotiation successful
0811 08:12:41.574460 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":163,"thread_start_us":102,"threads_started":1}
I20260811 08:12:41.574421 29408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:41.570421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.195:34965 (local address 127.0.0.1:56868)
0811 08:12:41.570927 (+ 506us) negotiation.cc:107] Waiting for socket to connect
0811 08:12:41.570937 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 08:12:41.571001 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:12:41.571183 (+ 182us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:12:41.571183 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:12:41.571186 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:12:41.571235 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:12:41.571237 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:12:41.572187 (+ 950us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:12:41.572188 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:12:41.573226 (+ 1038us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:12:41.573229 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:12:41.574128 (+ 899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:12:41.574129 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:12:41.574212 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:41.574229 (+ 17us) client_negotiation.cc:769] Sending connection context
0811 08:12:41.574291 (+ 62us) client_negotiation.cc:240] Negotiation successful
0811 08:12:41.574343 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":492,"mutex_wait_us":1,"thread_start_us":50,"threads_started":1}
I20260811 08:12:41.574601 29409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:41.570736 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56868 (local address 127.27.243.195:34965)
0811 08:12:41.570951 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0811 08:12:41.570957 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 08:12:41.570986 (+ 29us) server_negotiation.cc:407] Connection header received
0811 08:12:41.571065 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:12:41.571068 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:12:41.571084 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:12:41.571305 (+ 221us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:12:41.571369 (+ 64us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:41.572098 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:41.573301 (+ 1203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:41.574045 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:41.574120 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:41.574173 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 08:12:41.574487 (+ 314us) server_negotiation.cc:299] Negotiation successful
0811 08:12:41.574529 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":181,"thread_start_us":96,"threads_started":1}
I20260811 08:12:41.575232 29404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:41.570617 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.193:43997 (local address 127.0.0.1:37058)
0811 08:12:41.571091 (+ 474us) negotiation.cc:107] Waiting for socket to connect
0811 08:12:41.571099 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 08:12:41.571143 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:12:41.571426 (+ 283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:12:41.571427 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:12:41.571429 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:12:41.571466 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:12:41.571467 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:12:41.572700 (+ 1233us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:12:41.572701 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:12:41.573674 (+ 973us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:12:41.573677 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:12:41.575005 (+ 1328us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:12:41.575006 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:12:41.575068 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:41.575073 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 08:12:41.575131 (+ 58us) client_negotiation.cc:240] Negotiation successful
0811 08:12:41.575169 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":465,"thread_start_us":46,"threads_started":1}
I20260811 08:12:41.575289 29411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:41.570729 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37058 (local address 127.27.243.193:43997)
0811 08:12:41.570976 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0811 08:12:41.570980 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 08:12:41.571203 (+ 223us) server_negotiation.cc:407] Connection header received
0811 08:12:41.571249 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:12:41.571251 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:12:41.571267 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:12:41.571331 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:12:41.571551 (+ 220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:41.572597 (+ 1046us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:41.573755 (+ 1158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:41.574441 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:41.574498 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:41.574546 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0811 08:12:41.575161 (+ 615us) server_negotiation.cc:299] Negotiation successful
0811 08:12:41.575208 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":216,"thread_start_us":122,"threads_started":1}
I20260811 08:12:41.575343 29047 tablet_service.cc:1467] Processing CreateTablet for tablet ad977884c3f54f12826882793aca11ca (DEFAULT_TABLE table=test-table [id=27eb54c16412496c829fb31d11f3fb2f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:12:41.575367 29274 tablet_service.cc:1467] Processing CreateTablet for tablet ad977884c3f54f12826882793aca11ca (DEFAULT_TABLE table=test-table [id=27eb54c16412496c829fb31d11f3fb2f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:12:41.575714 29274 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ad977884c3f54f12826882793aca11ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:12:41.575726 29047 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ad977884c3f54f12826882793aca11ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:12:41.576125 28821 tablet_service.cc:1467] Processing CreateTablet for tablet ad977884c3f54f12826882793aca11ca (DEFAULT_TABLE table=test-table [id=27eb54c16412496c829fb31d11f3fb2f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:12:41.576447 28821 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ad977884c3f54f12826882793aca11ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:12:41.578317 29413 tablet_bootstrap.cc:492] T ad977884c3f54f12826882793aca11ca P c86508c9878549b9a4e68360a55d8c8d: Bootstrap starting.
I20260811 08:12:41.578953 29413 tablet_bootstrap.cc:654] T ad977884c3f54f12826882793aca11ca P c86508c9878549b9a4e68360a55d8c8d: Neither blocks nor log segments found. Creating new log.
I20260811 08:12:41.579027 29415 tablet_bootstrap.cc:492] T ad977884c3f54f12826882793aca11ca P d81002531c0b4ac3a0e7c8d2245cf0a4: Bootstrap starting.
I20260811 08:12:41.579658 29415 tablet_bootstrap.cc:654] T ad977884c3f54f12826882793aca11ca P d81002531c0b4ac3a0e7c8d2245cf0a4: Neither blocks nor log segments found. Creating new log.
I20260811 08:12:41.579862 29413 log.cc:824] T ad977884c3f54f12826882793aca11ca P c86508c9878549b9a4e68360a55d8c8d: Log is configured to *not* fsync() on all Append() calls
I20260811 08:12:41.580211 29415 log.cc:824] T ad977884c3f54f12826882793aca11ca P d81002531c0b4ac3a0e7c8d2245cf0a4: Log is configured to *not* fsync() on all Append() calls
I20260811 08:12:41.580229 29417 tablet_bootstrap.cc:492] T ad977884c3f54f12826882793aca11ca P 2ee130eb9a944a08a3238405dcd65266: Bootstrap starting.
I20260811 08:12:41.580628 29413 tablet_bootstrap.cc:492] T ad977884c3f54f12826882793aca11ca P c86508c9878549b9a4e68360a55d8c8d: No bootstrap required, opened a new log
I20260811 08:12:41.580703 29413 ts_tablet_manager.cc:1397] T ad977884c3f54f12826882793aca11ca P c86508c9878549b9a4e68360a55d8c8d: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 08:12:41.580783 29417 tablet_bootstrap.cc:654] T ad977884c3f54f12826882793aca11ca P 2ee130eb9a944a08a3238405dcd65266: Neither blocks nor log segments found. Creating new log.
I20260811 08:12:41.581056 29415 tablet_bootstrap.cc:492] T ad977884c3f54f12826882793aca11ca P d81002531c0b4ac3a0e7c8d2245cf0a4: No bootstrap required, opened a new log
I20260811 08:12:41.581130 29415 ts_tablet_manager.cc:1397] T ad977884c3f54f12826882793aca11ca P d81002531c0b4ac3a0e7c8d2245cf0a4: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 08:12:41.581295 29417 log.cc:824] T ad977884c3f54f12826882793aca11ca P 2ee130eb9a944a08a3238405dcd65266: Log is configured to *not* fsync() on all Append() calls
I20260811 08:12:41.582100 29417 tablet_bootstrap.cc:492] T ad977884c3f54f12826882793aca11ca P 2ee130eb9a944a08a3238405dcd65266: No bootstrap required, opened a new log
I20260811 08:12:41.582170 29417 ts_tablet_manager.cc:1397] T ad977884c3f54f12826882793aca11ca P 2ee130eb9a944a08a3238405dcd65266: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 08:12:41.582497 29413 raft_consensus.cc:348] T ad977884c3f54f12826882793aca11ca P c86508c9878549b9a4e68360a55d8c8d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d81002531c0b4ac3a0e7c8d2245cf0a4" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 33245 } } peers { permanent_uuid: "2ee130eb9a944a08a3238405dcd65266" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 43997 } } peers { permanent_uuid: "c86508c9878549b9a4e68360a55d8c8d" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 34965 } }
I20260811 08:12:41.582636 29413 raft_consensus.cc:374] T ad977884c3f54f12826882793aca11ca P c86508c9878549b9a4e68360a55d8c8d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:12:41.582669 29413 raft_consensus.cc:729] T ad977884c3f54f12826882793aca11ca P c86508c9878549b9a4e68360a55d8c8d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c86508c9878549b9a4e68360a55d8c8d, State: Initialized, Role: FOLLOWER
I20260811 08:12:41.582784 29413 consensus_queue.cc:260] T ad977884c3f54f12826882793aca11ca P c86508c9878549b9a4e68360a55d8c8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d81002531c0b4ac3a0e7c8d2245cf0a4" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 33245 } } peers { permanent_uuid: "2ee130eb9a944a08a3238405dcd65266" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 43997 } } peers { permanent_uuid: "c86508c9878549b9a4e68360a55d8c8d" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 34965 } }
I20260811 08:12:41.583039 29413 ts_tablet_manager.cc:1428] T ad977884c3f54f12826882793aca11ca P c86508c9878549b9a4e68360a55d8c8d: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260811 08:12:41.582970 29415 raft_consensus.cc:348] T ad977884c3f54f12826882793aca11ca P d81002531c0b4ac3a0e7c8d2245cf0a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d81002531c0b4ac3a0e7c8d2245cf0a4" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 33245 } } peers { permanent_uuid: "2ee130eb9a944a08a3238405dcd65266" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 43997 } } peers { permanent_uuid: "c86508c9878549b9a4e68360a55d8c8d" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 34965 } }
I20260811 08:12:41.583146 29415 raft_consensus.cc:374] T ad977884c3f54f12826882793aca11ca P d81002531c0b4ac3a0e7c8d2245cf0a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:12:41.583165 29385 heartbeater.cc:503] Master 127.27.243.254:37617 was elected leader, sending a full tablet report...
I20260811 08:12:41.583184 29415 raft_consensus.cc:729] T ad977884c3f54f12826882793aca11ca P d81002531c0b4ac3a0e7c8d2245cf0a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d81002531c0b4ac3a0e7c8d2245cf0a4, State: Initialized, Role: FOLLOWER
I20260811 08:12:41.583287 29415 consensus_queue.cc:260] T ad977884c3f54f12826882793aca11ca P d81002531c0b4ac3a0e7c8d2245cf0a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d81002531c0b4ac3a0e7c8d2245cf0a4" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 33245 } } peers { permanent_uuid: "2ee130eb9a944a08a3238405dcd65266" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 43997 } } peers { permanent_uuid: "c86508c9878549b9a4e68360a55d8c8d" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 34965 } }
I20260811 08:12:41.583539 29415 ts_tablet_manager.cc:1428] T ad977884c3f54f12826882793aca11ca P d81002531c0b4ac3a0e7c8d2245cf0a4: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260811 08:12:41.583801 29156 heartbeater.cc:503] Master 127.27.243.254:37617 was elected leader, sending a full tablet report...
I20260811 08:12:41.584125 29417 raft_consensus.cc:348] T ad977884c3f54f12826882793aca11ca P 2ee130eb9a944a08a3238405dcd65266 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d81002531c0b4ac3a0e7c8d2245cf0a4" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 33245 } } peers { permanent_uuid: "2ee130eb9a944a08a3238405dcd65266" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 43997 } } peers { permanent_uuid: "c86508c9878549b9a4e68360a55d8c8d" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 34965 } }
I20260811 08:12:41.584288 29417 raft_consensus.cc:374] T ad977884c3f54f12826882793aca11ca P 2ee130eb9a944a08a3238405dcd65266 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:12:41.584339 29417 raft_consensus.cc:729] T ad977884c3f54f12826882793aca11ca P 2ee130eb9a944a08a3238405dcd65266 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ee130eb9a944a08a3238405dcd65266, State: Initialized, Role: FOLLOWER
I20260811 08:12:41.584462 29417 consensus_queue.cc:260] T ad977884c3f54f12826882793aca11ca P 2ee130eb9a944a08a3238405dcd65266 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d81002531c0b4ac3a0e7c8d2245cf0a4" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 33245 } } peers { permanent_uuid: "2ee130eb9a944a08a3238405dcd65266" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 43997 } } peers { permanent_uuid: "c86508c9878549b9a4e68360a55d8c8d" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 34965 } }
I20260811 08:12:41.584704 29417 ts_tablet_manager.cc:1428] T ad977884c3f54f12826882793aca11ca P 2ee130eb9a944a08a3238405dcd65266: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260811 08:12:41.584754 28936 heartbeater.cc:503] Master 127.27.243.254:37617 was elected leader, sending a full tablet report...
W20260811 08:12:41.628890 29157 tablet.cc:2369] T ad977884c3f54f12826882793aca11ca P d81002531c0b4ac3a0e7c8d2245cf0a4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 08:12:41.645965 29425 raft_consensus.cc:482] T ad977884c3f54f12826882793aca11ca P 2ee130eb9a944a08a3238405dcd65266 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:12:41.646142 29425 raft_consensus.cc:504] T ad977884c3f54f12826882793aca11ca P 2ee130eb9a944a08a3238405dcd65266 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d81002531c0b4ac3a0e7c8d2245cf0a4" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 33245 } } peers { permanent_uuid: "2ee130eb9a944a08a3238405dcd65266" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 43997 } } peers { permanent_uuid: "c86508c9878549b9a4e68360a55d8c8d" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 34965 } }
I20260811 08:12:41.646584 29425 leader_election.cc:288] T ad977884c3f54f12826882793aca11ca P 2ee130eb9a944a08a3238405dcd65266 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d81002531c0b4ac3a0e7c8d2245cf0a4 (127.27.243.194:33245), c86508c9878549b9a4e68360a55d8c8d (127.27.243.195:34965)
I20260811 08:12:41.650557 29409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:41.646916 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.193:33935 (local address 127.27.243.195:34965)
0811 08:12:41.646974 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0811 08:12:41.646976 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:12:41.647035 (+ 59us) server_negotiation.cc:407] Connection header received
0811 08:12:41.647088 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:12:41.647090 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:12:41.647099 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:12:41.647143 (+ 44us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:12:41.647260 (+ 117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:41.647967 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:41.649492 (+ 1525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:41.650132 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:41.650219 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:41.650227 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 08:12:41.650426 (+ 199us) server_negotiation.cc:299] Negotiation successful
0811 08:12:41.650468 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 08:12:41.650557 29405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:41.646876 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.193:51355 (local address 127.27.243.194:33245)
0811 08:12:41.646927 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 08:12:41.646929 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:12:41.646938 (+ 9us) server_negotiation.cc:407] Connection header received
0811 08:12:41.646965 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:12:41.646966 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:12:41.646975 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:12:41.647034 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:12:41.647190 (+ 156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:41.647966 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:41.649540 (+ 1574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:41.650133 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:41.650216 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:41.650227 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0811 08:12:41.650426 (+ 199us) server_negotiation.cc:299] Negotiation successful
0811 08:12:41.650468 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 08:12:41.650579 28941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:41.646734 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.194:33245 (local address 127.27.243.193:51355)
0811 08:12:41.646788 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0811 08:12:41.646799 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 08:12:41.646838 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:12:41.647043 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:12:41.647044 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:12:41.647046 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:12:41.647120 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:12:41.647122 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:12:41.648063 (+ 941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:12:41.648064 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:12:41.649368 (+ 1304us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:12:41.649372 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:12:41.650240 (+ 868us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:12:41.650241 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:12:41.650346 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:41.650352 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 08:12:41.650413 (+ 61us) client_negotiation.cc:240] Negotiation successful
0811 08:12:41.650465 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34,"mutex_wait_us":78}
I20260811 08:12:41.650585 29426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:41.646735 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.195:34965 (local address 127.27.243.193:33935)
0811 08:12:41.646976 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0811 08:12:41.646984 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 08:12:41.647034 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:12:41.647146 (+ 112us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:12:41.647147 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:12:41.647148 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:12:41.647201 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:12:41.647202 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:12:41.648063 (+ 861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:12:41.648064 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:12:41.649368 (+ 1304us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:12:41.649372 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:12:41.650240 (+ 868us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:12:41.650241 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:12:41.650356 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:41.650358 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 08:12:41.650413 (+ 55us) client_negotiation.cc:240] Negotiation successful
0811 08:12:41.650465 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":219,"mutex_wait_us":47,"thread_start_us":166,"threads_started":1}
I20260811 08:12:41.650939 29081 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad977884c3f54f12826882793aca11ca" candidate_uuid: "2ee130eb9a944a08a3238405dcd65266" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d81002531c0b4ac3a0e7c8d2245cf0a4" is_pre_election: true
I20260811 08:12:41.651124 29081 raft_consensus.cc:2454] T ad977884c3f54f12826882793aca11ca P d81002531c0b4ac3a0e7c8d2245cf0a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ee130eb9a944a08a3238405dcd65266 in term 0.
I20260811 08:12:41.651208 29307 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad977884c3f54f12826882793aca11ca" candidate_uuid: "2ee130eb9a944a08a3238405dcd65266" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c86508c9878549b9a4e68360a55d8c8d" is_pre_election: true
I20260811 08:12:41.651379 29307 raft_consensus.cc:2454] T ad977884c3f54f12826882793aca11ca P c86508c9878549b9a4e68360a55d8c8d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ee130eb9a944a08a3238405dcd65266 in term 0.
I20260811 08:12:41.651373 28734 leader_election.cc:302] T ad977884c3f54f12826882793aca11ca P 2ee130eb9a944a08a3238405dcd65266 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ee130eb9a944a08a3238405dcd65266, d81002531c0b4ac3a0e7c8d2245cf0a4; no voters:
I20260811 08:12:41.651497 29425 raft_consensus.cc:2781] T ad977884c3f54f12826882793aca11ca P 2ee130eb9a944a08a3238405dcd65266 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 08:12:41.651567 29425 raft_consensus.cc:482] T ad977884c3f54f12826882793aca11ca P 2ee130eb9a944a08a3238405dcd65266 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 08:12:41.651597 29425 raft_consensus.cc:3037] T ad977884c3f54f12826882793aca11ca P 2ee130eb9a944a08a3238405dcd65266 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:12:41.652456 29425 raft_consensus.cc:504] T ad977884c3f54f12826882793aca11ca P 2ee130eb9a944a08a3238405dcd65266 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d81002531c0b4ac3a0e7c8d2245cf0a4" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 33245 } } peers { permanent_uuid: "2ee130eb9a944a08a3238405dcd65266" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 43997 } } peers { permanent_uuid: "c86508c9878549b9a4e68360a55d8c8d" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 34965 } }
I20260811 08:12:41.652621 29425 leader_election.cc:288] T ad977884c3f54f12826882793aca11ca P 2ee130eb9a944a08a3238405dcd65266 [CANDIDATE]: Term 1 election: Requested vote from peers d81002531c0b4ac3a0e7c8d2245cf0a4 (127.27.243.194:33245), c86508c9878549b9a4e68360a55d8c8d (127.27.243.195:34965)
I20260811 08:12:41.652776 29307 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad977884c3f54f12826882793aca11ca" candidate_uuid: "2ee130eb9a944a08a3238405dcd65266" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c86508c9878549b9a4e68360a55d8c8d"
I20260811 08:12:41.652818 29081 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad977884c3f54f12826882793aca11ca" candidate_uuid: "2ee130eb9a944a08a3238405dcd65266" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d81002531c0b4ac3a0e7c8d2245cf0a4"
I20260811 08:12:41.652855 29307 raft_consensus.cc:3037] T ad977884c3f54f12826882793aca11ca P c86508c9878549b9a4e68360a55d8c8d [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:12:41.652910 29081 raft_consensus.cc:3037] T ad977884c3f54f12826882793aca11ca P d81002531c0b4ac3a0e7c8d2245cf0a4 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:12:41.653769 29307 raft_consensus.cc:2454] T ad977884c3f54f12826882793aca11ca P c86508c9878549b9a4e68360a55d8c8d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ee130eb9a944a08a3238405dcd65266 in term 1.
I20260811 08:12:41.653812 29081 raft_consensus.cc:2454] T ad977884c3f54f12826882793aca11ca P d81002531c0b4ac3a0e7c8d2245cf0a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ee130eb9a944a08a3238405dcd65266 in term 1.
I20260811 08:12:41.653977 28734 leader_election.cc:302] T ad977884c3f54f12826882793aca11ca P 2ee130eb9a944a08a3238405dcd65266 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 2ee130eb9a944a08a3238405dcd65266, c86508c9878549b9a4e68360a55d8c8d, d81002531c0b4ac3a0e7c8d2245cf0a4; no voters:
I20260811 08:12:41.654129 29425 raft_consensus.cc:2781] T ad977884c3f54f12826882793aca11ca P 2ee130eb9a944a08a3238405dcd65266 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:12:41.654284 29425 raft_consensus.cc:686] T ad977884c3f54f12826882793aca11ca P 2ee130eb9a944a08a3238405dcd65266 [term 1 LEADER]: Becoming Leader. State: Replica: 2ee130eb9a944a08a3238405dcd65266, State: Running, Role: LEADER
I20260811 08:12:41.654376 29425 consensus_queue.cc:237] T ad977884c3f54f12826882793aca11ca P 2ee130eb9a944a08a3238405dcd65266 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d81002531c0b4ac3a0e7c8d2245cf0a4" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 33245 } } peers { permanent_uuid: "2ee130eb9a944a08a3238405dcd65266" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 43997 } } peers { permanent_uuid: "c86508c9878549b9a4e68360a55d8c8d" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 34965 } }
I20260811 08:12:41.655314 28600 catalog_manager.cc:5495] T ad977884c3f54f12826882793aca11ca P 2ee130eb9a944a08a3238405dcd65266 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2ee130eb9a944a08a3238405dcd65266 (127.27.243.193). New cstate: current_term: 1 leader_uuid: "2ee130eb9a944a08a3238405dcd65266" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d81002531c0b4ac3a0e7c8d2245cf0a4" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 33245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ee130eb9a944a08a3238405dcd65266" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 43997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c86508c9878549b9a4e68360a55d8c8d" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 34965 } health_report { overall_health: UNKNOWN } } }
I20260811 08:12:41.669648 29411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:41.667216 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37064 (local address 127.27.243.193:43997)
0811 08:12:41.667277 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0811 08:12:41.667287 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 08:12:41.667307 (+ 20us) server_negotiation.cc:407] Connection header received
0811 08:12:41.667345 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:12:41.667345 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:12:41.667363 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:12:41.667425 (+ 62us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:12:41.667570 (+ 145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:41.668041 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:41.668840 (+ 799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:41.669037 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:41.669100 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:41.669267 (+ 167us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:12:41.669379 (+ 112us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:12:41.669457 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 08:12:41.669503 (+ 46us) server_negotiation.cc:299] Negotiation successful
0811 08:12:41.669548 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 08:12:41.671489 29307 raft_consensus.cc:1261] T ad977884c3f54f12826882793aca11ca P c86508c9878549b9a4e68360a55d8c8d [term 1 FOLLOWER]: Refusing update from remote peer 2ee130eb9a944a08a3238405dcd65266: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:12:41.671489 29081 raft_consensus.cc:1261] T ad977884c3f54f12826882793aca11ca P d81002531c0b4ac3a0e7c8d2245cf0a4 [term 1 FOLLOWER]: Refusing update from remote peer 2ee130eb9a944a08a3238405dcd65266: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:12:41.671854 29427 consensus_queue.cc:1035] T ad977884c3f54f12826882793aca11ca P 2ee130eb9a944a08a3238405dcd65266 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c86508c9878549b9a4e68360a55d8c8d" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 34965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:12:41.671991 29425 consensus_queue.cc:1035] T ad977884c3f54f12826882793aca11ca P 2ee130eb9a944a08a3238405dcd65266 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d81002531c0b4ac3a0e7c8d2245cf0a4" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 33245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:12:41.674525 29432 mvcc.cc:205] Tried to move back new op lower bound from 7317241699003678720 to 7317241698936967168. Current Snapshot: MvccSnapshot[applied={T|T < 7317241699003678720}]
I20260811 08:12:41.674727 29433 mvcc.cc:205] Tried to move back new op lower bound from 7317241699003678720 to 7317241698936967168. Current Snapshot: MvccSnapshot[applied={T|T < 7317241699003678720}]
I20260811 08:12:41.676834 28600 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53526:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:12:41.676918 28600 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53526:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:12:41.677634 28600 catalog_manager.cc:5782] T 00000000000000000000000000000000 P dd1a1b9365c149658ce1696deaf75519: Sending DeleteTablet for 3 replicas of tablet ad977884c3f54f12826882793aca11ca
I20260811 08:12:41.678018 29274 tablet_service.cc:1514] Processing DeleteTablet for tablet ad977884c3f54f12826882793aca11ca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:12:41 UTC) from {username='kudu', principal='kudu/127.27.243.254@KRBTEST.COM'} at 127.0.0.1:56868
I20260811 08:12:41.678031 29047 tablet_service.cc:1514] Processing DeleteTablet for tablet ad977884c3f54f12826882793aca11ca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:12:41 UTC) from {username='kudu', principal='kudu/127.27.243.254@KRBTEST.COM'} at 127.0.0.1:55244
I20260811 08:12:41.678033 28821 tablet_service.cc:1514] Processing DeleteTablet for tablet ad977884c3f54f12826882793aca11ca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:12:41 UTC) from {username='kudu', principal='kudu/127.27.243.254@KRBTEST.COM'} at 127.0.0.1:37058
I20260811 08:12:41.678299 29454 tablet_replica.cc:330] T ad977884c3f54f12826882793aca11ca P c86508c9878549b9a4e68360a55d8c8d: stopping tablet replica
I20260811 08:12:41.678403 29454 raft_consensus.cc:2229] T ad977884c3f54f12826882793aca11ca P c86508c9878549b9a4e68360a55d8c8d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:12:41.678503 29454 raft_consensus.cc:2258] T ad977884c3f54f12826882793aca11ca P c86508c9878549b9a4e68360a55d8c8d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:12:41.678536 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 28711
I20260811 08:12:41.683595 29454 ts_tablet_manager.cc:1905] T ad977884c3f54f12826882793aca11ca P c86508c9878549b9a4e68360a55d8c8d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:12:41.685135 29454 ts_tablet_manager.cc:1918] T ad977884c3f54f12826882793aca11ca P c86508c9878549b9a4e68360a55d8c8d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:12:41.685201 29454 log.cc:1196] T ad977884c3f54f12826882793aca11ca P c86508c9878549b9a4e68360a55d8c8d: Deleting WAL directory at /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435717191469-28623-0/minicluster-data/ts-2/wal/wals/ad977884c3f54f12826882793aca11ca
I20260811 08:12:41.685458 29454 ts_tablet_manager.cc:1939] T ad977884c3f54f12826882793aca11ca P c86508c9878549b9a4e68360a55d8c8d: Deleting consensus metadata
I20260811 08:12:41.685940 28572 catalog_manager.cc:4841] TS c86508c9878549b9a4e68360a55d8c8d (127.27.243.195:34965): tablet ad977884c3f54f12826882793aca11ca (table test-table [id=27eb54c16412496c829fb31d11f3fb2f]) successfully deleted
I20260811 08:12:41.687564 29457 tablet_replica.cc:330] T ad977884c3f54f12826882793aca11ca P d81002531c0b4ac3a0e7c8d2245cf0a4: stopping tablet replica
I20260811 08:12:41.687681 29457 raft_consensus.cc:2229] T ad977884c3f54f12826882793aca11ca P d81002531c0b4ac3a0e7c8d2245cf0a4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:12:41.687788 29457 raft_consensus.cc:2258] T ad977884c3f54f12826882793aca11ca P d81002531c0b4ac3a0e7c8d2245cf0a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:12:41.688163 29457 ts_tablet_manager.cc:1905] T ad977884c3f54f12826882793aca11ca P d81002531c0b4ac3a0e7c8d2245cf0a4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:12:41.689433 29457 ts_tablet_manager.cc:1918] T ad977884c3f54f12826882793aca11ca P d81002531c0b4ac3a0e7c8d2245cf0a4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:12:41.689500 29457 log.cc:1196] T ad977884c3f54f12826882793aca11ca P d81002531c0b4ac3a0e7c8d2245cf0a4: Deleting WAL directory at /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435717191469-28623-0/minicluster-data/ts-1/wal/wals/ad977884c3f54f12826882793aca11ca
I20260811 08:12:41.689752 29457 ts_tablet_manager.cc:1939] T ad977884c3f54f12826882793aca11ca P d81002531c0b4ac3a0e7c8d2245cf0a4: Deleting consensus metadata
I20260811 08:12:41.690128 28574 catalog_manager.cc:4841] TS d81002531c0b4ac3a0e7c8d2245cf0a4 (127.27.243.194:33245): tablet ad977884c3f54f12826882793aca11ca (table test-table [id=27eb54c16412496c829fb31d11f3fb2f]) successfully deleted
W20260811 08:12:41.693728 28574 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.27.243.193:43997 (error 108)
I20260811 08:12:41.693902 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 28945
I20260811 08:12:41.703233 29404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:41.703080 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.193:43997 (local address 127.0.0.1:37070)
0811 08:12:41.703136 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0811 08:12:41.703192 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.193:43997: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260811 08:12:41.703423 28574 catalog_manager.cc:4584] TS 2ee130eb9a944a08a3238405dcd65266 (127.27.243.193:43997): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet ad977884c3f54f12826882793aca11ca: Network error: Client connection negotiation failed: client connection to 127.27.243.193:43997: connect: Connection refused (error 111)
I20260811 08:12:41.706830 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 29161
I20260811 08:12:41.715305 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 28545
2026-08-11T08:12:41Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (2073 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-11T08:12:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:12:41Z Disabled control of system clock
I20260811 08:12:41.750447 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435717191469-28623-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435717191469-28623-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435717191469-28623-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.243.254:34709
--webserver_interface=127.27.243.254
--webserver_port=0
--builtin_ntp_servers=127.27.243.212:40527
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.243.254:34709
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 08:12:41.831947 29463 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:12:41.832149 29463 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:12:41.832166 29463 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:12:41.833232 29463 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:12:41.833264 29463 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:12:41.833276 29463 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:12:41.833287 29463 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:12:41.833302 29463 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:12:41.834587 29463 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:40527
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435717191469-28623-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435717191469-28623-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.243.254:34709
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.243.254:34709
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.243.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29463
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435717191469-28623-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:12:41.834772 29463 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:12:41.835008 29463 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:12:41.839666 29470 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:12:41.839766 29463 server_base.cc:1034] running on GCE node
W20260811 08:12:41.839710 29472 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:12:41.839695 29469 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:12:41.840134 29463 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:12:41.840371 29463 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:12:41.841544 29463 hybrid_clock.cc:648] HybridClock initialized: now 1786435961841529 us; error 29 us; skew 500 ppm
I20260811 08:12:41.842756 29463 webserver.cc:460] Webserver started at http://127.27.243.254:43839/ using document root <none> and password file <none>
I20260811 08:12:41.843024 29463 fs_manager.cc:359] Metadata directory not provided
I20260811 08:12:41.843077 29463 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:12:41.843202 29463 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:12:41.844213 29463 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435717191469-28623-0/minicluster-data/master-0/data/instance:
uuid: "ea57a86d47a84ad1949b62a44fb12a69"
format_stamp: "Formatted at 2026-08-11 08:12:41 on dist-test-slave-7lbf"
server_key: "6dcfb5d2fa173e57f625444259a39e55"
server_key_iv: "4cfa589016bc8c9cfdb232719d8bfe4c"
server_key_version: "encryptionkey@0"
I20260811 08:12:41.844554 29463 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435717191469-28623-0/minicluster-data/master-0/wal/instance:
uuid: "ea57a86d47a84ad1949b62a44fb12a69"
format_stamp: "Formatted at 2026-08-11 08:12:41 on dist-test-slave-7lbf"
server_key: "6dcfb5d2fa173e57f625444259a39e55"
server_key_iv: "4cfa589016bc8c9cfdb232719d8bfe4c"
server_key_version: "encryptionkey@0"
I20260811 08:12:41.845741 29463 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 08:12:41.846403 29483 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:12:41.846571 29463 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 08:12:41.846654 29463 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435717191469-28623-0/minicluster-data/master-0/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435717191469-28623-0/minicluster-data/master-0/wal
uuid: "ea57a86d47a84ad1949b62a44fb12a69"
format_stamp: "Formatted at 2026-08-11 08:12:41 on dist-test-slave-7lbf"
server_key: "6dcfb5d2fa173e57f625444259a39e55"
server_key_iv: "4cfa589016bc8c9cfdb232719d8bfe4c"
server_key_version: "encryptionkey@0"
I20260811 08:12:41.846711 29463 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435717191469-28623-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435717191469-28623-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435717191469-28623-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:12:41.855459 29463 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:12:41.855741 29463 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:12:41.855862 29463 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:12:41.859848 29463 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.254:34709
I20260811 08:12:41.859921 29570 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.254:34709 every 8 connection(s)
I20260811 08:12:41.860235 29463 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
I20260811 08:12:41.861276 29573 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:12:41.863658 29573 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ea57a86d47a84ad1949b62a44fb12a69: Bootstrap starting.
I20260811 08:12:41.864225 29573 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ea57a86d47a84ad1949b62a44fb12a69: Neither blocks nor log segments found. Creating new log.
I20260811 08:12:41.864475 29573 log.cc:824] T 00000000000000000000000000000000 P ea57a86d47a84ad1949b62a44fb12a69: Log is configured to *not* fsync() on all Append() calls
I20260811 08:12:41.864699 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 29463
I20260811 08:12:41.864811 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435717191469-28623-0/minicluster-data/master-0/wal/instance
I20260811 08:12:41.864998 28623 external_mini_cluster.cc:1428] Setting key 47e59ff8d03d147ddc0f6e687389b47f
I20260811 08:12:41.865211 29573 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ea57a86d47a84ad1949b62a44fb12a69: No bootstrap required, opened a new log
I20260811 08:12:41.867790 29573 raft_consensus.cc:348] T 00000000000000000000000000000000 P ea57a86d47a84ad1949b62a44fb12a69 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea57a86d47a84ad1949b62a44fb12a69" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 34709 } }
I20260811 08:12:41.867969 29573 raft_consensus.cc:374] T 00000000000000000000000000000000 P ea57a86d47a84ad1949b62a44fb12a69 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:12:41.868011 29573 raft_consensus.cc:729] T 00000000000000000000000000000000 P ea57a86d47a84ad1949b62a44fb12a69 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea57a86d47a84ad1949b62a44fb12a69, State: Initialized, Role: FOLLOWER
I20260811 08:12:41.868147 29573 consensus_queue.cc:260] T 00000000000000000000000000000000 P ea57a86d47a84ad1949b62a44fb12a69 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea57a86d47a84ad1949b62a44fb12a69" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 34709 } }
I20260811 08:12:41.868232 29573 raft_consensus.cc:388] T 00000000000000000000000000000000 P ea57a86d47a84ad1949b62a44fb12a69 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:12:41.868274 29573 raft_consensus.cc:482] T 00000000000000000000000000000000 P ea57a86d47a84ad1949b62a44fb12a69 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:12:41.868326 29573 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ea57a86d47a84ad1949b62a44fb12a69 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:12:41.869048 29573 raft_consensus.cc:504] T 00000000000000000000000000000000 P ea57a86d47a84ad1949b62a44fb12a69 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea57a86d47a84ad1949b62a44fb12a69" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 34709 } }
I20260811 08:12:41.869151 29573 leader_election.cc:302] T 00000000000000000000000000000000 P ea57a86d47a84ad1949b62a44fb12a69 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ea57a86d47a84ad1949b62a44fb12a69; no voters:
I20260811 08:12:41.869341 29573 leader_election.cc:288] T 00000000000000000000000000000000 P ea57a86d47a84ad1949b62a44fb12a69 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:12:41.869383 29583 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ea57a86d47a84ad1949b62a44fb12a69 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:12:41.869508 29583 raft_consensus.cc:686] T 00000000000000000000000000000000 P ea57a86d47a84ad1949b62a44fb12a69 [term 1 LEADER]: Becoming Leader. State: Replica: ea57a86d47a84ad1949b62a44fb12a69, State: Running, Role: LEADER
I20260811 08:12:41.869637 29573 sys_catalog.cc:564] T 00000000000000000000000000000000 P ea57a86d47a84ad1949b62a44fb12a69 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:12:41.869626 29583 consensus_queue.cc:237] T 00000000000000000000000000000000 P ea57a86d47a84ad1949b62a44fb12a69 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea57a86d47a84ad1949b62a44fb12a69" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 34709 } }
I20260811 08:12:41.869947 29583 sys_catalog.cc:455] T 00000000000000000000000000000000 P ea57a86d47a84ad1949b62a44fb12a69 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ea57a86d47a84ad1949b62a44fb12a69" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea57a86d47a84ad1949b62a44fb12a69" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 34709 } } }
I20260811 08:12:41.870005 29588 sys_catalog.cc:455] T 00000000000000000000000000000000 P ea57a86d47a84ad1949b62a44fb12a69 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ea57a86d47a84ad1949b62a44fb12a69. Latest consensus state: current_term: 1 leader_uuid: "ea57a86d47a84ad1949b62a44fb12a69" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea57a86d47a84ad1949b62a44fb12a69" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 34709 } } }
I20260811 08:12:41.870373 29588 sys_catalog.cc:458] T 00000000000000000000000000000000 P ea57a86d47a84ad1949b62a44fb12a69 [sys.catalog]: This master's current role is: LEADER
I20260811 08:12:41.870033 29583 sys_catalog.cc:458] T 00000000000000000000000000000000 P ea57a86d47a84ad1949b62a44fb12a69 [sys.catalog]: This master's current role is: LEADER
I20260811 08:12:41.871048 29596 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:12:41.871236 29579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:41.865534 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45178 (local address 127.27.243.254:34709)
0811 08:12:41.865735 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0811 08:12:41.865743 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 08:12:41.865767 (+ 24us) server_negotiation.cc:407] Connection header received
0811 08:12:41.866480 (+ 713us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:12:41.866487 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:12:41.866545 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:12:41.866655 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:12:41.866926 (+ 271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:41.867807 (+ 881us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:41.868922 (+ 1115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:41.869412 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:41.869593 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:41.870277 (+ 684us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:12:41.870292 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:12:41.870292 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:12:41.870516 (+ 224us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:12:41.870582 (+ 66us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:12:41.870597 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:12:41.870677 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 08:12:41.870921 (+ 244us) server_negotiation.cc:299] Negotiation successful
0811 08:12:41.870996 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":127,"thread_start_us":77,"threads_started":1}
I20260811 08:12:41.871937 29596 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:12:41.873304 29596 catalog_manager.cc:1347] Generated new cluster ID: ec79dbcbcbbf41519b15844171559ce8
I20260811 08:12:41.873356 29596 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:12:41.880800 29596 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:12:41.881359 29596 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:12:41.888173 29596 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ea57a86d47a84ad1949b62a44fb12a69: Generated new TSK 0
I20260811 08:12:41.888341 29596 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 08:12:41.895524 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435717191469-28623-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435717191469-28623-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435717191469-28623-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435717191469-28623-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.243.193:0
--local_ip_for_outbound_sockets=127.27.243.193
--webserver_interface=127.27.243.193
--webserver_port=0
--tserver_master_addrs=127.27.243.254:34709
--builtin_ntp_servers=127.27.243.212:40527
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 08:12:42.006233 29613 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:12:42.006440 29613 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:12:42.006461 29613 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:12:42.007602 29613 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:12:42.007640 29613 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:12:42.007663 29613 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.243.193
I20260811 08:12:42.008978 29613 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:40527
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435717191469-28623-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435717191469-28623-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.243.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435717191469-28623-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.243.193
--webserver_port=0
--tserver_master_addrs=127.27.243.254:34709
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29613
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.243.193
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435717191469-28623-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:12:42.009192 29613 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:12:42.009471 29613 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:12:42.014319 29627 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:12:42.014331 29630 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:12:42.014338 29625 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:12:42.014750 29613 server_base.cc:1034] running on GCE node
I20260811 08:12:42.014935 29613 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:12:42.015149 29613 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:12:42.016294 29613 hybrid_clock.cc:648] HybridClock initialized: now 1786435962016278 us; error 30 us; skew 500 ppm
I20260811 08:12:42.017488 29613 webserver.cc:460] Webserver started at http://127.27.243.193:41819/ using document root <none> and password file <none>
I20260811 08:12:42.017737 29613 fs_manager.cc:359] Metadata directory not provided
I20260811 08:12:42.017788 29613 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:12:42.017969 29613 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:12:42.019025 29613 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435717191469-28623-0/minicluster-data/ts-0/data/instance:
uuid: "bc6bef0478d44207a65d3f037201c126"
format_stamp: "Formatted at 2026-08-11 08:12:42 on dist-test-slave-7lbf"
server_key: "2ece5af43597e4d63c127eeda6b5abde"
server_key_iv: "729a20e5e27f3975805a7a4e92ea0075"
server_key_version: "encryptionkey@0"
I20260811 08:12:42.019361 29613 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435717191469-28623-0/minicluster-data/ts-0/wal/instance:
uuid: "bc6bef0478d44207a65d3f037201c126"
format_stamp: "Formatted at 2026-08-11 08:12:42 on dist-test-slave-7lbf"
server_key: "2ece5af43597e4d63c127eeda6b5abde"
server_key_iv: "729a20e5e27f3975805a7a4e92ea0075"
server_key_version: "encryptionkey@0"
I20260811 08:12:42.020617 29613 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 08:12:42.021430 29637 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:12:42.021641 29613 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 08:12:42.021716 29613 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435717191469-28623-0/minicluster-data/ts-0/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435717191469-28623-0/minicluster-data/ts-0/wal
uuid: "bc6bef0478d44207a65d3f037201c126"
format_stamp: "Formatted at 2026-08-11 08:12:42 on dist-test-slave-7lbf"
server_key: "2ece5af43597e4d63c127eeda6b5abde"
server_key_iv: "729a20e5e27f3975805a7a4e92ea0075"
server_key_version: "encryptionkey@0"
I20260811 08:12:42.021786 29613 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435717191469-28623-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435717191469-28623-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435717191469-28623-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:12:42.035939 29613 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:12:42.036266 29613 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:12:42.036401 29613 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:12:42.036616 29613 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:12:42.036932 29613 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:12:42.036966 29613 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:12:42.036993 29613 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:12:42.037017 29613 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:12:42.042474 29613 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.193:39401
I20260811 08:12:42.042539 29829 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.193:39401 every 8 connection(s)
I20260811 08:12:42.042846 29613 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435717191469-28623-0/minicluster-data/ts-0/data/info.pb
I20260811 08:12:42.047825 29579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:42.043503 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.193:58855 (local address 127.27.243.254:34709)
0811 08:12:42.043547 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 08:12:42.043549 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:12:42.043802 (+ 253us) server_negotiation.cc:407] Connection header received
0811 08:12:42.044301 (+ 499us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:12:42.044303 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:12:42.044318 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:12:42.044359 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:12:42.045029 (+ 670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:42.045565 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:42.046535 (+ 970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:42.046728 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:42.046783 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:42.047568 (+ 785us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:12:42.047569 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:12:42.047569 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:12:42.047574 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:12:42.047589 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:12:42.047593 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:12:42.047637 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0811 08:12:42.047710 (+ 73us) server_negotiation.cc:299] Negotiation successful
0811 08:12:42.047737 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 08:12:42.048009 29834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:42.043497 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:34709 (local address 127.27.243.193:58855)
0811 08:12:42.043685 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0811 08:12:42.043718 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0811 08:12:42.044212 (+ 494us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:12:42.044445 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:12:42.044449 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:12:42.044466 (+ 17us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:12:42.044945 (+ 479us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:12:42.044950 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:12:42.045642 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:12:42.045643 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:12:42.046449 (+ 806us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:12:42.046452 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:12:42.046798 (+ 346us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:12:42.046799 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:12:42.046950 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:42.047442 (+ 492us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 08:12:42.047442 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:12:42.047471 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 08:12:42.047492 (+ 21us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:12:42.047644 (+ 152us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:12:42.047649 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:12:42.047652 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 08:12:42.047709 (+ 57us) client_negotiation.cc:240] Negotiation successful
0811 08:12:42.047815 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":92,"threads_started":1}
I20260811 08:12:42.048475 29830 heartbeater.cc:347] Connected to a master server at 127.27.243.254:34709
I20260811 08:12:42.048563 29830 heartbeater.cc:464] Registering TS with master...
I20260811 08:12:42.048722 29830 heartbeater.cc:511] Master 127.27.243.254:34709 requested a full tablet report, sending...
I20260811 08:12:42.049237 29517 ts_manager.cc:194] Registered new tserver with Master: bc6bef0478d44207a65d3f037201c126 (127.27.243.193:39401)
I20260811 08:12:42.049898 29517 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.27.243.193:58855
I20260811 08:12:42.052114 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 29613
I20260811 08:12:42.052199 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435717191469-28623-0/minicluster-data/ts-0/wal/instance
I20260811 08:12:42.052366 28623 external_mini_cluster.cc:1428] Setting key 04e470de1fbdcefc163854c78c9f81f4
I20260811 08:12:42.053252 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435717191469-28623-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435717191469-28623-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435717191469-28623-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435717191469-28623-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.243.194:0
--local_ip_for_outbound_sockets=127.27.243.194
--webserver_interface=127.27.243.194
--webserver_port=0
--tserver_master_addrs=127.27.243.254:34709
--builtin_ntp_servers=127.27.243.212:40527
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 08:12:42.136394 29836 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:12:42.136591 29836 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:12:42.136612 29836 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:12:42.137733 29836 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:12:42.137771 29836 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:12:42.137795 29836 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.243.194
I20260811 08:12:42.139091 29836 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:40527
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435717191469-28623-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435717191469-28623-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.243.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435717191469-28623-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.243.194
--webserver_port=0
--tserver_master_addrs=127.27.243.254:34709
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29836
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.243.194
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435717191469-28623-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:12:42.139268 29836 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:12:42.139523 29836 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:12:42.144290 29844 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:12:42.144384 29836 server_base.cc:1034] running on GCE node
W20260811 08:12:42.144297 29842 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:12:42.144315 29849 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:12:42.144717 29836 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:12:42.144976 29836 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:12:42.146117 29836 hybrid_clock.cc:648] HybridClock initialized: now 1786435962146101 us; error 31 us; skew 500 ppm
I20260811 08:12:42.147310 29836 webserver.cc:460] Webserver started at http://127.27.243.194:40309/ using document root <none> and password file <none>
I20260811 08:12:42.147534 29836 fs_manager.cc:359] Metadata directory not provided
I20260811 08:12:42.147579 29836 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:12:42.147702 29836 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:12:42.148782 29836 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435717191469-28623-0/minicluster-data/ts-1/data/instance:
uuid: "4de02a827c87459591cfa322f338f53f"
format_stamp: "Formatted at 2026-08-11 08:12:42 on dist-test-slave-7lbf"
server_key: "136d8f21acebe32375440561221c054f"
server_key_iv: "9687ac9e48c75ae674d059e235448fcd"
server_key_version: "encryptionkey@0"
I20260811 08:12:42.149129 29836 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435717191469-28623-0/minicluster-data/ts-1/wal/instance:
uuid: "4de02a827c87459591cfa322f338f53f"
format_stamp: "Formatted at 2026-08-11 08:12:42 on dist-test-slave-7lbf"
server_key: "136d8f21acebe32375440561221c054f"
server_key_iv: "9687ac9e48c75ae674d059e235448fcd"
server_key_version: "encryptionkey@0"
I20260811 08:12:42.150494 29836 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 08:12:42.151235 29858 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:12:42.151371 29836 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 08:12:42.151450 29836 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435717191469-28623-0/minicluster-data/ts-1/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435717191469-28623-0/minicluster-data/ts-1/wal
uuid: "4de02a827c87459591cfa322f338f53f"
format_stamp: "Formatted at 2026-08-11 08:12:42 on dist-test-slave-7lbf"
server_key: "136d8f21acebe32375440561221c054f"
server_key_iv: "9687ac9e48c75ae674d059e235448fcd"
server_key_version: "encryptionkey@0"
I20260811 08:12:42.151520 29836 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435717191469-28623-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435717191469-28623-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435717191469-28623-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:12:42.164140 29836 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:12:42.164425 29836 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:12:42.164551 29836 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:12:42.164765 29836 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:12:42.165091 29836 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:12:42.165124 29836 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:12:42.165148 29836 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:12:42.165170 29836 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:12:42.171079 29836 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.194:36643
I20260811 08:12:42.171139 30063 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.194:36643 every 8 connection(s)
I20260811 08:12:42.171470 29836 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435717191469-28623-0/minicluster-data/ts-1/data/info.pb
I20260811 08:12:42.176342 29579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:42.172199 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.194:57213 (local address 127.27.243.254:34709)
0811 08:12:42.172247 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 08:12:42.172249 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:12:42.172507 (+ 258us) server_negotiation.cc:407] Connection header received
0811 08:12:42.172985 (+ 478us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:12:42.172986 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:12:42.172996 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:12:42.173051 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:12:42.173778 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:42.174278 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:42.175225 (+ 947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:42.175404 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:42.175451 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:42.176147 (+ 696us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:12:42.176148 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:12:42.176149 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:12:42.176153 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:12:42.176168 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:12:42.176171 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:12:42.176207 (+ 36us) server_negotiation.cc:1035] Waiting for connection context
0811 08:12:42.176260 (+ 53us) server_negotiation.cc:299] Negotiation successful
0811 08:12:42.176282 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 08:12:42.176551 30070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:42.172177 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:34709 (local address 127.27.243.194:57213)
0811 08:12:42.172377 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0811 08:12:42.172418 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 08:12:42.172907 (+ 489us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:12:42.173119 (+ 212us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:12:42.173122 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:12:42.173130 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:12:42.173701 (+ 571us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:12:42.173708 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:12:42.174361 (+ 653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:12:42.174362 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:12:42.175158 (+ 796us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:12:42.175161 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:12:42.175461 (+ 300us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:12:42.175461 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:12:42.175568 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:42.176027 (+ 459us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 08:12:42.176027 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:12:42.176056 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 08:12:42.176077 (+ 21us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:12:42.176209 (+ 132us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:12:42.176212 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:12:42.176214 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 08:12:42.176257 (+ 43us) client_negotiation.cc:240] Negotiation successful
0811 08:12:42.176349 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":76,"threads_started":1}
I20260811 08:12:42.177018 30068 heartbeater.cc:347] Connected to a master server at 127.27.243.254:34709
I20260811 08:12:42.177112 30068 heartbeater.cc:464] Registering TS with master...
I20260811 08:12:42.177289 30068 heartbeater.cc:511] Master 127.27.243.254:34709 requested a full tablet report, sending...
I20260811 08:12:42.177672 29517 ts_manager.cc:194] Registered new tserver with Master: 4de02a827c87459591cfa322f338f53f (127.27.243.194:36643)
I20260811 08:12:42.178040 29517 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.27.243.194:57213
I20260811 08:12:42.178975 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 29836
I20260811 08:12:42.179071 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435717191469-28623-0/minicluster-data/ts-1/wal/instance
I20260811 08:12:42.179215 28623 external_mini_cluster.cc:1428] Setting key 3947a50b86c1c9095f6e2f4b08362f65
I20260811 08:12:42.179999 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435717191469-28623-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435717191469-28623-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435717191469-28623-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435717191469-28623-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.243.195:0
--local_ip_for_outbound_sockets=127.27.243.195
--webserver_interface=127.27.243.195
--webserver_port=0
--tserver_master_addrs=127.27.243.254:34709
--builtin_ntp_servers=127.27.243.212:40527
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 08:12:42.261590 30071 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:12:42.261811 30071 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:12:42.261843 30071 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:12:42.263010 30071 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:12:42.263053 30071 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:12:42.263087 30071 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.243.195
I20260811 08:12:42.264420 30071 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:40527
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435717191469-28623-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435717191469-28623-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.243.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435717191469-28623-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.243.195
--webserver_port=0
--tserver_master_addrs=127.27.243.254:34709
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30071
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.243.195
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435717191469-28623-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:12:42.264652 30071 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:12:42.264928 30071 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:12:42.269666 30079 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:12:42.269677 30085 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:12:42.269677 30081 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:12:42.269817 30071 server_base.cc:1034] running on GCE node
I20260811 08:12:42.270153 30071 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:12:42.270380 30071 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:12:42.271557 30071 hybrid_clock.cc:648] HybridClock initialized: now 1786435962271536 us; error 33 us; skew 500 ppm
I20260811 08:12:42.272806 30071 webserver.cc:460] Webserver started at http://127.27.243.195:46769/ using document root <none> and password file <none>
I20260811 08:12:42.273023 30071 fs_manager.cc:359] Metadata directory not provided
I20260811 08:12:42.273075 30071 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:12:42.273201 30071 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:12:42.274303 30071 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435717191469-28623-0/minicluster-data/ts-2/data/instance:
uuid: "3aa2cfd7259947f389fa79517384e380"
format_stamp: "Formatted at 2026-08-11 08:12:42 on dist-test-slave-7lbf"
server_key: "c408bd01977052b655107e9015c0ec7f"
server_key_iv: "61db295330fa9265441266d9c9a3b80e"
server_key_version: "encryptionkey@0"
I20260811 08:12:42.274645 30071 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435717191469-28623-0/minicluster-data/ts-2/wal/instance:
uuid: "3aa2cfd7259947f389fa79517384e380"
format_stamp: "Formatted at 2026-08-11 08:12:42 on dist-test-slave-7lbf"
server_key: "c408bd01977052b655107e9015c0ec7f"
server_key_iv: "61db295330fa9265441266d9c9a3b80e"
server_key_version: "encryptionkey@0"
I20260811 08:12:42.276050 30071 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 08:12:42.276829 30103 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:12:42.277004 30071 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 08:12:42.277087 30071 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435717191469-28623-0/minicluster-data/ts-2/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435717191469-28623-0/minicluster-data/ts-2/wal
uuid: "3aa2cfd7259947f389fa79517384e380"
format_stamp: "Formatted at 2026-08-11 08:12:42 on dist-test-slave-7lbf"
server_key: "c408bd01977052b655107e9015c0ec7f"
server_key_iv: "61db295330fa9265441266d9c9a3b80e"
server_key_version: "encryptionkey@0"
I20260811 08:12:42.277148 30071 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435717191469-28623-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435717191469-28623-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435717191469-28623-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:12:42.283313 30071 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:12:42.283560 30071 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:12:42.283675 30071 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:12:42.283862 30071 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:12:42.284157 30071 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:12:42.284189 30071 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:12:42.284215 30071 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:12:42.284240 30071 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:12:42.289646 30071 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.195:43233
I20260811 08:12:42.289701 30304 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.195:43233 every 8 connection(s)
I20260811 08:12:42.289985 30071 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435717191469-28623-0/minicluster-data/ts-2/data/info.pb
I20260811 08:12:42.294839 29579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:42.290640 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.195:47207 (local address 127.27.243.254:34709)
0811 08:12:42.290691 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 08:12:42.290693 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:12:42.290897 (+ 204us) server_negotiation.cc:407] Connection header received
0811 08:12:42.291376 (+ 479us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:12:42.291378 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:12:42.291392 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:12:42.291450 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:12:42.292086 (+ 636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:42.292577 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:42.293553 (+ 976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:42.293757 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:42.293813 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:42.294579 (+ 766us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:12:42.294580 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:12:42.294581 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:12:42.294585 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:12:42.294601 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:12:42.294606 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:12:42.294651 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0811 08:12:42.294730 (+ 79us) server_negotiation.cc:299] Negotiation successful
0811 08:12:42.294757 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 08:12:42.295046 30310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:42.290612 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:34709 (local address 127.27.243.195:47207)
0811 08:12:42.290776 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0811 08:12:42.290808 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0811 08:12:42.291276 (+ 468us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:12:42.291520 (+ 244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:12:42.291523 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:12:42.291531 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:12:42.291996 (+ 465us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:12:42.292000 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:12:42.292659 (+ 659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:12:42.292660 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:12:42.293462 (+ 802us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:12:42.293465 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:12:42.293828 (+ 363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:12:42.293829 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:12:42.293954 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:42.294445 (+ 491us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 08:12:42.294445 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:12:42.294472 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 08:12:42.294494 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:12:42.294658 (+ 164us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:12:42.294663 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:12:42.294666 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 08:12:42.294727 (+ 61us) client_negotiation.cc:240] Negotiation successful
0811 08:12:42.294828 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":74,"threads_started":1}
I20260811 08:12:42.295222 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 30071
I20260811 08:12:42.295336 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435717191469-28623-0/minicluster-data/ts-2/wal/instance
I20260811 08:12:42.295518 30305 heartbeater.cc:347] Connected to a master server at 127.27.243.254:34709
I20260811 08:12:42.295569 28623 external_mini_cluster.cc:1428] Setting key ee22972bbd5a789c7f3a54ba3feac655
I20260811 08:12:42.295624 30305 heartbeater.cc:464] Registering TS with master...
I20260811 08:12:42.295825 30305 heartbeater.cc:511] Master 127.27.243.254:34709 requested a full tablet report, sending...
I20260811 08:12:42.296221 29517 ts_manager.cc:194] Registered new tserver with Master: 3aa2cfd7259947f389fa79517384e380 (127.27.243.195:43233)
I20260811 08:12:42.296628 28623 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 08:12:42.296657 29517 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.27.243.195:47207
I20260811 08:12:42.300717 29579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:42.298221 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45190 (local address 127.27.243.254:34709)
0811 08:12:42.298264 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 08:12:42.298266 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:12:42.298364 (+ 98us) server_negotiation.cc:407] Connection header received
0811 08:12:42.298415 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:12:42.298416 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:12:42.298424 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:12:42.298466 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:12:42.298596 (+ 130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:42.299065 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:42.299775 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:42.299973 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:42.300020 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:42.300534 (+ 514us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:12:42.300535 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:12:42.300535 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:12:42.300538 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:12:42.300551 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:12:42.300554 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:12:42.300591 (+ 37us) server_negotiation.cc:1035] Waiting for connection context
0811 08:12:42.300639 (+ 48us) server_negotiation.cc:299] Negotiation successful
0811 08:12:42.300657 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 08:12:42.302209 29517 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45190:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 08:12:42.303759 29517 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 08:12:42.309854 30326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:42.305910 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.194:36643 (local address 127.0.0.1:60824)
0811 08:12:42.306121 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0811 08:12:42.306160 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 08:12:42.306225 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:12:42.306543 (+ 318us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:12:42.306546 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:12:42.306548 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:12:42.306616 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:12:42.306618 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:12:42.307552 (+ 934us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:12:42.307553 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:12:42.308513 (+ 960us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:12:42.308515 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:12:42.309444 (+ 929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:12:42.309445 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:12:42.309606 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:42.309626 (+ 20us) client_negotiation.cc:769] Sending connection context
0811 08:12:42.309700 (+ 74us) client_negotiation.cc:240] Negotiation successful
0811 08:12:42.309758 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":80,"threads_started":1}
I20260811 08:12:42.309862 30330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:42.306008 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60824 (local address 127.27.243.194:36643)
0811 08:12:42.306378 (+ 370us) server_negotiation.cc:206] Beginning negotiation
0811 08:12:42.306383 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 08:12:42.306393 (+ 10us) server_negotiation.cc:407] Connection header received
0811 08:12:42.306431 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:12:42.306433 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:12:42.306449 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:12:42.306521 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:12:42.306699 (+ 178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:42.307477 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:42.308627 (+ 1150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:42.309368 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:42.309431 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:42.309546 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0811 08:12:42.309733 (+ 187us) server_negotiation.cc:299] Negotiation successful
0811 08:12:42.309774 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":326,"thread_start_us":82,"threads_started":1}
I20260811 08:12:42.310055 30325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:42.305911 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.195:43233 (local address 127.0.0.1:38062)
0811 08:12:42.306185 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0811 08:12:42.306195 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 08:12:42.306249 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:12:42.306772 (+ 523us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:12:42.306773 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:12:42.306775 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:12:42.306810 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:12:42.306811 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:12:42.308133 (+ 1322us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:12:42.308134 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:12:42.309001 (+ 867us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:12:42.309004 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:12:42.309843 (+ 839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:12:42.309844 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:12:42.309901 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:42.309905 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 08:12:42.309955 (+ 50us) client_negotiation.cc:240] Negotiation successful
0811 08:12:42.309990 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":257,"spinlock_wait_cycles":9600,"thread_start_us":134,"threads_started":1}
I20260811 08:12:42.310276 30329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:42.306012 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38062 (local address 127.27.243.195:43233)
0811 08:12:42.306642 (+ 630us) server_negotiation.cc:206] Beginning negotiation
0811 08:12:42.306645 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:12:42.306655 (+ 10us) server_negotiation.cc:407] Connection header received
0811 08:12:42.306686 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:12:42.306688 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:12:42.306702 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:12:42.306777 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:12:42.306917 (+ 140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:42.308023 (+ 1106us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:42.309078 (+ 1055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:42.309669 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:42.309728 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:42.309808 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 08:12:42.310154 (+ 346us) server_negotiation.cc:299] Negotiation successful
0811 08:12:42.310194 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":595,"thread_start_us":71,"threads_started":1}
I20260811 08:12:42.310308 30331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:42.306126 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.193:39401 (local address 127.0.0.1:36626)
0811 08:12:42.306261 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0811 08:12:42.306270 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 08:12:42.306331 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:12:42.306653 (+ 322us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:12:42.306654 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:12:42.306656 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:12:42.306719 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:12:42.306722 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:12:42.308111 (+ 1389us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:12:42.308112 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:12:42.309181 (+ 1069us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:12:42.309183 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:12:42.310107 (+ 924us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:12:42.310109 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:12:42.310173 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:42.310177 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 08:12:42.310203 (+ 26us) client_negotiation.cc:240] Negotiation successful
0811 08:12:42.310241 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"mutex_wait_us":23,"thread_start_us":77,"threads_started":1}
I20260811 08:12:42.310717 30332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:42.306337 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36626 (local address 127.27.243.193:39401)
0811 08:12:42.306495 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0811 08:12:42.306498 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:12:42.306507 (+ 9us) server_negotiation.cc:407] Connection header received
0811 08:12:42.306543 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:12:42.306545 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:12:42.306557 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:12:42.306901 (+ 344us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:12:42.306963 (+ 62us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:42.308023 (+ 1060us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:42.309274 (+ 1251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:42.310014 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:42.310457 (+ 443us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:42.310570 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0811 08:12:42.310594 (+ 24us) server_negotiation.cc:299] Negotiation successful
0811 08:12:42.310631 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":117,"thread_start_us":70,"threads_started":1}
I20260811 08:12:42.310997 30199 tablet_service.cc:1467] Processing CreateTablet for tablet 63be0085dfaa4fcdaf95a0b73b738fb9 (DEFAULT_TABLE table=test-table [id=5dd3aa2a29624766ab4124d795dbbca1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:12:42.311395 30199 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 63be0085dfaa4fcdaf95a0b73b738fb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:12:42.311372 29720 tablet_service.cc:1467] Processing CreateTablet for tablet 63be0085dfaa4fcdaf95a0b73b738fb9 (DEFAULT_TABLE table=test-table [id=5dd3aa2a29624766ab4124d795dbbca1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:12:42.311671 29720 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 63be0085dfaa4fcdaf95a0b73b738fb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:12:42.314006 29947 tablet_service.cc:1467] Processing CreateTablet for tablet 63be0085dfaa4fcdaf95a0b73b738fb9 (DEFAULT_TABLE table=test-table [id=5dd3aa2a29624766ab4124d795dbbca1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:12:42.314157 30333 tablet_bootstrap.cc:492] T 63be0085dfaa4fcdaf95a0b73b738fb9 P 3aa2cfd7259947f389fa79517384e380: Bootstrap starting.
I20260811 08:12:42.314311 30334 tablet_bootstrap.cc:492] T 63be0085dfaa4fcdaf95a0b73b738fb9 P bc6bef0478d44207a65d3f037201c126: Bootstrap starting.
I20260811 08:12:42.314371 29947 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 63be0085dfaa4fcdaf95a0b73b738fb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:12:42.314831 30333 tablet_bootstrap.cc:654] T 63be0085dfaa4fcdaf95a0b73b738fb9 P 3aa2cfd7259947f389fa79517384e380: Neither blocks nor log segments found. Creating new log.
I20260811 08:12:42.314924 30334 tablet_bootstrap.cc:654] T 63be0085dfaa4fcdaf95a0b73b738fb9 P bc6bef0478d44207a65d3f037201c126: Neither blocks nor log segments found. Creating new log.
I20260811 08:12:42.315162 30333 log.cc:824] T 63be0085dfaa4fcdaf95a0b73b738fb9 P 3aa2cfd7259947f389fa79517384e380: Log is configured to *not* fsync() on all Append() calls
I20260811 08:12:42.315212 30334 log.cc:824] T 63be0085dfaa4fcdaf95a0b73b738fb9 P bc6bef0478d44207a65d3f037201c126: Log is configured to *not* fsync() on all Append() calls
I20260811 08:12:42.315964 30334 tablet_bootstrap.cc:492] T 63be0085dfaa4fcdaf95a0b73b738fb9 P bc6bef0478d44207a65d3f037201c126: No bootstrap required, opened a new log
I20260811 08:12:42.316037 30334 ts_tablet_manager.cc:1397] T 63be0085dfaa4fcdaf95a0b73b738fb9 P bc6bef0478d44207a65d3f037201c126: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 08:12:42.316180 30333 tablet_bootstrap.cc:492] T 63be0085dfaa4fcdaf95a0b73b738fb9 P 3aa2cfd7259947f389fa79517384e380: No bootstrap required, opened a new log
I20260811 08:12:42.316241 30333 ts_tablet_manager.cc:1397] T 63be0085dfaa4fcdaf95a0b73b738fb9 P 3aa2cfd7259947f389fa79517384e380: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 08:12:42.317086 30340 tablet_bootstrap.cc:492] T 63be0085dfaa4fcdaf95a0b73b738fb9 P 4de02a827c87459591cfa322f338f53f: Bootstrap starting.
I20260811 08:12:42.317719 30340 tablet_bootstrap.cc:654] T 63be0085dfaa4fcdaf95a0b73b738fb9 P 4de02a827c87459591cfa322f338f53f: Neither blocks nor log segments found. Creating new log.
I20260811 08:12:42.317984 30340 log.cc:824] T 63be0085dfaa4fcdaf95a0b73b738fb9 P 4de02a827c87459591cfa322f338f53f: Log is configured to *not* fsync() on all Append() calls
I20260811 08:12:42.318572 30340 tablet_bootstrap.cc:492] T 63be0085dfaa4fcdaf95a0b73b738fb9 P 4de02a827c87459591cfa322f338f53f: No bootstrap required, opened a new log
I20260811 08:12:42.318635 30340 ts_tablet_manager.cc:1397] T 63be0085dfaa4fcdaf95a0b73b738fb9 P 4de02a827c87459591cfa322f338f53f: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 08:12:42.318684 30334 raft_consensus.cc:348] T 63be0085dfaa4fcdaf95a0b73b738fb9 P bc6bef0478d44207a65d3f037201c126 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de02a827c87459591cfa322f338f53f" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 36643 } } peers { permanent_uuid: "bc6bef0478d44207a65d3f037201c126" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 39401 } } peers { permanent_uuid: "3aa2cfd7259947f389fa79517384e380" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 43233 } }
I20260811 08:12:42.318769 30333 raft_consensus.cc:348] T 63be0085dfaa4fcdaf95a0b73b738fb9 P 3aa2cfd7259947f389fa79517384e380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de02a827c87459591cfa322f338f53f" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 36643 } } peers { permanent_uuid: "bc6bef0478d44207a65d3f037201c126" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 39401 } } peers { permanent_uuid: "3aa2cfd7259947f389fa79517384e380" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 43233 } }
I20260811 08:12:42.318873 30334 raft_consensus.cc:374] T 63be0085dfaa4fcdaf95a0b73b738fb9 P bc6bef0478d44207a65d3f037201c126 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:12:42.318887 30333 raft_consensus.cc:374] T 63be0085dfaa4fcdaf95a0b73b738fb9 P 3aa2cfd7259947f389fa79517384e380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:12:42.318918 30334 raft_consensus.cc:729] T 63be0085dfaa4fcdaf95a0b73b738fb9 P bc6bef0478d44207a65d3f037201c126 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc6bef0478d44207a65d3f037201c126, State: Initialized, Role: FOLLOWER
I20260811 08:12:42.318918 30333 raft_consensus.cc:729] T 63be0085dfaa4fcdaf95a0b73b738fb9 P 3aa2cfd7259947f389fa79517384e380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3aa2cfd7259947f389fa79517384e380, State: Initialized, Role: FOLLOWER
I20260811 08:12:42.319038 30333 consensus_queue.cc:260] T 63be0085dfaa4fcdaf95a0b73b738fb9 P 3aa2cfd7259947f389fa79517384e380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de02a827c87459591cfa322f338f53f" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 36643 } } peers { permanent_uuid: "bc6bef0478d44207a65d3f037201c126" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 39401 } } peers { permanent_uuid: "3aa2cfd7259947f389fa79517384e380" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 43233 } }
I20260811 08:12:42.319029 30334 consensus_queue.cc:260] T 63be0085dfaa4fcdaf95a0b73b738fb9 P bc6bef0478d44207a65d3f037201c126 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de02a827c87459591cfa322f338f53f" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 36643 } } peers { permanent_uuid: "bc6bef0478d44207a65d3f037201c126" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 39401 } } peers { permanent_uuid: "3aa2cfd7259947f389fa79517384e380" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 43233 } }
I20260811 08:12:42.319285 30334 ts_tablet_manager.cc:1428] T 63be0085dfaa4fcdaf95a0b73b738fb9 P bc6bef0478d44207a65d3f037201c126: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 08:12:42.319285 30333 ts_tablet_manager.cc:1428] T 63be0085dfaa4fcdaf95a0b73b738fb9 P 3aa2cfd7259947f389fa79517384e380: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 08:12:42.319427 30305 heartbeater.cc:503] Master 127.27.243.254:34709 was elected leader, sending a full tablet report...
I20260811 08:12:42.319422 29830 heartbeater.cc:503] Master 127.27.243.254:34709 was elected leader, sending a full tablet report...
I20260811 08:12:42.320968 30340 raft_consensus.cc:348] T 63be0085dfaa4fcdaf95a0b73b738fb9 P 4de02a827c87459591cfa322f338f53f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de02a827c87459591cfa322f338f53f" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 36643 } } peers { permanent_uuid: "bc6bef0478d44207a65d3f037201c126" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 39401 } } peers { permanent_uuid: "3aa2cfd7259947f389fa79517384e380" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 43233 } }
I20260811 08:12:42.321092 30340 raft_consensus.cc:374] T 63be0085dfaa4fcdaf95a0b73b738fb9 P 4de02a827c87459591cfa322f338f53f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:12:42.321112 30340 raft_consensus.cc:729] T 63be0085dfaa4fcdaf95a0b73b738fb9 P 4de02a827c87459591cfa322f338f53f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4de02a827c87459591cfa322f338f53f, State: Initialized, Role: FOLLOWER
I20260811 08:12:42.321194 30340 consensus_queue.cc:260] T 63be0085dfaa4fcdaf95a0b73b738fb9 P 4de02a827c87459591cfa322f338f53f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de02a827c87459591cfa322f338f53f" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 36643 } } peers { permanent_uuid: "bc6bef0478d44207a65d3f037201c126" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 39401 } } peers { permanent_uuid: "3aa2cfd7259947f389fa79517384e380" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 43233 } }
I20260811 08:12:42.321441 30340 ts_tablet_manager.cc:1428] T 63be0085dfaa4fcdaf95a0b73b738fb9 P 4de02a827c87459591cfa322f338f53f: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 08:12:42.321496 30068 heartbeater.cc:503] Master 127.27.243.254:34709 was elected leader, sending a full tablet report...
I20260811 08:12:42.363267 30348 raft_consensus.cc:482] T 63be0085dfaa4fcdaf95a0b73b738fb9 P 3aa2cfd7259947f389fa79517384e380 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:12:42.363426 30348 raft_consensus.cc:504] T 63be0085dfaa4fcdaf95a0b73b738fb9 P 3aa2cfd7259947f389fa79517384e380 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de02a827c87459591cfa322f338f53f" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 36643 } } peers { permanent_uuid: "bc6bef0478d44207a65d3f037201c126" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 39401 } } peers { permanent_uuid: "3aa2cfd7259947f389fa79517384e380" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 43233 } }
I20260811 08:12:42.363878 30348 leader_election.cc:288] T 63be0085dfaa4fcdaf95a0b73b738fb9 P 3aa2cfd7259947f389fa79517384e380 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4de02a827c87459591cfa322f338f53f (127.27.243.194:36643), bc6bef0478d44207a65d3f037201c126 (127.27.243.193:39401)
I20260811 08:12:42.367606 30332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:42.364231 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.195:51671 (local address 127.27.243.193:39401)
0811 08:12:42.364287 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0811 08:12:42.364289 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:12:42.364438 (+ 149us) server_negotiation.cc:407] Connection header received
0811 08:12:42.364484 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:12:42.364485 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:12:42.364497 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:12:42.364550 (+ 53us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:12:42.364660 (+ 110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:42.365367 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:42.366654 (+ 1287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:42.367276 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:42.367338 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:42.367345 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0811 08:12:42.367493 (+ 148us) server_negotiation.cc:299] Negotiation successful
0811 08:12:42.367534 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260811 08:12:42.367610 30330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:42.364107 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.243.195:52885 (local address 127.27.243.194:36643)
0811 08:12:42.364172 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0811 08:12:42.364174 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:12:42.364185 (+ 11us) server_negotiation.cc:407] Connection header received
0811 08:12:42.364217 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:12:42.364218 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:12:42.364227 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:12:42.364277 (+ 50us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:12:42.364450 (+ 173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:42.365199 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:42.366654 (+ 1455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:42.367212 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:42.367295 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:42.367328 (+ 33us) server_negotiation.cc:1035] Waiting for connection context
0811 08:12:42.367493 (+ 165us) server_negotiation.cc:299] Negotiation successful
0811 08:12:42.367536 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260811 08:12:42.367606 30310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:42.364022 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.194:36643 (local address 127.27.243.195:52885)
0811 08:12:42.364094 (+ 72us) negotiation.cc:107] Waiting for socket to connect
0811 08:12:42.364108 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 08:12:42.364164 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:12:42.364299 (+ 135us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:12:42.364301 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:12:42.364303 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:12:42.364379 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:12:42.364381 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:12:42.365281 (+ 900us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:12:42.365282 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:12:42.366548 (+ 1266us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:12:42.366551 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:12:42.367310 (+ 759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:12:42.367311 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:12:42.367400 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:42.367405 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 08:12:42.367470 (+ 65us) client_negotiation.cc:240] Negotiation successful
0811 08:12:42.367516 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42,"mutex_wait_us":3}
I20260811 08:12:42.367612 30353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:42.364166 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.193:39401 (local address 127.27.243.195:51671)
0811 08:12:42.364367 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0811 08:12:42.364376 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 08:12:42.364433 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:12:42.364556 (+ 123us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:12:42.364557 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:12:42.364557 (+ 0us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:12:42.364607 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:12:42.364608 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:12:42.365431 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:12:42.365432 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:12:42.366547 (+ 1115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:12:42.366551 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:12:42.367364 (+ 813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:12:42.367365 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:12:42.367426 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:42.367428 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 08:12:42.367474 (+ 46us) client_negotiation.cc:240] Negotiation successful
0811 08:12:42.367513 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":176,"thread_start_us":114,"threads_started":1}
I20260811 08:12:42.367928 29985 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "63be0085dfaa4fcdaf95a0b73b738fb9" candidate_uuid: "3aa2cfd7259947f389fa79517384e380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de02a827c87459591cfa322f338f53f" is_pre_election: true
I20260811 08:12:42.368098 29985 raft_consensus.cc:2454] T 63be0085dfaa4fcdaf95a0b73b738fb9 P 4de02a827c87459591cfa322f338f53f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3aa2cfd7259947f389fa79517384e380 in term 0.
I20260811 08:12:42.368214 29753 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "63be0085dfaa4fcdaf95a0b73b738fb9" candidate_uuid: "3aa2cfd7259947f389fa79517384e380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc6bef0478d44207a65d3f037201c126" is_pre_election: true
I20260811 08:12:42.368330 30110 leader_election.cc:302] T 63be0085dfaa4fcdaf95a0b73b738fb9 P 3aa2cfd7259947f389fa79517384e380 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3aa2cfd7259947f389fa79517384e380, 4de02a827c87459591cfa322f338f53f; no voters:
I20260811 08:12:42.368376 29753 raft_consensus.cc:2454] T 63be0085dfaa4fcdaf95a0b73b738fb9 P bc6bef0478d44207a65d3f037201c126 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3aa2cfd7259947f389fa79517384e380 in term 0.
I20260811 08:12:42.368460 30348 raft_consensus.cc:2781] T 63be0085dfaa4fcdaf95a0b73b738fb9 P 3aa2cfd7259947f389fa79517384e380 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 08:12:42.368539 30348 raft_consensus.cc:482] T 63be0085dfaa4fcdaf95a0b73b738fb9 P 3aa2cfd7259947f389fa79517384e380 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 08:12:42.368570 30348 raft_consensus.cc:3037] T 63be0085dfaa4fcdaf95a0b73b738fb9 P 3aa2cfd7259947f389fa79517384e380 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:12:42.369336 30348 raft_consensus.cc:504] T 63be0085dfaa4fcdaf95a0b73b738fb9 P 3aa2cfd7259947f389fa79517384e380 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de02a827c87459591cfa322f338f53f" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 36643 } } peers { permanent_uuid: "bc6bef0478d44207a65d3f037201c126" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 39401 } } peers { permanent_uuid: "3aa2cfd7259947f389fa79517384e380" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 43233 } }
I20260811 08:12:42.369455 30348 leader_election.cc:288] T 63be0085dfaa4fcdaf95a0b73b738fb9 P 3aa2cfd7259947f389fa79517384e380 [CANDIDATE]: Term 1 election: Requested vote from peers 4de02a827c87459591cfa322f338f53f (127.27.243.194:36643), bc6bef0478d44207a65d3f037201c126 (127.27.243.193:39401)
I20260811 08:12:42.369664 29985 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "63be0085dfaa4fcdaf95a0b73b738fb9" candidate_uuid: "3aa2cfd7259947f389fa79517384e380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de02a827c87459591cfa322f338f53f"
I20260811 08:12:42.369733 29753 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "63be0085dfaa4fcdaf95a0b73b738fb9" candidate_uuid: "3aa2cfd7259947f389fa79517384e380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc6bef0478d44207a65d3f037201c126"
I20260811 08:12:42.369771 29985 raft_consensus.cc:3037] T 63be0085dfaa4fcdaf95a0b73b738fb9 P 4de02a827c87459591cfa322f338f53f [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:12:42.369812 29753 raft_consensus.cc:3037] T 63be0085dfaa4fcdaf95a0b73b738fb9 P bc6bef0478d44207a65d3f037201c126 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:12:42.370700 29985 raft_consensus.cc:2454] T 63be0085dfaa4fcdaf95a0b73b738fb9 P 4de02a827c87459591cfa322f338f53f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3aa2cfd7259947f389fa79517384e380 in term 1.
I20260811 08:12:42.370711 29753 raft_consensus.cc:2454] T 63be0085dfaa4fcdaf95a0b73b738fb9 P bc6bef0478d44207a65d3f037201c126 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3aa2cfd7259947f389fa79517384e380 in term 1.
I20260811 08:12:42.370918 30110 leader_election.cc:302] T 63be0085dfaa4fcdaf95a0b73b738fb9 P 3aa2cfd7259947f389fa79517384e380 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3aa2cfd7259947f389fa79517384e380, bc6bef0478d44207a65d3f037201c126; no voters:
I20260811 08:12:42.371027 30348 raft_consensus.cc:2781] T 63be0085dfaa4fcdaf95a0b73b738fb9 P 3aa2cfd7259947f389fa79517384e380 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:12:42.371222 30348 raft_consensus.cc:686] T 63be0085dfaa4fcdaf95a0b73b738fb9 P 3aa2cfd7259947f389fa79517384e380 [term 1 LEADER]: Becoming Leader. State: Replica: 3aa2cfd7259947f389fa79517384e380, State: Running, Role: LEADER
I20260811 08:12:42.371326 30348 consensus_queue.cc:237] T 63be0085dfaa4fcdaf95a0b73b738fb9 P 3aa2cfd7259947f389fa79517384e380 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de02a827c87459591cfa322f338f53f" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 36643 } } peers { permanent_uuid: "bc6bef0478d44207a65d3f037201c126" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 39401 } } peers { permanent_uuid: "3aa2cfd7259947f389fa79517384e380" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 43233 } }
I20260811 08:12:42.372324 29516 catalog_manager.cc:5495] T 63be0085dfaa4fcdaf95a0b73b738fb9 P 3aa2cfd7259947f389fa79517384e380 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3aa2cfd7259947f389fa79517384e380 (127.27.243.195). New cstate: current_term: 1 leader_uuid: "3aa2cfd7259947f389fa79517384e380" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de02a827c87459591cfa322f338f53f" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 36643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc6bef0478d44207a65d3f037201c126" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 39401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3aa2cfd7259947f389fa79517384e380" member_type: VOTER last_known_addr { host: "127.27.243.195" port: 43233 } health_report { overall_health: HEALTHY } } }
I20260811 08:12:42.383337 30329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:42.380870 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38076 (local address 127.27.243.195:43233)
0811 08:12:42.380949 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0811 08:12:42.380951 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:12:42.380961 (+ 10us) server_negotiation.cc:407] Connection header received
0811 08:12:42.380994 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:12:42.380995 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:12:42.381012 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:12:42.381080 (+ 68us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:12:42.381183 (+ 103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:42.381739 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:42.382594 (+ 855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:42.382816 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:42.382917 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:42.383059 (+ 142us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:12:42.383165 (+ 106us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:12:42.383224 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0811 08:12:42.383239 (+ 15us) server_negotiation.cc:299] Negotiation successful
0811 08:12:42.383256 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260811 08:12:42.385136 29985 raft_consensus.cc:1261] T 63be0085dfaa4fcdaf95a0b73b738fb9 P 4de02a827c87459591cfa322f338f53f [term 1 FOLLOWER]: Refusing update from remote peer 3aa2cfd7259947f389fa79517384e380: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:12:42.385136 29753 raft_consensus.cc:1261] T 63be0085dfaa4fcdaf95a0b73b738fb9 P bc6bef0478d44207a65d3f037201c126 [term 1 FOLLOWER]: Refusing update from remote peer 3aa2cfd7259947f389fa79517384e380: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:12:42.385561 30356 consensus_queue.cc:1035] T 63be0085dfaa4fcdaf95a0b73b738fb9 P 3aa2cfd7259947f389fa79517384e380 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4de02a827c87459591cfa322f338f53f" member_type: VOTER last_known_addr { host: "127.27.243.194" port: 36643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:12:42.385726 30348 consensus_queue.cc:1035] T 63be0085dfaa4fcdaf95a0b73b738fb9 P 3aa2cfd7259947f389fa79517384e380 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc6bef0478d44207a65d3f037201c126" member_type: VOTER last_known_addr { host: "127.27.243.193" port: 39401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:12:42.388666 30360 mvcc.cc:205] Tried to move back new op lower bound from 7317241701926981632 to 7317241701873836032. Current Snapshot: MvccSnapshot[applied={T|T < 7317241701926981632 or (T in {7317241701926981632})}]
I20260811 08:12:42.390573 29516 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45190:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:12:42.390661 29516 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45190:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:12:42.391386 29516 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ea57a86d47a84ad1949b62a44fb12a69: Sending DeleteTablet for 3 replicas of tablet 63be0085dfaa4fcdaf95a0b73b738fb9
I20260811 08:12:42.391690 30199 tablet_service.cc:1514] Processing DeleteTablet for tablet 63be0085dfaa4fcdaf95a0b73b738fb9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:12:42 UTC) from {username='slave'} at 127.0.0.1:38062
I20260811 08:12:42.391748 29947 tablet_service.cc:1514] Processing DeleteTablet for tablet 63be0085dfaa4fcdaf95a0b73b738fb9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:12:42 UTC) from {username='slave'} at 127.0.0.1:60824
I20260811 08:12:42.391955 30374 tablet_replica.cc:330] T 63be0085dfaa4fcdaf95a0b73b738fb9 P 4de02a827c87459591cfa322f338f53f: stopping tablet replica
I20260811 08:12:42.391955 29720 tablet_service.cc:1514] Processing DeleteTablet for tablet 63be0085dfaa4fcdaf95a0b73b738fb9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:12:42 UTC) from {username='slave'} at 127.0.0.1:36626
I20260811 08:12:42.392064 30374 raft_consensus.cc:2229] T 63be0085dfaa4fcdaf95a0b73b738fb9 P 4de02a827c87459591cfa322f338f53f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:12:42.392179 30374 raft_consensus.cc:2258] T 63be0085dfaa4fcdaf95a0b73b738fb9 P 4de02a827c87459591cfa322f338f53f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:12:42.392251 30377 tablet_replica.cc:330] T 63be0085dfaa4fcdaf95a0b73b738fb9 P bc6bef0478d44207a65d3f037201c126: stopping tablet replica
I20260811 08:12:42.392421 30377 raft_consensus.cc:2229] T 63be0085dfaa4fcdaf95a0b73b738fb9 P bc6bef0478d44207a65d3f037201c126 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:12:42.392448 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 29613
I20260811 08:12:42.392603 30377 raft_consensus.cc:2258] T 63be0085dfaa4fcdaf95a0b73b738fb9 P bc6bef0478d44207a65d3f037201c126 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:12:42.392632 30374 ts_tablet_manager.cc:1905] T 63be0085dfaa4fcdaf95a0b73b738fb9 P 4de02a827c87459591cfa322f338f53f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:12:42.394785 30374 ts_tablet_manager.cc:1918] T 63be0085dfaa4fcdaf95a0b73b738fb9 P 4de02a827c87459591cfa322f338f53f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:12:42.394891 30374 log.cc:1196] T 63be0085dfaa4fcdaf95a0b73b738fb9 P 4de02a827c87459591cfa322f338f53f: Deleting WAL directory at /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435717191469-28623-0/minicluster-data/ts-1/wal/wals/63be0085dfaa4fcdaf95a0b73b738fb9
I20260811 08:12:42.395171 30374 ts_tablet_manager.cc:1939] T 63be0085dfaa4fcdaf95a0b73b738fb9 P 4de02a827c87459591cfa322f338f53f: Deleting consensus metadata
I20260811 08:12:42.398811 30373 tablet_replica.cc:330] T 63be0085dfaa4fcdaf95a0b73b738fb9 P 3aa2cfd7259947f389fa79517384e380: stopping tablet replica
I20260811 08:12:42.398950 30373 raft_consensus.cc:2229] T 63be0085dfaa4fcdaf95a0b73b738fb9 P 3aa2cfd7259947f389fa79517384e380 [term 1 LEADER]: Raft consensus shutting down.
I20260811 08:12:42.399061 30373 raft_consensus.cc:2258] T 63be0085dfaa4fcdaf95a0b73b738fb9 P 3aa2cfd7259947f389fa79517384e380 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:12:42.400910 30373 ts_tablet_manager.cc:1905] T 63be0085dfaa4fcdaf95a0b73b738fb9 P 3aa2cfd7259947f389fa79517384e380: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:12:42.400960 29492 catalog_manager.cc:4841] TS 4de02a827c87459591cfa322f338f53f (127.27.243.194:36643): tablet 63be0085dfaa4fcdaf95a0b73b738fb9 (table test-table [id=5dd3aa2a29624766ab4124d795dbbca1]) successfully deleted
I20260811 08:12:42.402570 30373 ts_tablet_manager.cc:1918] T 63be0085dfaa4fcdaf95a0b73b738fb9 P 3aa2cfd7259947f389fa79517384e380: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:12:42.402714 30373 log.cc:1196] T 63be0085dfaa4fcdaf95a0b73b738fb9 P 3aa2cfd7259947f389fa79517384e380: Deleting WAL directory at /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435717191469-28623-0/minicluster-data/ts-2/wal/wals/63be0085dfaa4fcdaf95a0b73b738fb9
I20260811 08:12:42.403003 30373 ts_tablet_manager.cc:1939] T 63be0085dfaa4fcdaf95a0b73b738fb9 P 3aa2cfd7259947f389fa79517384e380: Deleting consensus metadata
I20260811 08:12:42.403518 29491 catalog_manager.cc:4841] TS 3aa2cfd7259947f389fa79517384e380 (127.27.243.195:43233): tablet 63be0085dfaa4fcdaf95a0b73b738fb9 (table test-table [id=5dd3aa2a29624766ab4124d795dbbca1]) successfully deleted
W20260811 08:12:42.405342 29492 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.27.243.193:39401 (error 108)
I20260811 08:12:42.405607 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 29836
I20260811 08:12:42.408218 30331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:42.405720 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.193:39401 (local address 127.0.0.1:36630)
0811 08:12:42.408107 (+ 2387us) negotiation.cc:107] Waiting for socket to connect
0811 08:12:42.408176 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.193:39401: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2356}
W20260811 08:12:42.410117 29492 catalog_manager.cc:4584] TS bc6bef0478d44207a65d3f037201c126 (127.27.243.193:39401): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 63be0085dfaa4fcdaf95a0b73b738fb9: Network error: Client connection negotiation failed: client connection to 127.27.243.193:39401: connect: Connection refused (error 111)
I20260811 08:12:42.426188 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 30071
I20260811 08:12:42.440544 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 29463
2026-08-11T08:12:42Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (725 ms)
[----------] 6 tests from EncryptionPolicyTest (8752 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786435717191469-28623-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:12:42 dist-test-slave-7lbf krb5kdc[30382](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:12:42 dist-test-slave-7lbf krb5kdc[30382](info): set up 2 sockets
Aug 11 08:12:42 dist-test-slave-7lbf krb5kdc[30382](info): commencing operation
krb5kdc: starting...
W20260811 08:12:43.610172 28623 mini_kdc.cc:121] Time spent starting KDC: real 1.141s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786435717191469-28623-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786435717191469-28623-0/krb5kdc/test-user.keytab.
Aug 11 08:12:43 dist-test-slave-7lbf krb5kdc[30382](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435963, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:12:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:12:43Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786435717191469-28623-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786435717191469-28623-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 08:12:43.729849 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786435717191469-28623-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786435717191469-28623-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786435717191469-28623-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43771
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786435717191469-28623-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:45469
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43771
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:12:43.811385 30405 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:12:43.811578 30405 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:12:43.811599 30405 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:12:43.812714 30405 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:12:43.812757 30405 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:12:43.812772 30405 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:12:43.812783 30405 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:12:43.812793 30405 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:12:43.814312 30405 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:45469
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786435717191469-28623-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786435717191469-28623-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43771
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786435717191469-28623-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43771
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30405
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786435717191469-28623-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:12:43.814543 30405 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:12:43.814749 30405 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:12:43.819315 30416 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:12:43.819358 30415 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:12:43.819352 30418 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:12:43.819476 30405 server_base.cc:1034] running on GCE node
I20260811 08:12:43.819732 30405 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:12:43.819995 30405 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:12:43.821147 30405 hybrid_clock.cc:648] HybridClock initialized: now 1786435963821111 us; error 52 us; skew 500 ppm
Aug 11 08:12:43 dist-test-slave-7lbf krb5kdc[30382](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435963, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:12:43.823640 30405 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 08:12:43.824092 30405 webserver.cc:460] Webserver started at http://127.0.0.1:43177/ using document root <none> and password file <none>
I20260811 08:12:43.824323 30405 fs_manager.cc:359] Metadata directory not provided
I20260811 08:12:43.824373 30405 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:12:43.824501 30405 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:12:43.825539 30405 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786435717191469-28623-0/minicluster-data/master-0/data/instance:
uuid: "452627633ef44fabb61d67cefb2263f2"
format_stamp: "Formatted at 2026-08-11 08:12:43 on dist-test-slave-7lbf"
server_key: "65a21820b28b75ac994c2a32debb95f5"
server_key_iv: "48f127d287de99a0178b41c44032c96b"
server_key_version: "encryptionkey@0"
I20260811 08:12:43.825884 30405 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786435717191469-28623-0/minicluster-data/master-0/wal/instance:
uuid: "452627633ef44fabb61d67cefb2263f2"
format_stamp: "Formatted at 2026-08-11 08:12:43 on dist-test-slave-7lbf"
server_key: "65a21820b28b75ac994c2a32debb95f5"
server_key_iv: "48f127d287de99a0178b41c44032c96b"
server_key_version: "encryptionkey@0"
I20260811 08:12:43.827133 30405 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:12:43.827931 30433 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:12:43.828094 30405 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:12:43.828181 30405 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786435717191469-28623-0/minicluster-data/master-0/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786435717191469-28623-0/minicluster-data/master-0/wal
uuid: "452627633ef44fabb61d67cefb2263f2"
format_stamp: "Formatted at 2026-08-11 08:12:43 on dist-test-slave-7lbf"
server_key: "65a21820b28b75ac994c2a32debb95f5"
server_key_iv: "48f127d287de99a0178b41c44032c96b"
server_key_version: "encryptionkey@0"
I20260811 08:12:43.828248 30405 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786435717191469-28623-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786435717191469-28623-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786435717191469-28623-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:12:43.836647 30405 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:12:43.838380 30405 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:12:43.838536 30405 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:12:43.842432 30405 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43771
I20260811 08:12:43.842464 30509 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43771 every 8 connection(s)
I20260811 08:12:43.842775 30405 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
I20260811 08:12:43.843577 30510 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:12:43.844615 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 30405
I20260811 08:12:43.844720 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786435717191469-28623-0/minicluster-data/master-0/wal/instance
I20260811 08:12:43.844959 28623 external_mini_cluster.cc:1428] Setting key 4f88320a98a15f86b3660018f491bfdf
I20260811 08:12:43.846221 30510 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 452627633ef44fabb61d67cefb2263f2: Bootstrap starting.
I20260811 08:12:43.846865 30510 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 452627633ef44fabb61d67cefb2263f2: Neither blocks nor log segments found. Creating new log.
I20260811 08:12:43.847164 30510 log.cc:824] T 00000000000000000000000000000000 P 452627633ef44fabb61d67cefb2263f2: Log is configured to *not* fsync() on all Append() calls
I20260811 08:12:43.847937 30510 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 452627633ef44fabb61d67cefb2263f2: No bootstrap required, opened a new log
I20260811 08:12:43.850072 30510 raft_consensus.cc:348] T 00000000000000000000000000000000 P 452627633ef44fabb61d67cefb2263f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "452627633ef44fabb61d67cefb2263f2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43771 } }
I20260811 08:12:43.850242 30510 raft_consensus.cc:374] T 00000000000000000000000000000000 P 452627633ef44fabb61d67cefb2263f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:12:43.850281 30510 raft_consensus.cc:729] T 00000000000000000000000000000000 P 452627633ef44fabb61d67cefb2263f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 452627633ef44fabb61d67cefb2263f2, State: Initialized, Role: FOLLOWER
I20260811 08:12:43.850426 30510 consensus_queue.cc:260] T 00000000000000000000000000000000 P 452627633ef44fabb61d67cefb2263f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "452627633ef44fabb61d67cefb2263f2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43771 } }
I20260811 08:12:43.850512 30510 raft_consensus.cc:388] T 00000000000000000000000000000000 P 452627633ef44fabb61d67cefb2263f2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:12:43.850558 30510 raft_consensus.cc:482] T 00000000000000000000000000000000 P 452627633ef44fabb61d67cefb2263f2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:12:43.850608 30510 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 452627633ef44fabb61d67cefb2263f2 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:12:43.851181 30510 raft_consensus.cc:504] T 00000000000000000000000000000000 P 452627633ef44fabb61d67cefb2263f2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "452627633ef44fabb61d67cefb2263f2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43771 } }
I20260811 08:12:43.851289 30510 leader_election.cc:302] T 00000000000000000000000000000000 P 452627633ef44fabb61d67cefb2263f2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 452627633ef44fabb61d67cefb2263f2; no voters:
I20260811 08:12:43.851450 30510 leader_election.cc:288] T 00000000000000000000000000000000 P 452627633ef44fabb61d67cefb2263f2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:12:43.851512 30518 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 452627633ef44fabb61d67cefb2263f2 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:12:43.851698 30510 sys_catalog.cc:564] T 00000000000000000000000000000000 P 452627633ef44fabb61d67cefb2263f2 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:12:43.851706 30518 raft_consensus.cc:686] T 00000000000000000000000000000000 P 452627633ef44fabb61d67cefb2263f2 [term 1 LEADER]: Becoming Leader. State: Replica: 452627633ef44fabb61d67cefb2263f2, State: Running, Role: LEADER
Aug 11 08:12:43 dist-test-slave-7lbf krb5kdc[30382](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435963, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 08:12:43.851820 30518 consensus_queue.cc:237] T 00000000000000000000000000000000 P 452627633ef44fabb61d67cefb2263f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "452627633ef44fabb61d67cefb2263f2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43771 } }
I20260811 08:12:43.853467 30519 sys_catalog.cc:455] T 00000000000000000000000000000000 P 452627633ef44fabb61d67cefb2263f2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "452627633ef44fabb61d67cefb2263f2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "452627633ef44fabb61d67cefb2263f2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43771 } } }
I20260811 08:12:43.853579 30519 sys_catalog.cc:458] T 00000000000000000000000000000000 P 452627633ef44fabb61d67cefb2263f2 [sys.catalog]: This master's current role is: LEADER
I20260811 08:12:43.853628 30522 sys_catalog.cc:455] T 00000000000000000000000000000000 P 452627633ef44fabb61d67cefb2263f2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 452627633ef44fabb61d67cefb2263f2. Latest consensus state: current_term: 1 leader_uuid: "452627633ef44fabb61d67cefb2263f2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "452627633ef44fabb61d67cefb2263f2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43771 } } }
I20260811 08:12:43.853691 30522 sys_catalog.cc:458] T 00000000000000000000000000000000 P 452627633ef44fabb61d67cefb2263f2 [sys.catalog]: This master's current role is: LEADER
W20260811 08:12:43.854238 30548 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 452627633ef44fabb61d67cefb2263f2: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 08:12:43.854281 30548 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 08:12:43.854336 30546 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:12:43.854475 30546 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:12:43.856067 30546 catalog_manager.cc:1347] Generated new cluster ID: fff865ac35c84bf0982681911465cdae
I20260811 08:12:43.856122 30546 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:12:43.856125 30515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:43.845484 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34421 (local address 127.0.0.1:43771)
0811 08:12:43.845668 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0811 08:12:43.845678 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 08:12:43.845718 (+ 40us) server_negotiation.cc:407] Connection header received
0811 08:12:43.846228 (+ 510us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:12:43.846237 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:12:43.846298 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:12:43.846445 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:12:43.847008 (+ 563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:43.848271 (+ 1263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:43.849058 (+ 787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:43.849698 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:43.849818 (+ 120us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:43.852367 (+ 2549us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:12:43.852371 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:12:43.852372 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:12:43.852383 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:12:43.854298 (+ 1915us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:12:43.854736 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:12:43.854739 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:12:43.854740 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:12:43.854849 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:12:43.855097 (+ 248us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:12:43.855099 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:12:43.855099 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:12:43.855399 (+ 300us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:12:43.855553 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0811 08:12:43.855814 (+ 261us) server_negotiation.cc:299] Negotiation successful
0811 08:12:43.855924 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130,"thread_start_us":90,"threads_started":1}
I20260811 08:12:43.866472 28623 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 08:12:43.875495 30515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:43.868003 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35339 (local address 127.0.0.1:43771)
0811 08:12:43.868042 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0811 08:12:43.868044 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:12:43.868192 (+ 148us) server_negotiation.cc:407] Connection header received
0811 08:12:43.868248 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:12:43.868250 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:12:43.868261 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:12:43.868314 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:12:43.868973 (+ 659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:43.869794 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:43.870771 (+ 977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:43.871114 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:43.871185 (+ 71us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:43.872578 (+ 1393us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:12:43.872580 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:12:43.872580 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:12:43.872588 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:12:43.874172 (+ 1584us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:12:43.874575 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:12:43.874577 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:12:43.874577 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:12:43.874650 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:12:43.874852 (+ 202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:12:43.874853 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:12:43.874854 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:12:43.874987 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:12:43.875105 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0811 08:12:43.875192 (+ 87us) server_negotiation.cc:299] Negotiation successful
0811 08:12:43.875261 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":16,"server-negotiator.queue_time_us":18}
I20260811 08:12:43.879832 30546 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:12:43.880347 30546 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:12:43.883805 30546 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 452627633ef44fabb61d67cefb2263f2: Generated new TSK 0
I20260811 08:12:43.883987 30546 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 08:12:43.888018 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 30405
W20260811 08:12:43.903316 30380 connection.cc:535] client connection to 127.0.0.1:43771 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:43771): Connection reset by peer (error 104)
2026-08-11T08:12:43Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (1448 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786435717191469-28623-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:12:43 dist-test-slave-7lbf krb5kdc[30566](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:12:43 dist-test-slave-7lbf krb5kdc[30566](info): set up 2 sockets
Aug 11 08:12:43 dist-test-slave-7lbf krb5kdc[30566](info): commencing operation
krb5kdc: starting...
W20260811 08:12:45.054561 28623 mini_kdc.cc:121] Time spent starting KDC: real 1.138s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786435717191469-28623-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786435717191469-28623-0/krb5kdc/test-user.keytab.
Aug 11 08:12:45 dist-test-slave-7lbf krb5kdc[30566](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435965, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:12:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:12:45Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786435717191469-28623-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786435717191469-28623-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 08:12:45.175717 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786435717191469-28623-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786435717191469-28623-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786435717191469-28623-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39285
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786435717191469-28623-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:32803
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39285
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:12:45.256593 30589 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:12:45.256805 30589 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:12:45.256836 30589 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:12:45.257989 30589 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:12:45.258030 30589 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:12:45.258049 30589 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:12:45.258064 30589 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:12:45.258090 30589 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:12:45.259536 30589 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:32803
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786435717191469-28623-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786435717191469-28623-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39285
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786435717191469-28623-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39285
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30589
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786435717191469-28623-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:12:45.259773 30589 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:12:45.259971 30589 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:12:45.264518 30601 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:12:45.264552 30597 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:12:45.264524 30595 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:12:45.264643 30589 server_base.cc:1034] running on GCE node
I20260811 08:12:45.265012 30589 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:12:45.265273 30589 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:12:45.266404 30589 hybrid_clock.cc:648] HybridClock initialized: now 1786435965266388 us; error 32 us; skew 500 ppm
Aug 11 08:12:45 dist-test-slave-7lbf krb5kdc[30566](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435965, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:12:45.268738 30589 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 08:12:45.269141 30589 webserver.cc:460] Webserver started at http://127.0.0.1:38347/ using document root <none> and password file <none>
I20260811 08:12:45.269353 30589 fs_manager.cc:359] Metadata directory not provided
I20260811 08:12:45.269402 30589 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:12:45.269546 30589 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:12:45.270574 30589 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786435717191469-28623-0/minicluster-data/master-0/data/instance:
uuid: "aef71596f931427c91893a90d8c1e170"
format_stamp: "Formatted at 2026-08-11 08:12:45 on dist-test-slave-7lbf"
server_key: "d9c2cae2ab32583dfdadff9dda23a684"
server_key_iv: "ae918a880858150d92880da9d6b9862a"
server_key_version: "encryptionkey@0"
I20260811 08:12:45.270907 30589 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786435717191469-28623-0/minicluster-data/master-0/wal/instance:
uuid: "aef71596f931427c91893a90d8c1e170"
format_stamp: "Formatted at 2026-08-11 08:12:45 on dist-test-slave-7lbf"
server_key: "d9c2cae2ab32583dfdadff9dda23a684"
server_key_iv: "ae918a880858150d92880da9d6b9862a"
server_key_version: "encryptionkey@0"
I20260811 08:12:45.272158 30589 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 08:12:45.272794 30614 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:12:45.272944 30589 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 08:12:45.273029 30589 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786435717191469-28623-0/minicluster-data/master-0/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786435717191469-28623-0/minicluster-data/master-0/wal
uuid: "aef71596f931427c91893a90d8c1e170"
format_stamp: "Formatted at 2026-08-11 08:12:45 on dist-test-slave-7lbf"
server_key: "d9c2cae2ab32583dfdadff9dda23a684"
server_key_iv: "ae918a880858150d92880da9d6b9862a"
server_key_version: "encryptionkey@0"
I20260811 08:12:45.273087 30589 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786435717191469-28623-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786435717191469-28623-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786435717191469-28623-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:12:45.283712 30589 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:12:45.285385 30589 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:12:45.285511 30589 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:12:45.289202 30589 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39285
I20260811 08:12:45.289240 30701 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39285 every 8 connection(s)
I20260811 08:12:45.289567 30589 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
I20260811 08:12:45.290236 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 30589
I20260811 08:12:45.290338 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786435717191469-28623-0/minicluster-data/master-0/wal/instance
I20260811 08:12:45.290398 30704 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:12:45.290546 28623 external_mini_cluster.cc:1428] Setting key f3e8e0c881187217d787d5b7f0098cae
I20260811 08:12:45.293233 30704 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aef71596f931427c91893a90d8c1e170: Bootstrap starting.
I20260811 08:12:45.293938 30704 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P aef71596f931427c91893a90d8c1e170: Neither blocks nor log segments found. Creating new log.
I20260811 08:12:45.294242 30704 log.cc:824] T 00000000000000000000000000000000 P aef71596f931427c91893a90d8c1e170: Log is configured to *not* fsync() on all Append() calls
I20260811 08:12:45.294976 30704 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aef71596f931427c91893a90d8c1e170: No bootstrap required, opened a new log
I20260811 08:12:45.296015 30708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:45.291148 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57651 (local address 127.0.0.1:39285)
0811 08:12:45.291312 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0811 08:12:45.291319 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 08:12:45.291353 (+ 34us) server_negotiation.cc:407] Connection header received
0811 08:12:45.291769 (+ 416us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:12:45.291776 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:12:45.291825 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:12:45.291938 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:12:45.292183 (+ 245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:45.293067 (+ 884us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:45.294135 (+ 1068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:45.294642 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:45.294744 (+ 102us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:45.295416 (+ 672us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:12:45.295420 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:12:45.295420 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:12:45.295569 (+ 149us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:12:45.295597 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:12:45.295607 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:12:45.295670 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 08:12:45.295776 (+ 106us) server_negotiation.cc:299] Negotiation successful
0811 08:12:45.295799 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":118,"thread_start_us":71,"threads_started":1}
I20260811 08:12:45.296978 28623 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 08:12:45.297051 30704 raft_consensus.cc:348] T 00000000000000000000000000000000 P aef71596f931427c91893a90d8c1e170 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aef71596f931427c91893a90d8c1e170" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39285 } }
I20260811 08:12:45.297194 30704 raft_consensus.cc:374] T 00000000000000000000000000000000 P aef71596f931427c91893a90d8c1e170 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:12:45.297233 30704 raft_consensus.cc:729] T 00000000000000000000000000000000 P aef71596f931427c91893a90d8c1e170 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aef71596f931427c91893a90d8c1e170, State: Initialized, Role: FOLLOWER
I20260811 08:12:45.297343 30704 consensus_queue.cc:260] T 00000000000000000000000000000000 P aef71596f931427c91893a90d8c1e170 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aef71596f931427c91893a90d8c1e170" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39285 } }
I20260811 08:12:45.297408 30704 raft_consensus.cc:388] T 00000000000000000000000000000000 P aef71596f931427c91893a90d8c1e170 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:12:45.297438 30704 raft_consensus.cc:482] T 00000000000000000000000000000000 P aef71596f931427c91893a90d8c1e170 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:12:45.297482 30704 raft_consensus.cc:3037] T 00000000000000000000000000000000 P aef71596f931427c91893a90d8c1e170 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:12:45.298049 30704 raft_consensus.cc:504] T 00000000000000000000000000000000 P aef71596f931427c91893a90d8c1e170 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aef71596f931427c91893a90d8c1e170" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39285 } }
I20260811 08:12:45.298153 30704 leader_election.cc:302] T 00000000000000000000000000000000 P aef71596f931427c91893a90d8c1e170 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: aef71596f931427c91893a90d8c1e170; no voters:
I20260811 08:12:45.298302 30704 leader_election.cc:288] T 00000000000000000000000000000000 P aef71596f931427c91893a90d8c1e170 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:12:45.298388 30718 raft_consensus.cc:2781] T 00000000000000000000000000000000 P aef71596f931427c91893a90d8c1e170 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:12:45.298525 30718 raft_consensus.cc:686] T 00000000000000000000000000000000 P aef71596f931427c91893a90d8c1e170 [term 1 LEADER]: Becoming Leader. State: Replica: aef71596f931427c91893a90d8c1e170, State: Running, Role: LEADER
I20260811 08:12:45.298542 30704 sys_catalog.cc:564] T 00000000000000000000000000000000 P aef71596f931427c91893a90d8c1e170 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:12:45.298612 30718 consensus_queue.cc:237] T 00000000000000000000000000000000 P aef71596f931427c91893a90d8c1e170 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aef71596f931427c91893a90d8c1e170" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39285 } }
I20260811 08:12:45.298969 30724 sys_catalog.cc:455] T 00000000000000000000000000000000 P aef71596f931427c91893a90d8c1e170 [sys.catalog]: SysCatalogTable state changed. Reason: New leader aef71596f931427c91893a90d8c1e170. Latest consensus state: current_term: 1 leader_uuid: "aef71596f931427c91893a90d8c1e170" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aef71596f931427c91893a90d8c1e170" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39285 } } }
I20260811 08:12:45.299054 30724 sys_catalog.cc:458] T 00000000000000000000000000000000 P aef71596f931427c91893a90d8c1e170 [sys.catalog]: This master's current role is: LEADER
I20260811 08:12:45.299230 30732 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:12:45.299254 30723 sys_catalog.cc:455] T 00000000000000000000000000000000 P aef71596f931427c91893a90d8c1e170 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "aef71596f931427c91893a90d8c1e170" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aef71596f931427c91893a90d8c1e170" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39285 } } }
I20260811 08:12:45.299604 30723 sys_catalog.cc:458] T 00000000000000000000000000000000 P aef71596f931427c91893a90d8c1e170 [sys.catalog]: This master's current role is: LEADER
I20260811 08:12:45.299718 30732 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:12:45.301141 30732 catalog_manager.cc:1347] Generated new cluster ID: eacb7d7301d54dfb9edc6a5337cbcf24
I20260811 08:12:45.301198 30732 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:12:45.302608 30708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:45.298297 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35227 (local address 127.0.0.1:39285)
0811 08:12:45.298332 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0811 08:12:45.298334 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:12:45.299960 (+ 1626us) server_negotiation.cc:407] Connection header received
0811 08:12:45.300017 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:12:45.300018 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:12:45.300026 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:12:45.300071 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:12:45.300186 (+ 115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:45.300645 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:45.301650 (+ 1005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:45.301845 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:45.301920 (+ 75us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:45.302412 (+ 492us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:12:45.302413 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:12:45.302413 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:12:45.302416 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:12:45.302428 (+ 12us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:12:45.302431 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:12:45.302473 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0811 08:12:45.302535 (+ 62us) server_negotiation.cc:299] Negotiation successful
0811 08:12:45.302543 (+ 8us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 08:12:45.309630 30732 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:12:45.310254 30732 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:12:45.317961 30732 catalog_manager.cc:5868] T 00000000000000000000000000000000 P aef71596f931427c91893a90d8c1e170: Generated new TSK 0
I20260811 08:12:45.318120 30732 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 08:12:45.320456 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 30589
W20260811 08:12:45.339476 30562 connection.cc:535] client connection to 127.0.0.1:39285 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:39285): Connection reset by peer (error 104)
2026-08-11T08:12:45Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1436 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786435717191469-28623-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:12:45 dist-test-slave-7lbf krb5kdc[30755](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:12:45 dist-test-slave-7lbf krb5kdc[30755](info): set up 2 sockets
Aug 11 08:12:45 dist-test-slave-7lbf krb5kdc[30755](info): commencing operation
krb5kdc: starting...
W20260811 08:12:46.503316 28623 mini_kdc.cc:121] Time spent starting KDC: real 1.150s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786435717191469-28623-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786435717191469-28623-0/krb5kdc/test-user.keytab.
Aug 11 08:12:46 dist-test-slave-7lbf krb5kdc[30755](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435966, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:12:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:12:46Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786435717191469-28623-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786435717191469-28623-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 08:12:46.618438 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786435717191469-28623-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786435717191469-28623-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786435717191469-28623-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38551
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786435717191469-28623-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38909
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38551
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:12:46.698377 30775 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:12:46.698567 30775 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:12:46.698590 30775 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:12:46.699717 30775 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:12:46.699757 30775 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:12:46.699770 30775 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:12:46.699781 30775 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:12:46.699795 30775 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:12:46.701242 30775 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38909
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786435717191469-28623-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786435717191469-28623-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38551
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786435717191469-28623-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38551
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30775
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786435717191469-28623-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:12:46.701481 30775 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:12:46.701705 30775 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:12:46.706218 30789 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:12:46.706259 30783 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:12:46.706322 30786 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:12:46.706589 30775 server_base.cc:1034] running on GCE node
I20260811 08:12:46.706851 30775 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:12:46.707123 30775 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:12:46.708285 30775 hybrid_clock.cc:648] HybridClock initialized: now 1786435966708260 us; error 39 us; skew 500 ppm
Aug 11 08:12:46 dist-test-slave-7lbf krb5kdc[30755](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435966, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:12:46.710745 30775 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 08:12:46.711174 30775 webserver.cc:460] Webserver started at http://127.0.0.1:41145/ using document root <none> and password file <none>
I20260811 08:12:46.711380 30775 fs_manager.cc:359] Metadata directory not provided
I20260811 08:12:46.711423 30775 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:12:46.711535 30775 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:12:46.712535 30775 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786435717191469-28623-0/minicluster-data/master-0/data/instance:
uuid: "94bf99b2b5c44c8abfa9618d9088bc96"
format_stamp: "Formatted at 2026-08-11 08:12:46 on dist-test-slave-7lbf"
server_key: "cd1f5413c122b79434c34f3d906e747f"
server_key_iv: "2ae66ea5a1f4e3202782e900d83d5579"
server_key_version: "encryptionkey@0"
I20260811 08:12:46.712852 30775 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786435717191469-28623-0/minicluster-data/master-0/wal/instance:
uuid: "94bf99b2b5c44c8abfa9618d9088bc96"
format_stamp: "Formatted at 2026-08-11 08:12:46 on dist-test-slave-7lbf"
server_key: "cd1f5413c122b79434c34f3d906e747f"
server_key_iv: "2ae66ea5a1f4e3202782e900d83d5579"
server_key_version: "encryptionkey@0"
I20260811 08:12:46.714119 30775 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 08:12:46.714767 30800 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:12:46.714943 30775 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 08:12:46.715026 30775 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786435717191469-28623-0/minicluster-data/master-0/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786435717191469-28623-0/minicluster-data/master-0/wal
uuid: "94bf99b2b5c44c8abfa9618d9088bc96"
format_stamp: "Formatted at 2026-08-11 08:12:46 on dist-test-slave-7lbf"
server_key: "cd1f5413c122b79434c34f3d906e747f"
server_key_iv: "2ae66ea5a1f4e3202782e900d83d5579"
server_key_version: "encryptionkey@0"
I20260811 08:12:46.715085 30775 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786435717191469-28623-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786435717191469-28623-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786435717191469-28623-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:12:46.718241 30775 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:12:46.719821 30775 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:12:46.719942 30775 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:12:46.723629 30775 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38551
I20260811 08:12:46.723662 30889 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38551 every 8 connection(s)
I20260811 08:12:46.723943 30775 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
I20260811 08:12:46.724846 30891 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:12:46.727038 30891 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 94bf99b2b5c44c8abfa9618d9088bc96: Bootstrap starting.
I20260811 08:12:46.727567 30891 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 94bf99b2b5c44c8abfa9618d9088bc96: Neither blocks nor log segments found. Creating new log.
I20260811 08:12:46.727819 30891 log.cc:824] T 00000000000000000000000000000000 P 94bf99b2b5c44c8abfa9618d9088bc96: Log is configured to *not* fsync() on all Append() calls
I20260811 08:12:46.728447 30891 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 94bf99b2b5c44c8abfa9618d9088bc96: No bootstrap required, opened a new log
I20260811 08:12:46.730034 30891 raft_consensus.cc:348] T 00000000000000000000000000000000 P 94bf99b2b5c44c8abfa9618d9088bc96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "94bf99b2b5c44c8abfa9618d9088bc96" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38551 } }
I20260811 08:12:46.730162 30891 raft_consensus.cc:374] T 00000000000000000000000000000000 P 94bf99b2b5c44c8abfa9618d9088bc96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:12:46.730185 30891 raft_consensus.cc:729] T 00000000000000000000000000000000 P 94bf99b2b5c44c8abfa9618d9088bc96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94bf99b2b5c44c8abfa9618d9088bc96, State: Initialized, Role: FOLLOWER
I20260811 08:12:46.730320 30891 consensus_queue.cc:260] T 00000000000000000000000000000000 P 94bf99b2b5c44c8abfa9618d9088bc96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "94bf99b2b5c44c8abfa9618d9088bc96" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38551 } }
I20260811 08:12:46.730407 30891 raft_consensus.cc:388] T 00000000000000000000000000000000 P 94bf99b2b5c44c8abfa9618d9088bc96 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:12:46.730432 30891 raft_consensus.cc:482] T 00000000000000000000000000000000 P 94bf99b2b5c44c8abfa9618d9088bc96 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:12:46.730460 30891 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 94bf99b2b5c44c8abfa9618d9088bc96 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:12:46.730957 30891 raft_consensus.cc:504] T 00000000000000000000000000000000 P 94bf99b2b5c44c8abfa9618d9088bc96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "94bf99b2b5c44c8abfa9618d9088bc96" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38551 } }
I20260811 08:12:46.731043 30891 leader_election.cc:302] T 00000000000000000000000000000000 P 94bf99b2b5c44c8abfa9618d9088bc96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 94bf99b2b5c44c8abfa9618d9088bc96; no voters:
I20260811 08:12:46.731191 30891 leader_election.cc:288] T 00000000000000000000000000000000 P 94bf99b2b5c44c8abfa9618d9088bc96 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:12:46.731231 30896 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 94bf99b2b5c44c8abfa9618d9088bc96 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:12:46.731388 30896 raft_consensus.cc:686] T 00000000000000000000000000000000 P 94bf99b2b5c44c8abfa9618d9088bc96 [term 1 LEADER]: Becoming Leader. State: Replica: 94bf99b2b5c44c8abfa9618d9088bc96, State: Running, Role: LEADER
I20260811 08:12:46.731431 30891 sys_catalog.cc:564] T 00000000000000000000000000000000 P 94bf99b2b5c44c8abfa9618d9088bc96 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:12:46.731480 30896 consensus_queue.cc:237] T 00000000000000000000000000000000 P 94bf99b2b5c44c8abfa9618d9088bc96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "94bf99b2b5c44c8abfa9618d9088bc96" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38551 } }
I20260811 08:12:46.731823 30898 sys_catalog.cc:455] T 00000000000000000000000000000000 P 94bf99b2b5c44c8abfa9618d9088bc96 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 94bf99b2b5c44c8abfa9618d9088bc96. Latest consensus state: current_term: 1 leader_uuid: "94bf99b2b5c44c8abfa9618d9088bc96" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "94bf99b2b5c44c8abfa9618d9088bc96" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38551 } } }
I20260811 08:12:46.731904 30898 sys_catalog.cc:458] T 00000000000000000000000000000000 P 94bf99b2b5c44c8abfa9618d9088bc96 [sys.catalog]: This master's current role is: LEADER
I20260811 08:12:46.731945 30897 sys_catalog.cc:455] T 00000000000000000000000000000000 P 94bf99b2b5c44c8abfa9618d9088bc96 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "94bf99b2b5c44c8abfa9618d9088bc96" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "94bf99b2b5c44c8abfa9618d9088bc96" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38551 } } }
I20260811 08:12:46.732021 30897 sys_catalog.cc:458] T 00000000000000000000000000000000 P 94bf99b2b5c44c8abfa9618d9088bc96 [sys.catalog]: This master's current role is: LEADER
I20260811 08:12:46.732380 30909 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:12:46.732846 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 30775
I20260811 08:12:46.732868 30909 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:12:46.732972 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786435717191469-28623-0/minicluster-data/master-0/wal/instance
I20260811 08:12:46.733144 28623 external_mini_cluster.cc:1428] Setting key e7357e39eb089dbe1ee96517ba445e55
I20260811 08:12:46.734500 30909 catalog_manager.cc:1347] Generated new cluster ID: 74f4a65fba364ff59b7c77b68e8b671f
I20260811 08:12:46.734546 30909 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:12:46.735296 30936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:46.733596 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52465 (local address 127.0.0.1:38551)
0811 08:12:46.733876 (+ 280us) server_negotiation.cc:206] Beginning negotiation
0811 08:12:46.733885 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 08:12:46.733919 (+ 34us) server_negotiation.cc:407] Connection header received
0811 08:12:46.734042 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:12:46.734051 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:12:46.734083 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:12:46.734220 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:12:46.734876 (+ 656us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:12:46.734880 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:12:46.734880 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:12:46.734884 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:12:46.734920 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:12:46.734930 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:12:46.734980 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0811 08:12:46.735048 (+ 68us) server_negotiation.cc:299] Negotiation successful
0811 08:12:46.735167 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":230,"thread_start_us":67,"threads_started":1}
I20260811 08:12:46.736081 28623 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 08:12:46.742884 30936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:46.741861 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41703 (local address 127.0.0.1:38551)
0811 08:12:46.741893 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0811 08:12:46.741894 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 08:12:46.742075 (+ 181us) server_negotiation.cc:407] Connection header received
0811 08:12:46.742143 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:12:46.742144 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:12:46.742149 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:12:46.742195 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:12:46.742689 (+ 494us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:12:46.742690 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:12:46.742691 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:12:46.742694 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:12:46.742708 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:12:46.742711 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:12:46.742756 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0811 08:12:46.742805 (+ 49us) server_negotiation.cc:299] Negotiation successful
0811 08:12:46.742817 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260811 08:12:46.749578 30909 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:12:46.749723 30909 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:12:46.760136 30909 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 94bf99b2b5c44c8abfa9618d9088bc96: Generated new TSK 0
I20260811 08:12:46.760306 30909 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 08:12:46.770749 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 30775
2026-08-11T08:12:46Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1451 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786435717191469-28623-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:12:46 dist-test-slave-7lbf krb5kdc[30952](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:12:46 dist-test-slave-7lbf krb5kdc[30952](info): set up 2 sockets
Aug 11 08:12:46 dist-test-slave-7lbf krb5kdc[30952](info): commencing operation
krb5kdc: starting...
W20260811 08:12:47.970610 28623 mini_kdc.cc:121] Time spent starting KDC: real 1.166s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786435717191469-28623-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786435717191469-28623-0/krb5kdc/test-user.keytab.
Aug 11 08:12:48 dist-test-slave-7lbf krb5kdc[30952](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435968, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:12:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:12:48Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786435717191469-28623-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786435717191469-28623-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 08:12:48.092303 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786435717191469-28623-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786435717191469-28623-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786435717191469-28623-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33471
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786435717191469-28623-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40531
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33471
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:12:48.175491 30977 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:12:48.175689 30977 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:12:48.175710 30977 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:12:48.176822 30977 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:12:48.176870 30977 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:12:48.176885 30977 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:12:48.176895 30977 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:12:48.176908 30977 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:12:48.178391 30977 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40531
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786435717191469-28623-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786435717191469-28623-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33471
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786435717191469-28623-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33471
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30977
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786435717191469-28623-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:12:48.178613 30977 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:12:48.178815 30977 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:12:48.183372 30987 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:12:48.183459 30984 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:12:48.183470 30985 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:12:48.183487 30977 server_base.cc:1034] running on GCE node
I20260811 08:12:48.183876 30977 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:12:48.184142 30977 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:12:48.185295 30977 hybrid_clock.cc:648] HybridClock initialized: now 1786435968185275 us; error 30 us; skew 500 ppm
Aug 11 08:12:48 dist-test-slave-7lbf krb5kdc[30952](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435968, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:12:48.187744 30977 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 08:12:48.188126 30977 webserver.cc:460] Webserver started at http://127.0.0.1:39803/ using document root <none> and password file <none>
I20260811 08:12:48.188308 30977 fs_manager.cc:359] Metadata directory not provided
I20260811 08:12:48.188346 30977 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:12:48.188434 30977 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:12:48.189411 30977 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786435717191469-28623-0/minicluster-data/master-0/data/instance:
uuid: "329e5735ce3a4cf69c3ed8977f995b38"
format_stamp: "Formatted at 2026-08-11 08:12:48 on dist-test-slave-7lbf"
server_key: "13ef2ee342b6a83bf0b0540a75fdafed"
server_key_iv: "a23cf71e9f8898da9facbf0d98ee79f8"
server_key_version: "encryptionkey@0"
I20260811 08:12:48.189765 30977 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786435717191469-28623-0/minicluster-data/master-0/wal/instance:
uuid: "329e5735ce3a4cf69c3ed8977f995b38"
format_stamp: "Formatted at 2026-08-11 08:12:48 on dist-test-slave-7lbf"
server_key: "13ef2ee342b6a83bf0b0540a75fdafed"
server_key_iv: "a23cf71e9f8898da9facbf0d98ee79f8"
server_key_version: "encryptionkey@0"
I20260811 08:12:48.191039 30977 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:12:48.191728 30998 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:12:48.191928 30977 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:12:48.192016 30977 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786435717191469-28623-0/minicluster-data/master-0/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786435717191469-28623-0/minicluster-data/master-0/wal
uuid: "329e5735ce3a4cf69c3ed8977f995b38"
format_stamp: "Formatted at 2026-08-11 08:12:48 on dist-test-slave-7lbf"
server_key: "13ef2ee342b6a83bf0b0540a75fdafed"
server_key_iv: "a23cf71e9f8898da9facbf0d98ee79f8"
server_key_version: "encryptionkey@0"
I20260811 08:12:48.192083 30977 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786435717191469-28623-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786435717191469-28623-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786435717191469-28623-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:12:48.216465 30977 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:12:48.218504 30977 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:12:48.218637 30977 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:12:48.222625 30977 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33471
I20260811 08:12:48.222687 31078 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33471 every 8 connection(s)
I20260811 08:12:48.223003 30977 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
I20260811 08:12:48.223905 31082 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:12:48.226300 31082 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 329e5735ce3a4cf69c3ed8977f995b38: Bootstrap starting.
I20260811 08:12:48.226890 31082 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 329e5735ce3a4cf69c3ed8977f995b38: Neither blocks nor log segments found. Creating new log.
I20260811 08:12:48.227151 31082 log.cc:824] T 00000000000000000000000000000000 P 329e5735ce3a4cf69c3ed8977f995b38: Log is configured to *not* fsync() on all Append() calls
I20260811 08:12:48.227380 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 30977
I20260811 08:12:48.227485 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786435717191469-28623-0/minicluster-data/master-0/wal/instance
I20260811 08:12:48.227649 28623 external_mini_cluster.cc:1428] Setting key 39c504c9689c8211da9a7e205fd785c7
I20260811 08:12:48.227905 31082 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 329e5735ce3a4cf69c3ed8977f995b38: No bootstrap required, opened a new log
I20260811 08:12:48.230005 31082 raft_consensus.cc:348] T 00000000000000000000000000000000 P 329e5735ce3a4cf69c3ed8977f995b38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "329e5735ce3a4cf69c3ed8977f995b38" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33471 } }
I20260811 08:12:48.230186 31082 raft_consensus.cc:374] T 00000000000000000000000000000000 P 329e5735ce3a4cf69c3ed8977f995b38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:12:48.230230 31082 raft_consensus.cc:729] T 00000000000000000000000000000000 P 329e5735ce3a4cf69c3ed8977f995b38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 329e5735ce3a4cf69c3ed8977f995b38, State: Initialized, Role: FOLLOWER
I20260811 08:12:48.230372 31082 consensus_queue.cc:260] T 00000000000000000000000000000000 P 329e5735ce3a4cf69c3ed8977f995b38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "329e5735ce3a4cf69c3ed8977f995b38" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33471 } }
I20260811 08:12:48.230463 31082 raft_consensus.cc:388] T 00000000000000000000000000000000 P 329e5735ce3a4cf69c3ed8977f995b38 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:12:48.230499 31082 raft_consensus.cc:482] T 00000000000000000000000000000000 P 329e5735ce3a4cf69c3ed8977f995b38 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:12:48.230557 31082 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 329e5735ce3a4cf69c3ed8977f995b38 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:12:48.231240 31082 raft_consensus.cc:504] T 00000000000000000000000000000000 P 329e5735ce3a4cf69c3ed8977f995b38 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "329e5735ce3a4cf69c3ed8977f995b38" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33471 } }
I20260811 08:12:48.231359 31082 leader_election.cc:302] T 00000000000000000000000000000000 P 329e5735ce3a4cf69c3ed8977f995b38 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 329e5735ce3a4cf69c3ed8977f995b38; no voters:
I20260811 08:12:48.231506 31082 leader_election.cc:288] T 00000000000000000000000000000000 P 329e5735ce3a4cf69c3ed8977f995b38 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:12:48.231552 31088 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 329e5735ce3a4cf69c3ed8977f995b38 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:12:48.231737 31082 sys_catalog.cc:564] T 00000000000000000000000000000000 P 329e5735ce3a4cf69c3ed8977f995b38 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:12:48.231751 31088 raft_consensus.cc:686] T 00000000000000000000000000000000 P 329e5735ce3a4cf69c3ed8977f995b38 [term 1 LEADER]: Becoming Leader. State: Replica: 329e5735ce3a4cf69c3ed8977f995b38, State: Running, Role: LEADER
I20260811 08:12:48.233151 31088 consensus_queue.cc:237] T 00000000000000000000000000000000 P 329e5735ce3a4cf69c3ed8977f995b38 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "329e5735ce3a4cf69c3ed8977f995b38" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33471 } }
I20260811 08:12:48.233948 31089 sys_catalog.cc:455] T 00000000000000000000000000000000 P 329e5735ce3a4cf69c3ed8977f995b38 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "329e5735ce3a4cf69c3ed8977f995b38" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "329e5735ce3a4cf69c3ed8977f995b38" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33471 } } }
I20260811 08:12:48.234074 31089 sys_catalog.cc:458] T 00000000000000000000000000000000 P 329e5735ce3a4cf69c3ed8977f995b38 [sys.catalog]: This master's current role is: LEADER
I20260811 08:12:48.234053 31093 sys_catalog.cc:455] T 00000000000000000000000000000000 P 329e5735ce3a4cf69c3ed8977f995b38 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 329e5735ce3a4cf69c3ed8977f995b38. Latest consensus state: current_term: 1 leader_uuid: "329e5735ce3a4cf69c3ed8977f995b38" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "329e5735ce3a4cf69c3ed8977f995b38" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33471 } } }
I20260811 08:12:48.234133 31093 sys_catalog.cc:458] T 00000000000000000000000000000000 P 329e5735ce3a4cf69c3ed8977f995b38 [sys.catalog]: This master's current role is: LEADER
I20260811 08:12:48.234411 31112 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:12:48.234905 31112 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 11 08:12:48 dist-test-slave-7lbf krb5kdc[30952](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435968, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 08:12:48.236611 31112 catalog_manager.cc:1347] Generated new cluster ID: 44243956d7b84e9e91a54e908718753a
I20260811 08:12:48.236661 31112 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:12:48.248780 31087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:48.228169 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46843 (local address 127.0.0.1:33471)
0811 08:12:48.228381 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0811 08:12:48.228391 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 08:12:48.228427 (+ 36us) server_negotiation.cc:407] Connection header received
0811 08:12:48.229194 (+ 767us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:12:48.229204 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:12:48.229269 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:12:48.229422 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:12:48.230052 (+ 630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:48.231731 (+ 1679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:48.232604 (+ 873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:48.233241 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:48.233344 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:48.236301 (+ 2957us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:12:48.236306 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:12:48.236306 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:12:48.236318 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:12:48.247112 (+ 10794us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:12:48.247523 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:12:48.247526 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:12:48.247527 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:12:48.247648 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:12:48.247823 (+ 175us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:12:48.247824 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:12:48.247825 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:12:48.248157 (+ 332us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:12:48.248301 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0811 08:12:48.248400 (+ 99us) server_negotiation.cc:299] Negotiation successful
0811 08:12:48.248544 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":155,"thread_start_us":101,"threads_started":1}
I20260811 08:12:48.249794 28623 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 08:12:48.264671 31112 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:12:48.265403 31112 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:12:48.269312 31112 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 329e5735ce3a4cf69c3ed8977f995b38: Generated new TSK 0
I20260811 08:12:48.269565 31112 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 08:12:48.270179 31087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:48.251319 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58933 (local address 127.0.0.1:33471)
0811 08:12:48.251357 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0811 08:12:48.251359 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:12:48.264296 (+ 12937us) server_negotiation.cc:407] Connection header received
0811 08:12:48.264357 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:12:48.264358 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:12:48.264369 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:12:48.264417 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:12:48.265080 (+ 663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:48.265653 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:48.266342 (+ 689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:48.266556 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:48.266610 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:48.267736 (+ 1126us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:12:48.267737 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:12:48.267737 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:12:48.267745 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:12:48.269057 (+ 1312us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:12:48.269392 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:12:48.269393 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:12:48.269393 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:12:48.269454 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:12:48.269708 (+ 254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:12:48.269709 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:12:48.269709 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:12:48.269819 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:12:48.269911 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0811 08:12:48.270006 (+ 95us) server_negotiation.cc:299] Negotiation successful
0811 08:12:48.270095 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 08:12:48.271911 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 30977
2026-08-11T08:12:48Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (1495 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786435717191469-28623-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:12:48 dist-test-slave-7lbf krb5kdc[31131](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:12:48 dist-test-slave-7lbf krb5kdc[31131](info): set up 2 sockets
Aug 11 08:12:48 dist-test-slave-7lbf krb5kdc[31131](info): commencing operation
krb5kdc: starting...
W20260811 08:12:49.443481 28623 mini_kdc.cc:121] Time spent starting KDC: real 1.143s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786435717191469-28623-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786435717191469-28623-0/krb5kdc/test-user.keytab.
Aug 11 08:12:49 dist-test-slave-7lbf krb5kdc[31131](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435969, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:12:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:12:49Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786435717191469-28623-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786435717191469-28623-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 08:12:49.564581 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786435717191469-28623-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786435717191469-28623-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786435717191469-28623-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33239
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786435717191469-28623-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35839
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33239
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:12:49.645792 31153 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:12:49.645998 31153 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:12:49.646023 31153 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:12:49.647106 31153 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:12:49.647142 31153 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:12:49.647154 31153 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:12:49.647166 31153 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:12:49.647176 31153 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:12:49.648612 31153 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35839
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786435717191469-28623-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786435717191469-28623-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33239
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786435717191469-28623-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33239
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31153
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786435717191469-28623-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:12:49.648797 31153 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:12:49.648977 31153 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:12:49.653630 31164 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:12:49.653656 31162 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:12:49.653743 31153 server_base.cc:1034] running on GCE node
W20260811 08:12:49.653636 31161 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:12:49.654191 31153 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:12:49.654487 31153 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:12:49.655639 31153 hybrid_clock.cc:648] HybridClock initialized: now 1786435969655626 us; error 34 us; skew 500 ppm
Aug 11 08:12:49 dist-test-slave-7lbf krb5kdc[31131](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435969, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:12:49.663103 31153 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 08:12:49.663552 31153 webserver.cc:460] Webserver started at http://127.0.0.1:36103/ using document root <none> and password file <none>
I20260811 08:12:49.663757 31153 fs_manager.cc:359] Metadata directory not provided
I20260811 08:12:49.663798 31153 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:12:49.663893 31153 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:12:49.664921 31153 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786435717191469-28623-0/minicluster-data/master-0/data/instance:
uuid: "5ddc71e92ffe4276bebe410a3d232c33"
format_stamp: "Formatted at 2026-08-11 08:12:49 on dist-test-slave-7lbf"
server_key: "6c4fdcf76bdf56d40e05d091cfcaa78a"
server_key_iv: "10d7cd33aa296b1ec5b4b4db2f85e3e8"
server_key_version: "encryptionkey@0"
I20260811 08:12:49.665220 31153 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786435717191469-28623-0/minicluster-data/master-0/wal/instance:
uuid: "5ddc71e92ffe4276bebe410a3d232c33"
format_stamp: "Formatted at 2026-08-11 08:12:49 on dist-test-slave-7lbf"
server_key: "6c4fdcf76bdf56d40e05d091cfcaa78a"
server_key_iv: "10d7cd33aa296b1ec5b4b4db2f85e3e8"
server_key_version: "encryptionkey@0"
I20260811 08:12:49.666528 31153 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 08:12:49.667243 31177 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:12:49.667397 31153 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 08:12:49.667485 31153 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786435717191469-28623-0/minicluster-data/master-0/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786435717191469-28623-0/minicluster-data/master-0/wal
uuid: "5ddc71e92ffe4276bebe410a3d232c33"
format_stamp: "Formatted at 2026-08-11 08:12:49 on dist-test-slave-7lbf"
server_key: "6c4fdcf76bdf56d40e05d091cfcaa78a"
server_key_iv: "10d7cd33aa296b1ec5b4b4db2f85e3e8"
server_key_version: "encryptionkey@0"
I20260811 08:12:49.667547 31153 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786435717191469-28623-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786435717191469-28623-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786435717191469-28623-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:12:49.676007 31153 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:12:49.677675 31153 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:12:49.677802 31153 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:12:49.681761 31153 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33239
I20260811 08:12:49.681803 31256 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33239 every 8 connection(s)
I20260811 08:12:49.682118 31153 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
I20260811 08:12:49.682936 31257 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:12:49.685248 31257 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5ddc71e92ffe4276bebe410a3d232c33: Bootstrap starting.
I20260811 08:12:49.685843 31257 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5ddc71e92ffe4276bebe410a3d232c33: Neither blocks nor log segments found. Creating new log.
I20260811 08:12:49.686100 31257 log.cc:824] T 00000000000000000000000000000000 P 5ddc71e92ffe4276bebe410a3d232c33: Log is configured to *not* fsync() on all Append() calls
I20260811 08:12:49.686751 31257 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5ddc71e92ffe4276bebe410a3d232c33: No bootstrap required, opened a new log
I20260811 08:12:49.688329 31257 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5ddc71e92ffe4276bebe410a3d232c33 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ddc71e92ffe4276bebe410a3d232c33" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33239 } }
I20260811 08:12:49.688474 31257 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5ddc71e92ffe4276bebe410a3d232c33 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:12:49.688508 31257 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5ddc71e92ffe4276bebe410a3d232c33 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ddc71e92ffe4276bebe410a3d232c33, State: Initialized, Role: FOLLOWER
I20260811 08:12:49.688644 31257 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5ddc71e92ffe4276bebe410a3d232c33 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ddc71e92ffe4276bebe410a3d232c33" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33239 } }
I20260811 08:12:49.688706 31257 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5ddc71e92ffe4276bebe410a3d232c33 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:12:49.688740 31257 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5ddc71e92ffe4276bebe410a3d232c33 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:12:49.688784 31257 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5ddc71e92ffe4276bebe410a3d232c33 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:12:49.689299 31257 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5ddc71e92ffe4276bebe410a3d232c33 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ddc71e92ffe4276bebe410a3d232c33" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33239 } }
I20260811 08:12:49.689399 31257 leader_election.cc:302] T 00000000000000000000000000000000 P 5ddc71e92ffe4276bebe410a3d232c33 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5ddc71e92ffe4276bebe410a3d232c33; no voters:
I20260811 08:12:49.689574 31257 leader_election.cc:288] T 00000000000000000000000000000000 P 5ddc71e92ffe4276bebe410a3d232c33 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:12:49.689599 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 31153
I20260811 08:12:49.689623 31262 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5ddc71e92ffe4276bebe410a3d232c33 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:12:49.689738 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786435717191469-28623-0/minicluster-data/master-0/wal/instance
I20260811 08:12:49.689770 31262 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5ddc71e92ffe4276bebe410a3d232c33 [term 1 LEADER]: Becoming Leader. State: Replica: 5ddc71e92ffe4276bebe410a3d232c33, State: Running, Role: LEADER
I20260811 08:12:49.689833 31257 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5ddc71e92ffe4276bebe410a3d232c33 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:12:49.689851 31262 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5ddc71e92ffe4276bebe410a3d232c33 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ddc71e92ffe4276bebe410a3d232c33" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33239 } }
I20260811 08:12:49.689926 28623 external_mini_cluster.cc:1428] Setting key 4665f6dd41f57cfe242ffabbe5e08da0
I20260811 08:12:49.690176 31262 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5ddc71e92ffe4276bebe410a3d232c33 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5ddc71e92ffe4276bebe410a3d232c33. Latest consensus state: current_term: 1 leader_uuid: "5ddc71e92ffe4276bebe410a3d232c33" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ddc71e92ffe4276bebe410a3d232c33" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33239 } } }
I20260811 08:12:49.690308 31262 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5ddc71e92ffe4276bebe410a3d232c33 [sys.catalog]: This master's current role is: LEADER
I20260811 08:12:49.690568 31284 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:12:49.691032 31263 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5ddc71e92ffe4276bebe410a3d232c33 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5ddc71e92ffe4276bebe410a3d232c33" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ddc71e92ffe4276bebe410a3d232c33" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33239 } } }
I20260811 08:12:49.691128 31263 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5ddc71e92ffe4276bebe410a3d232c33 [sys.catalog]: This master's current role is: LEADER
I20260811 08:12:49.691387 31284 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:12:49.693943 31284 catalog_manager.cc:1347] Generated new cluster ID: 093b1bf046ba4cd89132002b708a9ad9
I20260811 08:12:49.693990 31284 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:12:49.696614 31287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:49.690582 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44361 (local address 127.0.0.1:33239)
0811 08:12:49.691676 (+ 1094us) server_negotiation.cc:206] Beginning negotiation
0811 08:12:49.691686 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 08:12:49.691719 (+ 33us) server_negotiation.cc:407] Connection header received
0811 08:12:49.692031 (+ 312us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:12:49.692039 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:12:49.692103 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:12:49.692246 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:12:49.692475 (+ 229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:49.693389 (+ 914us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:49.694539 (+ 1150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:49.695176 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:49.695276 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:49.695954 (+ 678us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:12:49.695959 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:12:49.695959 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:12:49.696162 (+ 203us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:12:49.696200 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:12:49.696214 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:12:49.696274 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0811 08:12:49.696355 (+ 81us) server_negotiation.cc:299] Negotiation successful
0811 08:12:49.696416 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1041,"thread_start_us":64,"threads_started":1}
I20260811 08:12:49.697808 28623 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 08:12:49.698457 31284 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:12:49.698968 31284 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:12:49.702664 31287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:49.699284 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39955 (local address 127.0.0.1:33239)
0811 08:12:49.699322 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0811 08:12:49.699324 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:12:49.699449 (+ 125us) server_negotiation.cc:407] Connection header received
0811 08:12:49.699505 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:12:49.699506 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:12:49.699516 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:12:49.699559 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:12:49.699683 (+ 124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:49.700408 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:49.701453 (+ 1045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:49.701715 (+ 262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:49.701780 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:49.702415 (+ 635us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:12:49.702417 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:12:49.702417 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:12:49.702423 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:12:49.702437 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:12:49.702441 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:12:49.702469 (+ 28us) server_negotiation.cc:1035] Waiting for connection context
0811 08:12:49.702568 (+ 99us) server_negotiation.cc:299] Negotiation successful
0811 08:12:49.702593 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 08:12:49.704316 31284 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5ddc71e92ffe4276bebe410a3d232c33: Generated new TSK 0
I20260811 08:12:49.704488 31284 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 08:12:49.707223 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 31153
2026-08-11T08:12:49Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1432 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786435717191469-28623-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:12:49 dist-test-slave-7lbf krb5kdc[31317](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:12:49 dist-test-slave-7lbf krb5kdc[31317](info): set up 2 sockets
Aug 11 08:12:49 dist-test-slave-7lbf krb5kdc[31317](info): commencing operation
krb5kdc: starting...
W20260811 08:12:50.888772 28623 mini_kdc.cc:121] Time spent starting KDC: real 1.155s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786435717191469-28623-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786435717191469-28623-0/krb5kdc/test-user.keytab.
Aug 11 08:12:50 dist-test-slave-7lbf krb5kdc[31317](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435970, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:12:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:12:50Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786435717191469-28623-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786435717191469-28623-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 08:12:51.005676 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786435717191469-28623-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786435717191469-28623-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786435717191469-28623-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45477
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786435717191469-28623-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40571
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45477
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:12:51.086815 31334 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:12:51.087016 31334 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:12:51.087037 31334 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:12:51.088155 31334 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:12:51.088196 31334 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:12:51.088209 31334 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:12:51.088231 31334 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:12:51.088248 31334 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:12:51.089784 31334 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40571
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786435717191469-28623-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786435717191469-28623-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45477
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786435717191469-28623-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45477
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31334
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786435717191469-28623-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:12:51.090029 31334 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:12:51.090237 31334 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:12:51.094954 31348 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:12:51.094954 31352 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:12:51.095018 31349 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:12:51.095233 31334 server_base.cc:1034] running on GCE node
I20260811 08:12:51.095469 31334 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:12:51.095734 31334 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:12:51.096899 31334 hybrid_clock.cc:648] HybridClock initialized: now 1786435971096870 us; error 47 us; skew 500 ppm
Aug 11 08:12:51 dist-test-slave-7lbf krb5kdc[31317](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435971, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:12:51.099640 31334 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 08:12:51.100095 31334 webserver.cc:460] Webserver started at http://127.0.0.1:41453/ using document root <none> and password file <none>
I20260811 08:12:51.100335 31334 fs_manager.cc:359] Metadata directory not provided
I20260811 08:12:51.100390 31334 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:12:51.100528 31334 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:12:51.101698 31334 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786435717191469-28623-0/minicluster-data/master-0/data/instance:
uuid: "bd182206a710439aa01f32f4abc7bdc3"
format_stamp: "Formatted at 2026-08-11 08:12:51 on dist-test-slave-7lbf"
server_key: "fc94e6c521fee606436d48d9f228eb34"
server_key_iv: "a154e76d7e08f4a9edde0e17ce6ddfbc"
server_key_version: "encryptionkey@0"
I20260811 08:12:51.102061 31334 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786435717191469-28623-0/minicluster-data/master-0/wal/instance:
uuid: "bd182206a710439aa01f32f4abc7bdc3"
format_stamp: "Formatted at 2026-08-11 08:12:51 on dist-test-slave-7lbf"
server_key: "fc94e6c521fee606436d48d9f228eb34"
server_key_iv: "a154e76d7e08f4a9edde0e17ce6ddfbc"
server_key_version: "encryptionkey@0"
I20260811 08:12:51.103390 31334 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 08:12:51.104094 31368 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:12:51.104243 31334 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 08:12:51.104339 31334 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786435717191469-28623-0/minicluster-data/master-0/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786435717191469-28623-0/minicluster-data/master-0/wal
uuid: "bd182206a710439aa01f32f4abc7bdc3"
format_stamp: "Formatted at 2026-08-11 08:12:51 on dist-test-slave-7lbf"
server_key: "fc94e6c521fee606436d48d9f228eb34"
server_key_iv: "a154e76d7e08f4a9edde0e17ce6ddfbc"
server_key_version: "encryptionkey@0"
I20260811 08:12:51.104404 31334 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786435717191469-28623-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786435717191469-28623-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786435717191469-28623-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:12:51.107832 31334 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:12:51.110061 31334 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:12:51.110199 31334 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:12:51.114324 31334 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45477
I20260811 08:12:51.114358 31461 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45477 every 8 connection(s)
I20260811 08:12:51.114671 31334 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
I20260811 08:12:51.115702 31464 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:12:51.118170 31464 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bd182206a710439aa01f32f4abc7bdc3: Bootstrap starting.
I20260811 08:12:51.118714 31464 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bd182206a710439aa01f32f4abc7bdc3: Neither blocks nor log segments found. Creating new log.
I20260811 08:12:51.118990 31464 log.cc:824] T 00000000000000000000000000000000 P bd182206a710439aa01f32f4abc7bdc3: Log is configured to *not* fsync() on all Append() calls
I20260811 08:12:51.119668 31464 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bd182206a710439aa01f32f4abc7bdc3: No bootstrap required, opened a new log
I20260811 08:12:51.120627 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 31334
I20260811 08:12:51.120738 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786435717191469-28623-0/minicluster-data/master-0/wal/instance
I20260811 08:12:51.120896 28623 external_mini_cluster.cc:1428] Setting key d6beccef0bd4cc2c694762f3d802c11e
I20260811 08:12:51.121503 31464 raft_consensus.cc:348] T 00000000000000000000000000000000 P bd182206a710439aa01f32f4abc7bdc3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd182206a710439aa01f32f4abc7bdc3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45477 } }
I20260811 08:12:51.121686 31464 raft_consensus.cc:374] T 00000000000000000000000000000000 P bd182206a710439aa01f32f4abc7bdc3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:12:51.121723 31464 raft_consensus.cc:729] T 00000000000000000000000000000000 P bd182206a710439aa01f32f4abc7bdc3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd182206a710439aa01f32f4abc7bdc3, State: Initialized, Role: FOLLOWER
I20260811 08:12:51.121865 31464 consensus_queue.cc:260] T 00000000000000000000000000000000 P bd182206a710439aa01f32f4abc7bdc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd182206a710439aa01f32f4abc7bdc3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45477 } }
I20260811 08:12:51.121946 31464 raft_consensus.cc:388] T 00000000000000000000000000000000 P bd182206a710439aa01f32f4abc7bdc3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:12:51.121984 31464 raft_consensus.cc:482] T 00000000000000000000000000000000 P bd182206a710439aa01f32f4abc7bdc3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:12:51.122082 31464 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bd182206a710439aa01f32f4abc7bdc3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:12:51.122983 31472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:51.121415 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47083 (local address 127.0.0.1:45477)
0811 08:12:51.121612 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0811 08:12:51.121620 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 08:12:51.121647 (+ 27us) server_negotiation.cc:407] Connection header received
0811 08:12:51.121749 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:12:51.121756 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:12:51.121846 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:12:51.121991 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:12:51.122565 (+ 574us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:12:51.122568 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:12:51.122568 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:12:51.122572 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:12:51.122603 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:12:51.122613 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:12:51.122670 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 08:12:51.122741 (+ 71us) server_negotiation.cc:299] Negotiation successful
0811 08:12:51.122789 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":143,"thread_start_us":99,"threads_started":1}
I20260811 08:12:51.123103 31464 raft_consensus.cc:504] T 00000000000000000000000000000000 P bd182206a710439aa01f32f4abc7bdc3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd182206a710439aa01f32f4abc7bdc3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45477 } }
I20260811 08:12:51.123216 31464 leader_election.cc:302] T 00000000000000000000000000000000 P bd182206a710439aa01f32f4abc7bdc3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bd182206a710439aa01f32f4abc7bdc3; no voters:
I20260811 08:12:51.123382 31464 leader_election.cc:288] T 00000000000000000000000000000000 P bd182206a710439aa01f32f4abc7bdc3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:12:51.123432 31478 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bd182206a710439aa01f32f4abc7bdc3 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:12:51.123579 31478 raft_consensus.cc:686] T 00000000000000000000000000000000 P bd182206a710439aa01f32f4abc7bdc3 [term 1 LEADER]: Becoming Leader. State: Replica: bd182206a710439aa01f32f4abc7bdc3, State: Running, Role: LEADER
I20260811 08:12:51.123617 31464 sys_catalog.cc:564] T 00000000000000000000000000000000 P bd182206a710439aa01f32f4abc7bdc3 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:12:51.123683 31478 consensus_queue.cc:237] T 00000000000000000000000000000000 P bd182206a710439aa01f32f4abc7bdc3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd182206a710439aa01f32f4abc7bdc3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45477 } }
I20260811 08:12:51.124043 28623 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 08:12:51.124119 31478 sys_catalog.cc:455] T 00000000000000000000000000000000 P bd182206a710439aa01f32f4abc7bdc3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bd182206a710439aa01f32f4abc7bdc3. Latest consensus state: current_term: 1 leader_uuid: "bd182206a710439aa01f32f4abc7bdc3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd182206a710439aa01f32f4abc7bdc3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45477 } } }
I20260811 08:12:51.124182 31478 sys_catalog.cc:458] T 00000000000000000000000000000000 P bd182206a710439aa01f32f4abc7bdc3 [sys.catalog]: This master's current role is: LEADER
I20260811 08:12:51.124328 31483 sys_catalog.cc:455] T 00000000000000000000000000000000 P bd182206a710439aa01f32f4abc7bdc3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bd182206a710439aa01f32f4abc7bdc3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd182206a710439aa01f32f4abc7bdc3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45477 } } }
I20260811 08:12:51.124387 31483 sys_catalog.cc:458] T 00000000000000000000000000000000 P bd182206a710439aa01f32f4abc7bdc3 [sys.catalog]: This master's current role is: LEADER
I20260811 08:12:51.124730 31495 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:12:51.125242 31495 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:12:51.126904 31472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:51.125604 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39513 (local address 127.0.0.1:45477)
0811 08:12:51.125642 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0811 08:12:51.125644 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:12:51.125876 (+ 232us) server_negotiation.cc:407] Connection header received
0811 08:12:51.125980 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:12:51.125981 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:12:51.125998 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:12:51.126029 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:12:51.126660 (+ 631us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:12:51.126661 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:12:51.126662 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:12:51.126667 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:12:51.126681 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:12:51.126686 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:12:51.126719 (+ 33us) server_negotiation.cc:1035] Waiting for connection context
0811 08:12:51.126828 (+ 109us) server_negotiation.cc:299] Negotiation successful
0811 08:12:51.126842 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260811 08:12:51.127139 31495 catalog_manager.cc:1347] Generated new cluster ID: f677da27242c40b686385059e1bcc5e0
I20260811 08:12:51.127193 31495 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:12:51.146929 31495 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:12:51.147126 31495 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:12:51.155951 31495 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bd182206a710439aa01f32f4abc7bdc3: Generated new TSK 0
I20260811 08:12:51.156157 31495 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 08:12:51.164395 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 31334
2026-08-11T08:12:51Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1461 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786435717191469-28623-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:12:51 dist-test-slave-7lbf krb5kdc[31520](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:12:51 dist-test-slave-7lbf krb5kdc[31520](info): set up 2 sockets
Aug 11 08:12:51 dist-test-slave-7lbf krb5kdc[31520](info): commencing operation
krb5kdc: starting...
W20260811 08:12:52.337297 28623 mini_kdc.cc:121] Time spent starting KDC: real 1.141s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786435717191469-28623-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786435717191469-28623-0/krb5kdc/test-user.keytab.
Aug 11 08:12:52 dist-test-slave-7lbf krb5kdc[31520](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435972, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:12:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:12:52Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786435717191469-28623-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786435717191469-28623-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 08:12:52.456040 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786435717191469-28623-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786435717191469-28623-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786435717191469-28623-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39229
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786435717191469-28623-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42519
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39229
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:12:52.538427 31545 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:12:52.538633 31545 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:12:52.538668 31545 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:12:52.539806 31545 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:12:52.539855 31545 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:12:52.539878 31545 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:12:52.539896 31545 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:12:52.539916 31545 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:12:52.541409 31545 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42519
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786435717191469-28623-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786435717191469-28623-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39229
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786435717191469-28623-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39229
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31545
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786435717191469-28623-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:12:52.541697 31545 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:12:52.541916 31545 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:12:52.546789 31554 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:12:52.546808 31557 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:12:52.546810 31553 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:12:52.547006 31545 server_base.cc:1034] running on GCE node
I20260811 08:12:52.547259 31545 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:12:52.547515 31545 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:12:52.548657 31545 hybrid_clock.cc:648] HybridClock initialized: now 1786435972548640 us; error 38 us; skew 500 ppm
Aug 11 08:12:52 dist-test-slave-7lbf krb5kdc[31520](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435972, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:12:52.551106 31545 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 08:12:52.551525 31545 webserver.cc:460] Webserver started at http://127.0.0.1:40921/ using document root <none> and password file <none>
I20260811 08:12:52.551726 31545 fs_manager.cc:359] Metadata directory not provided
I20260811 08:12:52.551765 31545 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:12:52.551859 31545 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:12:52.552839 31545 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786435717191469-28623-0/minicluster-data/master-0/data/instance:
uuid: "4ef4a48e9df64207a1633b3280063dcc"
format_stamp: "Formatted at 2026-08-11 08:12:52 on dist-test-slave-7lbf"
server_key: "4519432eed71085b7ce7e748510b6715"
server_key_iv: "3783d0000fe7557e5b1eed498cb3650d"
server_key_version: "encryptionkey@0"
I20260811 08:12:52.553138 31545 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786435717191469-28623-0/minicluster-data/master-0/wal/instance:
uuid: "4ef4a48e9df64207a1633b3280063dcc"
format_stamp: "Formatted at 2026-08-11 08:12:52 on dist-test-slave-7lbf"
server_key: "4519432eed71085b7ce7e748510b6715"
server_key_iv: "3783d0000fe7557e5b1eed498cb3650d"
server_key_version: "encryptionkey@0"
I20260811 08:12:52.554422 31545 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 08:12:52.555074 31570 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:12:52.555219 31545 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 08:12:52.555310 31545 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786435717191469-28623-0/minicluster-data/master-0/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786435717191469-28623-0/minicluster-data/master-0/wal
uuid: "4ef4a48e9df64207a1633b3280063dcc"
format_stamp: "Formatted at 2026-08-11 08:12:52 on dist-test-slave-7lbf"
server_key: "4519432eed71085b7ce7e748510b6715"
server_key_iv: "3783d0000fe7557e5b1eed498cb3650d"
server_key_version: "encryptionkey@0"
I20260811 08:12:52.555383 31545 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786435717191469-28623-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786435717191469-28623-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786435717191469-28623-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:12:52.568329 31545 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:12:52.570478 31545 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:12:52.570633 31545 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:12:52.574505 31545 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39229
I20260811 08:12:52.574544 31661 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39229 every 8 connection(s)
I20260811 08:12:52.574874 31545 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
I20260811 08:12:52.575764 31662 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:12:52.578106 31662 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4ef4a48e9df64207a1633b3280063dcc: Bootstrap starting.
I20260811 08:12:52.578663 31662 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4ef4a48e9df64207a1633b3280063dcc: Neither blocks nor log segments found. Creating new log.
I20260811 08:12:52.578923 31662 log.cc:824] T 00000000000000000000000000000000 P 4ef4a48e9df64207a1633b3280063dcc: Log is configured to *not* fsync() on all Append() calls
I20260811 08:12:52.579556 31662 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4ef4a48e9df64207a1633b3280063dcc: No bootstrap required, opened a new log
I20260811 08:12:52.580835 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 31545
I20260811 08:12:52.580948 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786435717191469-28623-0/minicluster-data/master-0/wal/instance
I20260811 08:12:52.581123 28623 external_mini_cluster.cc:1428] Setting key 6f336904c75b227156cdcd627b214d3f
I20260811 08:12:52.581202 31662 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4ef4a48e9df64207a1633b3280063dcc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ef4a48e9df64207a1633b3280063dcc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39229 } }
I20260811 08:12:52.581349 31662 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4ef4a48e9df64207a1633b3280063dcc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:12:52.581384 31662 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4ef4a48e9df64207a1633b3280063dcc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ef4a48e9df64207a1633b3280063dcc, State: Initialized, Role: FOLLOWER
I20260811 08:12:52.581576 31662 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4ef4a48e9df64207a1633b3280063dcc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ef4a48e9df64207a1633b3280063dcc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39229 } }
I20260811 08:12:52.581671 31662 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4ef4a48e9df64207a1633b3280063dcc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:12:52.581753 31662 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4ef4a48e9df64207a1633b3280063dcc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:12:52.581818 31662 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4ef4a48e9df64207a1633b3280063dcc [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:12:52.582772 31662 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4ef4a48e9df64207a1633b3280063dcc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ef4a48e9df64207a1633b3280063dcc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39229 } }
I20260811 08:12:52.582895 31662 leader_election.cc:302] T 00000000000000000000000000000000 P 4ef4a48e9df64207a1633b3280063dcc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4ef4a48e9df64207a1633b3280063dcc; no voters:
I20260811 08:12:52.583051 31662 leader_election.cc:288] T 00000000000000000000000000000000 P 4ef4a48e9df64207a1633b3280063dcc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:12:52.583128 31667 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4ef4a48e9df64207a1633b3280063dcc [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:12:52.583266 31667 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4ef4a48e9df64207a1633b3280063dcc [term 1 LEADER]: Becoming Leader. State: Replica: 4ef4a48e9df64207a1633b3280063dcc, State: Running, Role: LEADER
I20260811 08:12:52.583290 31662 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4ef4a48e9df64207a1633b3280063dcc [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:12:52.584128 31667 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4ef4a48e9df64207a1633b3280063dcc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ef4a48e9df64207a1633b3280063dcc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39229 } }
W20260811 08:12:52.585242 31701 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 4ef4a48e9df64207a1633b3280063dcc: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 08:12:52.585295 31701 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 08:12:52.585956 31670 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4ef4a48e9df64207a1633b3280063dcc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4ef4a48e9df64207a1633b3280063dcc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ef4a48e9df64207a1633b3280063dcc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39229 } } }
I20260811 08:12:52.585956 31668 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4ef4a48e9df64207a1633b3280063dcc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4ef4a48e9df64207a1633b3280063dcc. Latest consensus state: current_term: 1 leader_uuid: "4ef4a48e9df64207a1633b3280063dcc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ef4a48e9df64207a1633b3280063dcc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39229 } } }
I20260811 08:12:52.586056 31670 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4ef4a48e9df64207a1633b3280063dcc [sys.catalog]: This master's current role is: LEADER
I20260811 08:12:52.586086 31668 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4ef4a48e9df64207a1633b3280063dcc [sys.catalog]: This master's current role is: LEADER
I20260811 08:12:52.586257 31704 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:12:52.586431 31704 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:12:52.587709 31704 catalog_manager.cc:1347] Generated new cluster ID: cde93770dd2e483583d54f20fb95fa12
I20260811 08:12:52.587759 31704 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 08:12:52 dist-test-slave-7lbf krb5kdc[31520](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435972, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 08:12:52.591936 31666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:52.581595 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.224:45721 (local address 127.0.0.1:39229)
0811 08:12:52.581771 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0811 08:12:52.581779 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 08:12:52.581813 (+ 34us) server_negotiation.cc:407] Connection header received
0811 08:12:52.581940 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:12:52.581948 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:12:52.582006 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:12:52.582164 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:12:52.582786 (+ 622us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:52.583931 (+ 1145us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:52.584960 (+ 1029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:52.585497 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:52.585617 (+ 120us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:52.588364 (+ 2747us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:12:52.588367 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:12:52.588368 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:12:52.588378 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:12:52.590309 (+ 1931us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:12:52.590772 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:12:52.590775 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:12:52.590776 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:12:52.590894 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:12:52.591121 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:12:52.591121 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:12:52.591122 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:12:52.591388 (+ 266us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:12:52.591529 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0811 08:12:52.591654 (+ 125us) server_negotiation.cc:299] Negotiation successful
0811 08:12:52.591748 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132,"thread_start_us":80,"threads_started":1}
I20260811 08:12:52.592831 28623 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 08:12:52.596705 31704 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:12:52.597386 31704 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:12:52.600607 31666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:52.594300 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.224:38607 (local address 127.0.0.1:39229)
0811 08:12:52.594334 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0811 08:12:52.594336 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:12:52.594438 (+ 102us) server_negotiation.cc:407] Connection header received
0811 08:12:52.594481 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:12:52.594482 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:12:52.594502 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:12:52.594557 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:12:52.595112 (+ 555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:52.596006 (+ 894us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:52.596957 (+ 951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:52.597170 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:52.597223 (+ 53us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:52.598371 (+ 1148us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:12:52.598372 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:12:52.598373 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:12:52.598379 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:12:52.599566 (+ 1187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:12:52.599901 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:12:52.599902 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:12:52.599903 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:12:52.599956 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:12:52.600150 (+ 194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:12:52.600151 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:12:52.600151 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:12:52.600252 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:12:52.600363 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0811 08:12:52.600467 (+ 104us) server_negotiation.cc:299] Negotiation successful
0811 08:12:52.600525 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":143,"server-negotiator.queue_time_us":18}
I20260811 08:12:52.603632 31704 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4ef4a48e9df64207a1633b3280063dcc: Generated new TSK 0
I20260811 08:12:52.603804 31704 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 08:12:52.607126 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 31545
W20260811 08:12:52.624091 31518 connection.cc:535] client connection to 127.0.0.1:39229 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:39229): Connection reset by peer (error 104)
2026-08-11T08:12:52Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (1441 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786435717191469-28623-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:12:52 dist-test-slave-7lbf krb5kdc[31720](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:12:52 dist-test-slave-7lbf krb5kdc[31720](info): set up 2 sockets
Aug 11 08:12:52 dist-test-slave-7lbf krb5kdc[31720](info): commencing operation
krb5kdc: starting...
W20260811 08:12:53.800838 28623 mini_kdc.cc:121] Time spent starting KDC: real 1.163s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786435717191469-28623-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786435717191469-28623-0/krb5kdc/test-user.keytab.
Aug 11 08:12:53 dist-test-slave-7lbf krb5kdc[31720](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435973, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:12:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:12:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786435717191469-28623-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786435717191469-28623-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 08:12:53.924943 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786435717191469-28623-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786435717191469-28623-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786435717191469-28623-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45573
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786435717191469-28623-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35911
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45573
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:12:54.006841 31739 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:12:54.007050 31739 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:12:54.007071 31739 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:12:54.008215 31739 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:12:54.008258 31739 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:12:54.008271 31739 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:12:54.008282 31739 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:12:54.008301 31739 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:12:54.009876 31739 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35911
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786435717191469-28623-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786435717191469-28623-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45573
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786435717191469-28623-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45573
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31739
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786435717191469-28623-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:12:54.010119 31739 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:12:54.010339 31739 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:12:54.015223 31748 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:12:54.015244 31753 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:12:54.015226 31749 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:12:54.015563 31739 server_base.cc:1034] running on GCE node
I20260811 08:12:54.015822 31739 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:12:54.016135 31739 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:12:54.017318 31739 hybrid_clock.cc:648] HybridClock initialized: now 1786435974017273 us; error 52 us; skew 500 ppm
Aug 11 08:12:54 dist-test-slave-7lbf krb5kdc[31720](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435974, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:12:54.020241 31739 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 08:12:54.020802 31739 webserver.cc:460] Webserver started at http://127.0.0.1:41429/ using document root <none> and password file <none>
I20260811 08:12:54.021106 31739 fs_manager.cc:359] Metadata directory not provided
I20260811 08:12:54.021173 31739 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:12:54.021348 31739 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:12:54.022571 31739 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786435717191469-28623-0/minicluster-data/master-0/data/instance:
uuid: "b205246d40954784b294d1d966526f88"
format_stamp: "Formatted at 2026-08-11 08:12:54 on dist-test-slave-7lbf"
server_key: "730e8b634825176a46f1c28d4ddd810a"
server_key_iv: "7f655a315f207aa05dc7519c7ff1adb8"
server_key_version: "encryptionkey@0"
I20260811 08:12:54.022919 31739 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786435717191469-28623-0/minicluster-data/master-0/wal/instance:
uuid: "b205246d40954784b294d1d966526f88"
format_stamp: "Formatted at 2026-08-11 08:12:54 on dist-test-slave-7lbf"
server_key: "730e8b634825176a46f1c28d4ddd810a"
server_key_iv: "7f655a315f207aa05dc7519c7ff1adb8"
server_key_version: "encryptionkey@0"
I20260811 08:12:54.024354 31739 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 08:12:54.025067 31765 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:12:54.025221 31739 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 08:12:54.025311 31739 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786435717191469-28623-0/minicluster-data/master-0/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786435717191469-28623-0/minicluster-data/master-0/wal
uuid: "b205246d40954784b294d1d966526f88"
format_stamp: "Formatted at 2026-08-11 08:12:54 on dist-test-slave-7lbf"
server_key: "730e8b634825176a46f1c28d4ddd810a"
server_key_iv: "7f655a315f207aa05dc7519c7ff1adb8"
server_key_version: "encryptionkey@0"
I20260811 08:12:54.025381 31739 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786435717191469-28623-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786435717191469-28623-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786435717191469-28623-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:12:54.032958 31739 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:12:54.034739 31739 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:12:54.034875 31739 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:12:54.038661 31739 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45573
I20260811 08:12:54.038699 31849 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45573 every 8 connection(s)
I20260811 08:12:54.039031 31739 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
I20260811 08:12:54.039889 31850 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:12:54.040126 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 31739
I20260811 08:12:54.040246 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786435717191469-28623-0/minicluster-data/master-0/wal/instance
I20260811 08:12:54.040452 28623 external_mini_cluster.cc:1428] Setting key 5924a149620f3d406cdbe8a767f7ab20
I20260811 08:12:54.042982 31850 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b205246d40954784b294d1d966526f88: Bootstrap starting.
I20260811 08:12:54.043669 31850 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b205246d40954784b294d1d966526f88: Neither blocks nor log segments found. Creating new log.
I20260811 08:12:54.043946 31850 log.cc:824] T 00000000000000000000000000000000 P b205246d40954784b294d1d966526f88: Log is configured to *not* fsync() on all Append() calls
I20260811 08:12:54.044612 31850 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b205246d40954784b294d1d966526f88: No bootstrap required, opened a new log
I20260811 08:12:54.046607 31854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:54.040929 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.224:50851 (local address 127.0.0.1:45573)
0811 08:12:54.041129 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0811 08:12:54.041139 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 08:12:54.041175 (+ 36us) server_negotiation.cc:407] Connection header received
0811 08:12:54.041908 (+ 733us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:12:54.041918 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:12:54.041983 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:12:54.042145 (+ 162us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:12:54.042364 (+ 219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:54.043680 (+ 1316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:54.044465 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:54.045065 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:54.045177 (+ 112us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:54.045907 (+ 730us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:12:54.045912 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:12:54.045912 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:12:54.046120 (+ 208us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:12:54.046159 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:12:54.046174 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:12:54.046264 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0811 08:12:54.046351 (+ 87us) server_negotiation.cc:299] Negotiation successful
0811 08:12:54.046382 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":134,"thread_start_us":77,"threads_started":1}
I20260811 08:12:54.046936 31850 raft_consensus.cc:348] T 00000000000000000000000000000000 P b205246d40954784b294d1d966526f88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b205246d40954784b294d1d966526f88" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45573 } }
I20260811 08:12:54.047092 31850 raft_consensus.cc:374] T 00000000000000000000000000000000 P b205246d40954784b294d1d966526f88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:12:54.047127 31850 raft_consensus.cc:729] T 00000000000000000000000000000000 P b205246d40954784b294d1d966526f88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b205246d40954784b294d1d966526f88, State: Initialized, Role: FOLLOWER
I20260811 08:12:54.047230 31850 consensus_queue.cc:260] T 00000000000000000000000000000000 P b205246d40954784b294d1d966526f88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b205246d40954784b294d1d966526f88" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45573 } }
I20260811 08:12:54.047310 31850 raft_consensus.cc:388] T 00000000000000000000000000000000 P b205246d40954784b294d1d966526f88 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:12:54.047353 31850 raft_consensus.cc:482] T 00000000000000000000000000000000 P b205246d40954784b294d1d966526f88 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:12:54.047398 31850 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b205246d40954784b294d1d966526f88 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:12:54.047760 28623 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 08:12:54.048031 31850 raft_consensus.cc:504] T 00000000000000000000000000000000 P b205246d40954784b294d1d966526f88 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b205246d40954784b294d1d966526f88" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45573 } }
I20260811 08:12:54.048127 31850 leader_election.cc:302] T 00000000000000000000000000000000 P b205246d40954784b294d1d966526f88 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b205246d40954784b294d1d966526f88; no voters:
I20260811 08:12:54.048278 31850 leader_election.cc:288] T 00000000000000000000000000000000 P b205246d40954784b294d1d966526f88 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:12:54.048334 31856 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b205246d40954784b294d1d966526f88 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:12:54.048517 31850 sys_catalog.cc:564] T 00000000000000000000000000000000 P b205246d40954784b294d1d966526f88 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:12:54.048569 31856 raft_consensus.cc:686] T 00000000000000000000000000000000 P b205246d40954784b294d1d966526f88 [term 1 LEADER]: Becoming Leader. State: Replica: b205246d40954784b294d1d966526f88, State: Running, Role: LEADER
I20260811 08:12:54.048693 31856 consensus_queue.cc:237] T 00000000000000000000000000000000 P b205246d40954784b294d1d966526f88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b205246d40954784b294d1d966526f88" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45573 } }
I20260811 08:12:54.049115 31858 sys_catalog.cc:455] T 00000000000000000000000000000000 P b205246d40954784b294d1d966526f88 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b205246d40954784b294d1d966526f88" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b205246d40954784b294d1d966526f88" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45573 } } }
I20260811 08:12:54.049140 31860 sys_catalog.cc:455] T 00000000000000000000000000000000 P b205246d40954784b294d1d966526f88 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b205246d40954784b294d1d966526f88. Latest consensus state: current_term: 1 leader_uuid: "b205246d40954784b294d1d966526f88" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b205246d40954784b294d1d966526f88" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45573 } } }
I20260811 08:12:54.049238 31858 sys_catalog.cc:458] T 00000000000000000000000000000000 P b205246d40954784b294d1d966526f88 [sys.catalog]: This master's current role is: LEADER
I20260811 08:12:54.049252 31860 sys_catalog.cc:458] T 00000000000000000000000000000000 P b205246d40954784b294d1d966526f88 [sys.catalog]: This master's current role is: LEADER
I20260811 08:12:54.049737 31876 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:12:54.050310 31876 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:12:54.052186 31876 catalog_manager.cc:1347] Generated new cluster ID: 60201bdf624a4384bce60f3b9713fb13
I20260811 08:12:54.052240 31876 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:12:54.052927 31854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:54.049170 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.224:33843 (local address 127.0.0.1:45573)
0811 08:12:54.049203 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0811 08:12:54.049205 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:12:54.049688 (+ 483us) server_negotiation.cc:407] Connection header received
0811 08:12:54.049782 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:12:54.049783 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:12:54.049793 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:12:54.049819 (+ 26us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:12:54.050074 (+ 255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:54.050728 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:54.051711 (+ 983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:54.052016 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:54.052095 (+ 79us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:54.052697 (+ 602us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:12:54.052698 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:12:54.052698 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:12:54.052702 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:12:54.052716 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:12:54.052720 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:12:54.052769 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0811 08:12:54.052845 (+ 76us) server_negotiation.cc:299] Negotiation successful
0811 08:12:54.052858 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260811 08:12:54.065369 31876 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:12:54.066102 31876 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:12:54.070284 31876 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b205246d40954784b294d1d966526f88: Generated new TSK 0
I20260811 08:12:54.070451 31876 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 08:12:54.075963 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 31739
W20260811 08:12:54.097508 31716 connection.cc:535] client connection to 127.0.0.1:45573 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:45573): Connection reset by peer (error 104)
2026-08-11T08:12:54Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1473 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786435717191469-28623-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:12:54 dist-test-slave-7lbf krb5kdc[31903](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:12:54 dist-test-slave-7lbf krb5kdc[31903](info): set up 2 sockets
Aug 11 08:12:54 dist-test-slave-7lbf krb5kdc[31903](info): commencing operation
krb5kdc: starting...
W20260811 08:12:55.257550 28623 mini_kdc.cc:121] Time spent starting KDC: real 1.146s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786435717191469-28623-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786435717191469-28623-0/krb5kdc/test-user.keytab.
Aug 11 08:12:55 dist-test-slave-7lbf krb5kdc[31903](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435975, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:12:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:12:55Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786435717191469-28623-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786435717191469-28623-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 08:12:55.376135 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786435717191469-28623-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786435717191469-28623-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786435717191469-28623-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43227
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786435717191469-28623-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38547
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43227
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:12:55.461091 31928 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:12:55.461295 31928 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:12:55.461328 31928 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:12:55.462502 31928 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:12:55.462544 31928 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:12:55.462563 31928 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:12:55.462579 31928 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:12:55.462594 31928 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:12:55.464087 31928 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38547
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786435717191469-28623-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786435717191469-28623-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43227
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786435717191469-28623-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43227
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31928
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786435717191469-28623-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:12:55.464329 31928 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:12:55.464524 31928 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:12:55.468979 31934 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:12:55.469082 31939 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:12:55.469097 31935 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:12:55.469323 31928 server_base.cc:1034] running on GCE node
I20260811 08:12:55.469599 31928 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:12:55.469929 31928 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:12:55.471076 31928 hybrid_clock.cc:648] HybridClock initialized: now 1786435975471055 us; error 37 us; skew 500 ppm
Aug 11 08:12:55 dist-test-slave-7lbf krb5kdc[31903](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435975, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:12:55.476527 31928 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 08:12:55.477005 31928 webserver.cc:460] Webserver started at http://127.0.0.1:39719/ using document root <none> and password file <none>
I20260811 08:12:55.477222 31928 fs_manager.cc:359] Metadata directory not provided
I20260811 08:12:55.477270 31928 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:12:55.477401 31928 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:12:55.478470 31928 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786435717191469-28623-0/minicluster-data/master-0/data/instance:
uuid: "1431bf4778174387a91e60e5abf93bc2"
format_stamp: "Formatted at 2026-08-11 08:12:55 on dist-test-slave-7lbf"
server_key: "0b9f56ff40ad91bec6cba557e29d3600"
server_key_iv: "44fabb5bd57302790c6b7fb427594e46"
server_key_version: "encryptionkey@0"
I20260811 08:12:55.478806 31928 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786435717191469-28623-0/minicluster-data/master-0/wal/instance:
uuid: "1431bf4778174387a91e60e5abf93bc2"
format_stamp: "Formatted at 2026-08-11 08:12:55 on dist-test-slave-7lbf"
server_key: "0b9f56ff40ad91bec6cba557e29d3600"
server_key_iv: "44fabb5bd57302790c6b7fb427594e46"
server_key_version: "encryptionkey@0"
I20260811 08:12:55.480145 31928 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 08:12:55.480842 31958 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:12:55.481007 31928 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 08:12:55.481093 31928 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786435717191469-28623-0/minicluster-data/master-0/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786435717191469-28623-0/minicluster-data/master-0/wal
uuid: "1431bf4778174387a91e60e5abf93bc2"
format_stamp: "Formatted at 2026-08-11 08:12:55 on dist-test-slave-7lbf"
server_key: "0b9f56ff40ad91bec6cba557e29d3600"
server_key_iv: "44fabb5bd57302790c6b7fb427594e46"
server_key_version: "encryptionkey@0"
I20260811 08:12:55.481159 31928 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786435717191469-28623-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786435717191469-28623-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786435717191469-28623-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:12:55.484414 31928 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:12:55.486430 31928 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:12:55.486560 31928 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:12:55.490499 31928 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43227
I20260811 08:12:55.490545 32037 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43227 every 8 connection(s)
I20260811 08:12:55.490852 31928 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
I20260811 08:12:55.491770 32040 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:12:55.492452 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 31928
I20260811 08:12:55.492560 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786435717191469-28623-0/minicluster-data/master-0/wal/instance
I20260811 08:12:55.492733 28623 external_mini_cluster.cc:1428] Setting key 21b57cd56a87bb94ece18f7dc8b71c2a
I20260811 08:12:55.494787 32040 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1431bf4778174387a91e60e5abf93bc2: Bootstrap starting.
I20260811 08:12:55.495082 32046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:55.493198 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.224:50989 (local address 127.0.0.1:43227)
0811 08:12:55.493379 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0811 08:12:55.493389 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 08:12:55.493425 (+ 36us) server_negotiation.cc:407] Connection header received
0811 08:12:55.493973 (+ 548us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:12:55.493982 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:12:55.494019 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:12:55.494166 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:12:55.494682 (+ 516us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:12:55.494685 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:12:55.494686 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:12:55.494689 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:12:55.494729 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:12:55.494743 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:12:55.494819 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 08:12:55.494861 (+ 42us) server_negotiation.cc:299] Negotiation successful
0811 08:12:55.494903 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":127,"thread_start_us":76,"threads_started":1}
I20260811 08:12:55.495494 32040 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1431bf4778174387a91e60e5abf93bc2: Neither blocks nor log segments found. Creating new log.
I20260811 08:12:55.495797 32040 log.cc:824] T 00000000000000000000000000000000 P 1431bf4778174387a91e60e5abf93bc2: Log is configured to *not* fsync() on all Append() calls
I20260811 08:12:55.496121 28623 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 08:12:55.496477 32040 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1431bf4778174387a91e60e5abf93bc2: No bootstrap required, opened a new log
I20260811 08:12:55.498323 32046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:55.497453 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.224:40615 (local address 127.0.0.1:43227)
0811 08:12:55.497491 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0811 08:12:55.497492 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 08:12:55.497586 (+ 94us) server_negotiation.cc:407] Connection header received
0811 08:12:55.497649 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:12:55.497650 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:12:55.497653 (+ 3us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:12:55.497697 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:12:55.498140 (+ 443us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:12:55.498141 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:12:55.498142 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:12:55.498145 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:12:55.498156 (+ 11us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:12:55.498160 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:12:55.498193 (+ 33us) server_negotiation.cc:1035] Waiting for connection context
0811 08:12:55.498246 (+ 53us) server_negotiation.cc:299] Negotiation successful
0811 08:12:55.498255 (+ 9us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 08:12:55.498692 32040 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1431bf4778174387a91e60e5abf93bc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1431bf4778174387a91e60e5abf93bc2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43227 } }
I20260811 08:12:55.498824 32040 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1431bf4778174387a91e60e5abf93bc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:12:55.498876 32040 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1431bf4778174387a91e60e5abf93bc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1431bf4778174387a91e60e5abf93bc2, State: Initialized, Role: FOLLOWER
I20260811 08:12:55.498991 32040 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1431bf4778174387a91e60e5abf93bc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1431bf4778174387a91e60e5abf93bc2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43227 } }
I20260811 08:12:55.499063 32040 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1431bf4778174387a91e60e5abf93bc2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:12:55.499094 32040 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1431bf4778174387a91e60e5abf93bc2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:12:55.499140 32040 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1431bf4778174387a91e60e5abf93bc2 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:12:55.499641 32040 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1431bf4778174387a91e60e5abf93bc2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1431bf4778174387a91e60e5abf93bc2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43227 } }
I20260811 08:12:55.499737 32040 leader_election.cc:302] T 00000000000000000000000000000000 P 1431bf4778174387a91e60e5abf93bc2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1431bf4778174387a91e60e5abf93bc2; no voters:
I20260811 08:12:55.499891 32040 leader_election.cc:288] T 00000000000000000000000000000000 P 1431bf4778174387a91e60e5abf93bc2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:12:55.499964 32059 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1431bf4778174387a91e60e5abf93bc2 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:12:55.500111 32059 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1431bf4778174387a91e60e5abf93bc2 [term 1 LEADER]: Becoming Leader. State: Replica: 1431bf4778174387a91e60e5abf93bc2, State: Running, Role: LEADER
I20260811 08:12:55.500116 32040 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1431bf4778174387a91e60e5abf93bc2 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:12:55.500202 32059 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1431bf4778174387a91e60e5abf93bc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1431bf4778174387a91e60e5abf93bc2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43227 } }
I20260811 08:12:55.500545 32060 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1431bf4778174387a91e60e5abf93bc2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1431bf4778174387a91e60e5abf93bc2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1431bf4778174387a91e60e5abf93bc2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43227 } } }
I20260811 08:12:55.500548 32061 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1431bf4778174387a91e60e5abf93bc2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1431bf4778174387a91e60e5abf93bc2. Latest consensus state: current_term: 1 leader_uuid: "1431bf4778174387a91e60e5abf93bc2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1431bf4778174387a91e60e5abf93bc2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43227 } } }
I20260811 08:12:55.500715 32060 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1431bf4778174387a91e60e5abf93bc2 [sys.catalog]: This master's current role is: LEADER
I20260811 08:12:55.500720 32061 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1431bf4778174387a91e60e5abf93bc2 [sys.catalog]: This master's current role is: LEADER
I20260811 08:12:55.500923 32066 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:12:55.501392 32066 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:12:55.502965 32066 catalog_manager.cc:1347] Generated new cluster ID: 2b3532c264a247119eb1edc93ff5d030
I20260811 08:12:55.503010 32066 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:12:55.508234 32066 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:12:55.508375 32066 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:12:55.518384 32066 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1431bf4778174387a91e60e5abf93bc2: Generated new TSK 0
I20260811 08:12:55.518566 32066 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 08:12:55.520740 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 31928
2026-08-11T08:12:55Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1436 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786435717191469-28623-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:12:55 dist-test-slave-7lbf krb5kdc[32093](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:12:55 dist-test-slave-7lbf krb5kdc[32093](info): set up 2 sockets
Aug 11 08:12:55 dist-test-slave-7lbf krb5kdc[32093](info): commencing operation
krb5kdc: starting...
W20260811 08:12:56.692028 28623 mini_kdc.cc:121] Time spent starting KDC: real 1.145s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786435717191469-28623-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786435717191469-28623-0/krb5kdc/test-user.keytab.
Aug 11 08:12:56 dist-test-slave-7lbf krb5kdc[32093](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435976, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:12:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:12:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786435717191469-28623-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786435717191469-28623-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 08:12:56.815637 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786435717191469-28623-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786435717191469-28623-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786435717191469-28623-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39023
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786435717191469-28623-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44293
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39023
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:12:56.896106 32115 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:12:56.896303 32115 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:12:56.896324 32115 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:12:56.897449 32115 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:12:56.897490 32115 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:12:56.897503 32115 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:12:56.897531 32115 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:12:56.897542 32115 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:12:56.898978 32115 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44293
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786435717191469-28623-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786435717191469-28623-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39023
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786435717191469-28623-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39023
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32115
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786435717191469-28623-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:12:56.899194 32115 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:12:56.899397 32115 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:12:56.903877 32130 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:12:56.903901 32126 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:12:56.903996 32125 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:12:56.904201 32115 server_base.cc:1034] running on GCE node
I20260811 08:12:56.904440 32115 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:12:56.904714 32115 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:12:56.905862 32115 hybrid_clock.cc:648] HybridClock initialized: now 1786435976905847 us; error 32 us; skew 500 ppm
Aug 11 08:12:56 dist-test-slave-7lbf krb5kdc[32093](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435976, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:12:56.908267 32115 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 08:12:56.908665 32115 webserver.cc:460] Webserver started at http://127.0.0.1:33485/ using document root <none> and password file <none>
I20260811 08:12:56.908838 32115 fs_manager.cc:359] Metadata directory not provided
I20260811 08:12:56.908876 32115 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:12:56.908967 32115 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:12:56.909976 32115 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786435717191469-28623-0/minicluster-data/master-0/data/instance:
uuid: "65ea24875c20424db45dbf1211315603"
format_stamp: "Formatted at 2026-08-11 08:12:56 on dist-test-slave-7lbf"
server_key: "aaa078f918cf50fe000198e87b17a05a"
server_key_iv: "93be665609b6302c2edc85aa4ad46815"
server_key_version: "encryptionkey@0"
I20260811 08:12:56.910331 32115 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786435717191469-28623-0/minicluster-data/master-0/wal/instance:
uuid: "65ea24875c20424db45dbf1211315603"
format_stamp: "Formatted at 2026-08-11 08:12:56 on dist-test-slave-7lbf"
server_key: "aaa078f918cf50fe000198e87b17a05a"
server_key_iv: "93be665609b6302c2edc85aa4ad46815"
server_key_version: "encryptionkey@0"
I20260811 08:12:56.911540 32115 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 08:12:56.912170 32141 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:12:56.912326 32115 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 08:12:56.912408 32115 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786435717191469-28623-0/minicluster-data/master-0/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786435717191469-28623-0/minicluster-data/master-0/wal
uuid: "65ea24875c20424db45dbf1211315603"
format_stamp: "Formatted at 2026-08-11 08:12:56 on dist-test-slave-7lbf"
server_key: "aaa078f918cf50fe000198e87b17a05a"
server_key_iv: "93be665609b6302c2edc85aa4ad46815"
server_key_version: "encryptionkey@0"
I20260811 08:12:56.912464 32115 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786435717191469-28623-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786435717191469-28623-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786435717191469-28623-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:12:56.926190 32115 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:12:56.928172 32115 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:12:56.928282 32115 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:12:56.932070 32115 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39023
I20260811 08:12:56.932116 32239 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39023 every 8 connection(s)
I20260811 08:12:56.932417 32115 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
I20260811 08:12:56.933316 32240 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:12:56.935811 32240 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 65ea24875c20424db45dbf1211315603: Bootstrap starting.
I20260811 08:12:56.936409 32240 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 65ea24875c20424db45dbf1211315603: Neither blocks nor log segments found. Creating new log.
I20260811 08:12:56.936704 32240 log.cc:824] T 00000000000000000000000000000000 P 65ea24875c20424db45dbf1211315603: Log is configured to *not* fsync() on all Append() calls
I20260811 08:12:56.937492 32240 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 65ea24875c20424db45dbf1211315603: No bootstrap required, opened a new log
I20260811 08:12:56.939206 32240 raft_consensus.cc:348] T 00000000000000000000000000000000 P 65ea24875c20424db45dbf1211315603 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "65ea24875c20424db45dbf1211315603" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39023 } }
I20260811 08:12:56.939357 32240 raft_consensus.cc:374] T 00000000000000000000000000000000 P 65ea24875c20424db45dbf1211315603 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:12:56.939394 32240 raft_consensus.cc:729] T 00000000000000000000000000000000 P 65ea24875c20424db45dbf1211315603 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65ea24875c20424db45dbf1211315603, State: Initialized, Role: FOLLOWER
I20260811 08:12:56.939540 32240 consensus_queue.cc:260] T 00000000000000000000000000000000 P 65ea24875c20424db45dbf1211315603 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "65ea24875c20424db45dbf1211315603" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39023 } }
I20260811 08:12:56.939611 32240 raft_consensus.cc:388] T 00000000000000000000000000000000 P 65ea24875c20424db45dbf1211315603 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:12:56.939646 32240 raft_consensus.cc:482] T 00000000000000000000000000000000 P 65ea24875c20424db45dbf1211315603 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:12:56.939695 32240 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 65ea24875c20424db45dbf1211315603 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:12:56.940253 32240 raft_consensus.cc:504] T 00000000000000000000000000000000 P 65ea24875c20424db45dbf1211315603 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "65ea24875c20424db45dbf1211315603" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39023 } }
I20260811 08:12:56.940359 32240 leader_election.cc:302] T 00000000000000000000000000000000 P 65ea24875c20424db45dbf1211315603 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 65ea24875c20424db45dbf1211315603; no voters:
I20260811 08:12:56.940541 32240 leader_election.cc:288] T 00000000000000000000000000000000 P 65ea24875c20424db45dbf1211315603 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:12:56.940554 32249 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 65ea24875c20424db45dbf1211315603 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:12:56.940740 32249 raft_consensus.cc:686] T 00000000000000000000000000000000 P 65ea24875c20424db45dbf1211315603 [term 1 LEADER]: Becoming Leader. State: Replica: 65ea24875c20424db45dbf1211315603, State: Running, Role: LEADER
I20260811 08:12:56.940734 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 32115
I20260811 08:12:56.940862 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786435717191469-28623-0/minicluster-data/master-0/wal/instance
I20260811 08:12:56.940857 32240 sys_catalog.cc:564] T 00000000000000000000000000000000 P 65ea24875c20424db45dbf1211315603 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:12:56.940908 32249 consensus_queue.cc:237] T 00000000000000000000000000000000 P 65ea24875c20424db45dbf1211315603 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "65ea24875c20424db45dbf1211315603" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39023 } }
I20260811 08:12:56.941087 28623 external_mini_cluster.cc:1428] Setting key 808a52d332e57ad42a2bb2c2513d8a70
I20260811 08:12:56.941385 32252 sys_catalog.cc:455] T 00000000000000000000000000000000 P 65ea24875c20424db45dbf1211315603 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 65ea24875c20424db45dbf1211315603. Latest consensus state: current_term: 1 leader_uuid: "65ea24875c20424db45dbf1211315603" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "65ea24875c20424db45dbf1211315603" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39023 } } }
I20260811 08:12:56.941476 32252 sys_catalog.cc:458] T 00000000000000000000000000000000 P 65ea24875c20424db45dbf1211315603 [sys.catalog]: This master's current role is: LEADER
I20260811 08:12:56.941567 32250 sys_catalog.cc:455] T 00000000000000000000000000000000 P 65ea24875c20424db45dbf1211315603 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "65ea24875c20424db45dbf1211315603" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "65ea24875c20424db45dbf1211315603" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39023 } } }
I20260811 08:12:56.941743 32250 sys_catalog.cc:458] T 00000000000000000000000000000000 P 65ea24875c20424db45dbf1211315603 [sys.catalog]: This master's current role is: LEADER
I20260811 08:12:56.942015 32263 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:12:56.942520 32263 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:12:56.944131 32263 catalog_manager.cc:1347] Generated new cluster ID: 0c18cc03e3634a848d5f079549c88bc1
I20260811 08:12:56.944180 32263 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 08:12:56 dist-test-slave-7lbf krb5kdc[32093](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435976, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 08:12:56.953567 32264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:56.941775 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.224:46227 (local address 127.0.0.1:39023)
0811 08:12:56.942518 (+ 743us) server_negotiation.cc:206] Beginning negotiation
0811 08:12:56.942527 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 08:12:56.942566 (+ 39us) server_negotiation.cc:407] Connection header received
0811 08:12:56.942688 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:12:56.942695 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:12:56.942840 (+ 145us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:12:56.943029 (+ 189us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:12:56.943797 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:56.945178 (+ 1381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:56.946263 (+ 1085us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:56.946884 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:56.947012 (+ 128us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:56.949835 (+ 2823us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:12:56.949839 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:12:56.949840 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:12:56.949852 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:12:56.951759 (+ 1907us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:12:56.952243 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:12:56.952245 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:12:56.952246 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:12:56.952357 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:12:56.952604 (+ 247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:12:56.952604 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:12:56.952605 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:12:56.952897 (+ 292us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:12:56.953034 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0811 08:12:56.953211 (+ 177us) server_negotiation.cc:299] Negotiation successful
0811 08:12:56.953312 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":655,"thread_start_us":86,"threads_started":1}
I20260811 08:12:56.954754 28623 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 08:12:56.956192 32263 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:12:56.956840 32263 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:12:56.960556 32263 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 65ea24875c20424db45dbf1211315603: Generated new TSK 0
I20260811 08:12:56.960722 32263 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 08:12:56.963632 32264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:56.956234 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.224:45113 (local address 127.0.0.1:39023)
0811 08:12:56.956283 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 08:12:56.956285 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:12:56.956559 (+ 274us) server_negotiation.cc:407] Connection header received
0811 08:12:56.956616 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:12:56.956617 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:12:56.956628 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:12:56.956694 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:12:56.957360 (+ 666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:56.958205 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:56.959181 (+ 976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:56.959516 (+ 335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:56.959591 (+ 75us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:56.960857 (+ 1266us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:12:56.960858 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:12:56.960859 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:12:56.960867 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:12:56.962437 (+ 1570us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:12:56.962867 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:12:56.962868 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:12:56.962868 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:12:56.962935 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:12:56.963152 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:12:56.963152 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:12:56.963153 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:12:56.963276 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:12:56.963385 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0811 08:12:56.963476 (+ 91us) server_negotiation.cc:299] Negotiation successful
0811 08:12:56.963543 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 08:12:56.965766 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 32115
W20260811 08:12:56.990378 32089 connection.cc:535] client connection to 127.0.0.1:39023 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:39023): Connection reset by peer (error 104)
2026-08-11T08:12:56Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (1456 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786435717191469-28623-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:12:57 dist-test-slave-7lbf krb5kdc[32288](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:12:57 dist-test-slave-7lbf krb5kdc[32288](info): set up 2 sockets
Aug 11 08:12:57 dist-test-slave-7lbf krb5kdc[32288](info): commencing operation
krb5kdc: starting...
W20260811 08:12:58.145051 28623 mini_kdc.cc:121] Time spent starting KDC: real 1.141s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786435717191469-28623-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786435717191469-28623-0/krb5kdc/test-user.keytab.
Aug 11 08:12:58 dist-test-slave-7lbf krb5kdc[32288](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435978, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:12:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:12:58Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786435717191469-28623-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786435717191469-28623-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 08:12:58.264039 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786435717191469-28623-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786435717191469-28623-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786435717191469-28623-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37121
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786435717191469-28623-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40741
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37121
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:12:58.347179 32308 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:12:58.347390 32308 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:12:58.347412 32308 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:12:58.348546 32308 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:12:58.348587 32308 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:12:58.348600 32308 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:12:58.348611 32308 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:12:58.348627 32308 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:12:58.350123 32308 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40741
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786435717191469-28623-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786435717191469-28623-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37121
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786435717191469-28623-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37121
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32308
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786435717191469-28623-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:12:58.350353 32308 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:12:58.350574 32308 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:12:58.355152 32323 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:12:58.355175 32317 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:12:58.355180 32321 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:12:58.355372 32308 server_base.cc:1034] running on GCE node
I20260811 08:12:58.355579 32308 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:12:58.355875 32308 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:12:58.357041 32308 hybrid_clock.cc:648] HybridClock initialized: now 1786435978357031 us; error 33 us; skew 500 ppm
Aug 11 08:12:58 dist-test-slave-7lbf krb5kdc[32288](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435978, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:12:58.359493 32308 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 08:12:58.359933 32308 webserver.cc:460] Webserver started at http://127.0.0.1:41673/ using document root <none> and password file <none>
I20260811 08:12:58.360129 32308 fs_manager.cc:359] Metadata directory not provided
I20260811 08:12:58.360176 32308 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:12:58.360296 32308 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:12:58.361284 32308 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786435717191469-28623-0/minicluster-data/master-0/data/instance:
uuid: "3d12a09f301a421399336bb93a40ba84"
format_stamp: "Formatted at 2026-08-11 08:12:58 on dist-test-slave-7lbf"
server_key: "3a542c218f6faa6bf14dfee752e1a2f1"
server_key_iv: "f40aeffb83faa39e1c986ca7f20ec03a"
server_key_version: "encryptionkey@0"
I20260811 08:12:58.361640 32308 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786435717191469-28623-0/minicluster-data/master-0/wal/instance:
uuid: "3d12a09f301a421399336bb93a40ba84"
format_stamp: "Formatted at 2026-08-11 08:12:58 on dist-test-slave-7lbf"
server_key: "3a542c218f6faa6bf14dfee752e1a2f1"
server_key_iv: "f40aeffb83faa39e1c986ca7f20ec03a"
server_key_version: "encryptionkey@0"
I20260811 08:12:58.362897 32308 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 08:12:58.363659 32335 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:12:58.363857 32308 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 08:12:58.363955 32308 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786435717191469-28623-0/minicluster-data/master-0/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786435717191469-28623-0/minicluster-data/master-0/wal
uuid: "3d12a09f301a421399336bb93a40ba84"
format_stamp: "Formatted at 2026-08-11 08:12:58 on dist-test-slave-7lbf"
server_key: "3a542c218f6faa6bf14dfee752e1a2f1"
server_key_iv: "f40aeffb83faa39e1c986ca7f20ec03a"
server_key_version: "encryptionkey@0"
I20260811 08:12:58.364028 32308 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786435717191469-28623-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786435717191469-28623-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786435717191469-28623-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:12:58.385933 32308 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:12:58.387955 32308 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:12:58.388108 32308 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:12:58.392285 32308 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37121
I20260811 08:12:58.392324 32410 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37121 every 8 connection(s)
I20260811 08:12:58.392663 32308 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
I20260811 08:12:58.393620 32412 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:12:58.395910 32412 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3d12a09f301a421399336bb93a40ba84: Bootstrap starting.
I20260811 08:12:58.396478 32412 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3d12a09f301a421399336bb93a40ba84: Neither blocks nor log segments found. Creating new log.
I20260811 08:12:58.396731 32412 log.cc:824] T 00000000000000000000000000000000 P 3d12a09f301a421399336bb93a40ba84: Log is configured to *not* fsync() on all Append() calls
I20260811 08:12:58.397392 32412 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3d12a09f301a421399336bb93a40ba84: No bootstrap required, opened a new log
I20260811 08:12:58.399127 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 32308
I20260811 08:12:58.399040 32412 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3d12a09f301a421399336bb93a40ba84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d12a09f301a421399336bb93a40ba84" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37121 } }
I20260811 08:12:58.399209 32412 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3d12a09f301a421399336bb93a40ba84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:12:58.399257 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786435717191469-28623-0/minicluster-data/master-0/wal/instance
I20260811 08:12:58.399253 32412 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3d12a09f301a421399336bb93a40ba84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d12a09f301a421399336bb93a40ba84, State: Initialized, Role: FOLLOWER
I20260811 08:12:58.399395 32412 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3d12a09f301a421399336bb93a40ba84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d12a09f301a421399336bb93a40ba84" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37121 } }
I20260811 08:12:58.399457 28623 external_mini_cluster.cc:1428] Setting key 107e060ba5458041db67d4cd78cb88db
I20260811 08:12:58.399477 32412 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3d12a09f301a421399336bb93a40ba84 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:12:58.399514 32412 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3d12a09f301a421399336bb93a40ba84 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:12:58.399562 32412 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3d12a09f301a421399336bb93a40ba84 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:12:58.400481 32412 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3d12a09f301a421399336bb93a40ba84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d12a09f301a421399336bb93a40ba84" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37121 } }
I20260811 08:12:58.400599 32412 leader_election.cc:302] T 00000000000000000000000000000000 P 3d12a09f301a421399336bb93a40ba84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3d12a09f301a421399336bb93a40ba84; no voters:
I20260811 08:12:58.400767 32412 leader_election.cc:288] T 00000000000000000000000000000000 P 3d12a09f301a421399336bb93a40ba84 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:12:58.400806 32426 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3d12a09f301a421399336bb93a40ba84 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:12:58.400944 32426 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3d12a09f301a421399336bb93a40ba84 [term 1 LEADER]: Becoming Leader. State: Replica: 3d12a09f301a421399336bb93a40ba84, State: Running, Role: LEADER
I20260811 08:12:58.401037 32412 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3d12a09f301a421399336bb93a40ba84 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:12:58.401068 32426 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3d12a09f301a421399336bb93a40ba84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d12a09f301a421399336bb93a40ba84" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37121 } }
I20260811 08:12:58.401392 32426 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3d12a09f301a421399336bb93a40ba84 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3d12a09f301a421399336bb93a40ba84. Latest consensus state: current_term: 1 leader_uuid: "3d12a09f301a421399336bb93a40ba84" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d12a09f301a421399336bb93a40ba84" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37121 } } }
I20260811 08:12:58.401470 32426 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3d12a09f301a421399336bb93a40ba84 [sys.catalog]: This master's current role is: LEADER
I20260811 08:12:58.401643 32427 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3d12a09f301a421399336bb93a40ba84 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3d12a09f301a421399336bb93a40ba84" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d12a09f301a421399336bb93a40ba84" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37121 } } }
I20260811 08:12:58.401717 32427 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3d12a09f301a421399336bb93a40ba84 [sys.catalog]: This master's current role is: LEADER
I20260811 08:12:58.401846 32437 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:12:58.403084 32437 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:12:58.404779 32437 catalog_manager.cc:1347] Generated new cluster ID: a999539018f443d9b8cf45d959f18165
I20260811 08:12:58.404850 32437 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:12:58.405383 32423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:58.399955 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.224:37635 (local address 127.0.0.1:37121)
0811 08:12:58.400126 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0811 08:12:58.400134 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 08:12:58.400160 (+ 26us) server_negotiation.cc:407] Connection header received
0811 08:12:58.400253 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:12:58.400258 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:12:58.400304 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:12:58.400410 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:12:58.400672 (+ 262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:58.402195 (+ 1523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:58.403454 (+ 1259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:58.403954 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:58.404078 (+ 124us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:58.404732 (+ 654us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:12:58.404735 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:12:58.404735 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:12:58.404918 (+ 183us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:12:58.404957 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:12:58.404972 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:12:58.405046 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 08:12:58.405141 (+ 95us) server_negotiation.cc:299] Negotiation successful
0811 08:12:58.405170 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":122,"thread_start_us":83,"threads_started":1}
I20260811 08:12:58.406236 28623 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 08:12:58.412533 32423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:58.409860 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.224:54529 (local address 127.0.0.1:37121)
0811 08:12:58.409898 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0811 08:12:58.409900 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:12:58.410027 (+ 127us) server_negotiation.cc:407] Connection header received
0811 08:12:58.410088 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:12:58.410089 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:12:58.410101 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:12:58.410145 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:12:58.410261 (+ 116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:58.410765 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:58.411449 (+ 684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:12:58.411665 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:12:58.411719 (+ 54us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:12:58.412309 (+ 590us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:12:58.412311 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:12:58.412311 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:12:58.412315 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:12:58.412329 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:12:58.412333 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:12:58.412381 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0811 08:12:58.412449 (+ 68us) server_negotiation.cc:299] Negotiation successful
0811 08:12:58.412461 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 08:12:58.419981 32437 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:12:58.420490 32437 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:12:58.430454 32437 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3d12a09f301a421399336bb93a40ba84: Generated new TSK 0
I20260811 08:12:58.430647 32437 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 08:12:58.440918 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 32308
W20260811 08:12:58.451682 32286 connection.cc:535] client connection to 127.0.0.1:37121 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:37121): Connection reset by peer (error 104)
2026-08-11T08:12:58Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1461 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786435717191469-28623-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:12:58 dist-test-slave-7lbf krb5kdc[32475](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:12:58 dist-test-slave-7lbf krb5kdc[32475](info): set up 2 sockets
Aug 11 08:12:58 dist-test-slave-7lbf krb5kdc[32475](info): commencing operation
krb5kdc: starting...
W20260811 08:12:59.604987 28623 mini_kdc.cc:121] Time spent starting KDC: real 1.140s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786435717191469-28623-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786435717191469-28623-0/krb5kdc/test-user.keytab.
Aug 11 08:12:59 dist-test-slave-7lbf krb5kdc[32475](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435979, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:12:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:12:59Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786435717191469-28623-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786435717191469-28623-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 08:12:59.722699 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786435717191469-28623-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786435717191469-28623-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786435717191469-28623-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33881
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786435717191469-28623-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41579
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33881
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:12:59.803660 32499 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:12:59.803859 32499 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:12:59.803879 32499 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:12:59.804943 32499 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:12:59.804977 32499 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:12:59.804991 32499 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:12:59.805001 32499 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:12:59.805011 32499 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:12:59.806421 32499 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41579
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786435717191469-28623-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786435717191469-28623-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33881
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786435717191469-28623-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33881
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32499
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786435717191469-28623-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:12:59.806613 32499 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:12:59.806787 32499 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:12:59.811371 32505 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:12:59.811512 32499 server_base.cc:1034] running on GCE node
W20260811 08:12:59.811389 32507 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:12:59.811417 32510 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:12:59.811821 32499 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:12:59.812089 32499 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:12:59.813233 32499 hybrid_clock.cc:648] HybridClock initialized: now 1786435979813218 us; error 35 us; skew 500 ppm
Aug 11 08:12:59 dist-test-slave-7lbf krb5kdc[32475](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435979, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:12:59.815671 32499 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 08:12:59.816113 32499 webserver.cc:460] Webserver started at http://127.0.0.1:40047/ using document root <none> and password file <none>
I20260811 08:12:59.816330 32499 fs_manager.cc:359] Metadata directory not provided
I20260811 08:12:59.816378 32499 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:12:59.816498 32499 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:12:59.817538 32499 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786435717191469-28623-0/minicluster-data/master-0/data/instance:
uuid: "9d47d7e9435445eaa599c3c4b1221197"
format_stamp: "Formatted at 2026-08-11 08:12:59 on dist-test-slave-7lbf"
server_key: "82f4af84d28ff49dcc24f9a14cd441e2"
server_key_iv: "6832401a07395624ce33f5a6df91d69f"
server_key_version: "encryptionkey@0"
I20260811 08:12:59.817899 32499 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786435717191469-28623-0/minicluster-data/master-0/wal/instance:
uuid: "9d47d7e9435445eaa599c3c4b1221197"
format_stamp: "Formatted at 2026-08-11 08:12:59 on dist-test-slave-7lbf"
server_key: "82f4af84d28ff49dcc24f9a14cd441e2"
server_key_iv: "6832401a07395624ce33f5a6df91d69f"
server_key_version: "encryptionkey@0"
I20260811 08:12:59.819133 32499 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:12:59.819852 32523 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:12:59.820027 32499 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 08:12:59.820112 32499 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786435717191469-28623-0/minicluster-data/master-0/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786435717191469-28623-0/minicluster-data/master-0/wal
uuid: "9d47d7e9435445eaa599c3c4b1221197"
format_stamp: "Formatted at 2026-08-11 08:12:59 on dist-test-slave-7lbf"
server_key: "82f4af84d28ff49dcc24f9a14cd441e2"
server_key_iv: "6832401a07395624ce33f5a6df91d69f"
server_key_version: "encryptionkey@0"
I20260811 08:12:59.820176 32499 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786435717191469-28623-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786435717191469-28623-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786435717191469-28623-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:12:59.823366 32499 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:12:59.825094 32499 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:12:59.825218 32499 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:12:59.829156 32499 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33881
I20260811 08:12:59.829198 32624 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33881 every 8 connection(s)
I20260811 08:12:59.829499 32499 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
I20260811 08:12:59.830371 32626 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:12:59.832707 32626 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9d47d7e9435445eaa599c3c4b1221197: Bootstrap starting.
I20260811 08:12:59.833287 32626 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9d47d7e9435445eaa599c3c4b1221197: Neither blocks nor log segments found. Creating new log.
I20260811 08:12:59.833581 32626 log.cc:824] T 00000000000000000000000000000000 P 9d47d7e9435445eaa599c3c4b1221197: Log is configured to *not* fsync() on all Append() calls
I20260811 08:12:59.834224 32626 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9d47d7e9435445eaa599c3c4b1221197: No bootstrap required, opened a new log
I20260811 08:12:59.835803 32626 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9d47d7e9435445eaa599c3c4b1221197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d47d7e9435445eaa599c3c4b1221197" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33881 } }
I20260811 08:12:59.835942 32626 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9d47d7e9435445eaa599c3c4b1221197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:12:59.835975 32626 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9d47d7e9435445eaa599c3c4b1221197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d47d7e9435445eaa599c3c4b1221197, State: Initialized, Role: FOLLOWER
I20260811 08:12:59.836107 32626 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9d47d7e9435445eaa599c3c4b1221197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d47d7e9435445eaa599c3c4b1221197" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33881 } }
I20260811 08:12:59.836166 32626 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9d47d7e9435445eaa599c3c4b1221197 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:12:59.836197 32626 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9d47d7e9435445eaa599c3c4b1221197 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:12:59.836241 32626 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9d47d7e9435445eaa599c3c4b1221197 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:12:59.836843 32626 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9d47d7e9435445eaa599c3c4b1221197 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d47d7e9435445eaa599c3c4b1221197" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33881 } }
I20260811 08:12:59.836938 32626 leader_election.cc:302] T 00000000000000000000000000000000 P 9d47d7e9435445eaa599c3c4b1221197 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9d47d7e9435445eaa599c3c4b1221197; no voters:
I20260811 08:12:59.837100 32626 leader_election.cc:288] T 00000000000000000000000000000000 P 9d47d7e9435445eaa599c3c4b1221197 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:12:59.837189 32634 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9d47d7e9435445eaa599c3c4b1221197 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:12:59.837338 32626 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9d47d7e9435445eaa599c3c4b1221197 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:12:59.837342 32634 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9d47d7e9435445eaa599c3c4b1221197 [term 1 LEADER]: Becoming Leader. State: Replica: 9d47d7e9435445eaa599c3c4b1221197, State: Running, Role: LEADER
I20260811 08:12:59.837530 32634 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9d47d7e9435445eaa599c3c4b1221197 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d47d7e9435445eaa599c3c4b1221197" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33881 } }
I20260811 08:12:59.837855 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 32499
I20260811 08:12:59.837981 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786435717191469-28623-0/minicluster-data/master-0/wal/instance
I20260811 08:12:59.837970 32635 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9d47d7e9435445eaa599c3c4b1221197 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9d47d7e9435445eaa599c3c4b1221197" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d47d7e9435445eaa599c3c4b1221197" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33881 } } }
I20260811 08:12:59.838048 32635 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9d47d7e9435445eaa599c3c4b1221197 [sys.catalog]: This master's current role is: LEADER
I20260811 08:12:59.838165 28623 external_mini_cluster.cc:1428] Setting key a8de85aef8a5deb7e60ed38b66fe6bc8
I20260811 08:12:59.837975 32636 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9d47d7e9435445eaa599c3c4b1221197 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9d47d7e9435445eaa599c3c4b1221197. Latest consensus state: current_term: 1 leader_uuid: "9d47d7e9435445eaa599c3c4b1221197" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d47d7e9435445eaa599c3c4b1221197" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33881 } } }
I20260811 08:12:59.838227 32636 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9d47d7e9435445eaa599c3c4b1221197 [sys.catalog]: This master's current role is: LEADER
I20260811 08:12:59.838660 32642 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:12:59.839211 32642 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:12:59.840689 32642 catalog_manager.cc:1347] Generated new cluster ID: c1156b572b1644d6a61c1078c18b41af
I20260811 08:12:59.840742 32642 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:12:59.841053 32654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:59.838781 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.224:37313 (local address 127.0.0.1:33881)
0811 08:12:59.839198 (+ 417us) server_negotiation.cc:206] Beginning negotiation
0811 08:12:59.839209 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 08:12:59.839240 (+ 31us) server_negotiation.cc:407] Connection header received
0811 08:12:59.839358 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:12:59.839365 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:12:59.839396 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:12:59.839524 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:12:59.840540 (+ 1016us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:12:59.840543 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:12:59.840544 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:12:59.840548 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:12:59.840610 (+ 62us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:12:59.840626 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:12:59.840702 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 08:12:59.840837 (+ 135us) server_negotiation.cc:299] Negotiation successful
0811 08:12:59.840884 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":363,"thread_start_us":78,"threads_started":1}
I20260811 08:12:59.841958 28623 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 08:12:59.846936 32654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:12:59.845898 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.224:50233 (local address 127.0.0.1:33881)
0811 08:12:59.845941 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 08:12:59.845943 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:12:59.846094 (+ 151us) server_negotiation.cc:407] Connection header received
0811 08:12:59.846154 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:12:59.846155 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:12:59.846161 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:12:59.846210 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:12:59.846744 (+ 534us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:12:59.846745 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:12:59.846746 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:12:59.846749 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:12:59.846764 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:12:59.846768 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:12:59.846810 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0811 08:12:59.846860 (+ 50us) server_negotiation.cc:299] Negotiation successful
0811 08:12:59.846872 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260811 08:12:59.855803 32642 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:12:59.855997 32642 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:12:59.858741 32642 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9d47d7e9435445eaa599c3c4b1221197: Generated new TSK 0
I20260811 08:12:59.858938 32642 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 08:12:59.867380 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 32499
2026-08-11T08:12:59Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1439 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786435717191469-28623-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:12:59 dist-test-slave-7lbf krb5kdc[32679](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:12:59 dist-test-slave-7lbf krb5kdc[32679](info): set up 2 sockets
Aug 11 08:12:59 dist-test-slave-7lbf krb5kdc[32679](info): commencing operation
krb5kdc: starting...
W20260811 08:13:01.053099 28623 mini_kdc.cc:121] Time spent starting KDC: real 1.148s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786435717191469-28623-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786435717191469-28623-0/krb5kdc/test-user.keytab.
Aug 11 08:13:01 dist-test-slave-7lbf krb5kdc[32679](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435981, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:13:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:13:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.27.243.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.243.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.243.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab.
Entry for principal kudu/127.27.243.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab.
I20260811 08:13:01.175889 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786435717191469-28623-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786435717191469-28623-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786435717191469-28623-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.243.254:45407
--webserver_interface=127.27.243.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab
--principal=kudu/127.27.243.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:38221
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.243.254:45407
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:13:01.257953 32703 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:13:01.258167 32703 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:13:01.258198 32703 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:13:01.259341 32703 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:13:01.259385 32703 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:13:01.259403 32703 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:13:01.259419 32703 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:13:01.259433 32703 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:13:01.260910 32703 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:38221
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786435717191469-28623-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786435717191469-28623-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.243.254:45407
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab
--principal=kudu/127.27.243.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.243.254:45407
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.243.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32703
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786435717191469-28623-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:13:01.261169 32703 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:13:01.261394 32703 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:13:01.266199 32718 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:13:01.266273 32720 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:13:01.266323 32703 server_base.cc:1034] running on GCE node
W20260811 08:13:01.266424 32716 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:13:01.266644 32703 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:13:01.266907 32703 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:13:01.268049 32703 hybrid_clock.cc:648] HybridClock initialized: now 1786435981268030 us; error 37 us; skew 500 ppm
Aug 11 08:13:01 dist-test-slave-7lbf krb5kdc[32679](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435981, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:13:01.273615 32703 init.cc:377] Logged in from keytab as kudu/127.27.243.254@KRBTEST.COM (short username kudu)
I20260811 08:13:01.274087 32703 webserver.cc:460] Webserver started at http://127.27.243.254:37105/ using document root <none> and password file <none>
I20260811 08:13:01.274317 32703 fs_manager.cc:359] Metadata directory not provided
I20260811 08:13:01.274369 32703 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:13:01.274499 32703 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:13:01.275595 32703 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786435717191469-28623-0/minicluster-data/master-0/data/instance:
uuid: "c836046c77434cc6976d6d7d3aab4c2e"
format_stamp: "Formatted at 2026-08-11 08:13:01 on dist-test-slave-7lbf"
server_key: "7db5a5cc8ad000f1352f414940a69009"
server_key_iv: "b3465c9aaf560346ba28c20cc54b3ac4"
server_key_version: "encryptionkey@0"
I20260811 08:13:01.275939 32703 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786435717191469-28623-0/minicluster-data/master-0/wal/instance:
uuid: "c836046c77434cc6976d6d7d3aab4c2e"
format_stamp: "Formatted at 2026-08-11 08:13:01 on dist-test-slave-7lbf"
server_key: "7db5a5cc8ad000f1352f414940a69009"
server_key_iv: "b3465c9aaf560346ba28c20cc54b3ac4"
server_key_version: "encryptionkey@0"
I20260811 08:13:01.277205 32703 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 08:13:01.278100 32737 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:01.278285 32703 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 08:13:01.278389 32703 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786435717191469-28623-0/minicluster-data/master-0/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786435717191469-28623-0/minicluster-data/master-0/wal
uuid: "c836046c77434cc6976d6d7d3aab4c2e"
format_stamp: "Formatted at 2026-08-11 08:13:01 on dist-test-slave-7lbf"
server_key: "7db5a5cc8ad000f1352f414940a69009"
server_key_iv: "b3465c9aaf560346ba28c20cc54b3ac4"
server_key_version: "encryptionkey@0"
I20260811 08:13:01.278460 32703 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786435717191469-28623-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786435717191469-28623-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786435717191469-28623-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:13:01.290702 32703 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:13:01.292764 32703 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:13:01.292873 32703 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:13:01.296854 32703 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.254:45407
I20260811 08:13:01.296890 356 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.254:45407 every 8 connection(s)
I20260811 08:13:01.297216 32703 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
I20260811 08:13:01.298120 358 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:13:01.300457 358 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c836046c77434cc6976d6d7d3aab4c2e: Bootstrap starting.
I20260811 08:13:01.301081 358 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c836046c77434cc6976d6d7d3aab4c2e: Neither blocks nor log segments found. Creating new log.
I20260811 08:13:01.301136 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 32703
I20260811 08:13:01.301270 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786435717191469-28623-0/minicluster-data/master-0/wal/instance
I20260811 08:13:01.301421 358 log.cc:824] T 00000000000000000000000000000000 P c836046c77434cc6976d6d7d3aab4c2e: Log is configured to *not* fsync() on all Append() calls
I20260811 08:13:01.301462 28623 external_mini_cluster.cc:1428] Setting key 579f8fe6a0fa2adb1f056b636a8cba23
I20260811 08:13:01.302341 358 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c836046c77434cc6976d6d7d3aab4c2e: No bootstrap required, opened a new log
I20260811 08:13:01.304699 358 raft_consensus.cc:348] T 00000000000000000000000000000000 P c836046c77434cc6976d6d7d3aab4c2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c836046c77434cc6976d6d7d3aab4c2e" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 45407 } }
I20260811 08:13:01.304886 358 raft_consensus.cc:374] T 00000000000000000000000000000000 P c836046c77434cc6976d6d7d3aab4c2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:13:01.304924 358 raft_consensus.cc:729] T 00000000000000000000000000000000 P c836046c77434cc6976d6d7d3aab4c2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c836046c77434cc6976d6d7d3aab4c2e, State: Initialized, Role: FOLLOWER
I20260811 08:13:01.305060 358 consensus_queue.cc:260] T 00000000000000000000000000000000 P c836046c77434cc6976d6d7d3aab4c2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c836046c77434cc6976d6d7d3aab4c2e" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 45407 } }
I20260811 08:13:01.305138 358 raft_consensus.cc:388] T 00000000000000000000000000000000 P c836046c77434cc6976d6d7d3aab4c2e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:13:01.305172 358 raft_consensus.cc:482] T 00000000000000000000000000000000 P c836046c77434cc6976d6d7d3aab4c2e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:13:01.305217 358 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c836046c77434cc6976d6d7d3aab4c2e [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:13:01.305882 358 raft_consensus.cc:504] T 00000000000000000000000000000000 P c836046c77434cc6976d6d7d3aab4c2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c836046c77434cc6976d6d7d3aab4c2e" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 45407 } }
I20260811 08:13:01.305974 358 leader_election.cc:302] T 00000000000000000000000000000000 P c836046c77434cc6976d6d7d3aab4c2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c836046c77434cc6976d6d7d3aab4c2e; no voters:
I20260811 08:13:01.306104 358 leader_election.cc:288] T 00000000000000000000000000000000 P c836046c77434cc6976d6d7d3aab4c2e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:13:01.306151 364 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c836046c77434cc6976d6d7d3aab4c2e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:13:01.306274 364 raft_consensus.cc:686] T 00000000000000000000000000000000 P c836046c77434cc6976d6d7d3aab4c2e [term 1 LEADER]: Becoming Leader. State: Replica: c836046c77434cc6976d6d7d3aab4c2e, State: Running, Role: LEADER
I20260811 08:13:01.306362 358 sys_catalog.cc:564] T 00000000000000000000000000000000 P c836046c77434cc6976d6d7d3aab4c2e [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:13:01.306365 364 consensus_queue.cc:237] T 00000000000000000000000000000000 P c836046c77434cc6976d6d7d3aab4c2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c836046c77434cc6976d6d7d3aab4c2e" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 45407 } }
I20260811 08:13:01.306751 366 sys_catalog.cc:455] T 00000000000000000000000000000000 P c836046c77434cc6976d6d7d3aab4c2e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c836046c77434cc6976d6d7d3aab4c2e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c836046c77434cc6976d6d7d3aab4c2e" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 45407 } } }
I20260811 08:13:01.306838 366 sys_catalog.cc:458] T 00000000000000000000000000000000 P c836046c77434cc6976d6d7d3aab4c2e [sys.catalog]: This master's current role is: LEADER
I20260811 08:13:01.306775 367 sys_catalog.cc:455] T 00000000000000000000000000000000 P c836046c77434cc6976d6d7d3aab4c2e [sys.catalog]: SysCatalogTable state changed. Reason: New leader c836046c77434cc6976d6d7d3aab4c2e. Latest consensus state: current_term: 1 leader_uuid: "c836046c77434cc6976d6d7d3aab4c2e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c836046c77434cc6976d6d7d3aab4c2e" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 45407 } } }
I20260811 08:13:01.306905 367 sys_catalog.cc:458] T 00000000000000000000000000000000 P c836046c77434cc6976d6d7d3aab4c2e [sys.catalog]: This master's current role is: LEADER
I20260811 08:13:01.307065 372 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:13:01.307578 372 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 11 08:13:01 dist-test-slave-7lbf krb5kdc[32679](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435981, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.243.254@KRBTEST.COM
I20260811 08:13:01.309193 372 catalog_manager.cc:1347] Generated new cluster ID: fb2383ff1f9c4253bdec8aad946f81aa
I20260811 08:13:01.309240 372 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:13:01.312804 363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:01.302058 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44825 (local address 127.27.243.254:45407)
0811 08:13:01.302219 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:01.302228 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:01.302258 (+ 30us) server_negotiation.cc:407] Connection header received
0811 08:13:01.302707 (+ 449us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:01.302715 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:01.302775 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:01.302934 (+ 159us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:01.303692 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:01.304611 (+ 919us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:01.305663 (+ 1052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:01.306130 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:01.306558 (+ 428us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:01.309259 (+ 2701us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:01.309263 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:01.309263 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:01.309275 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:01.311135 (+ 1860us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:01.311581 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:01.311584 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:01.311584 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:01.311682 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:01.311918 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:01.311918 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:01.311918 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:01.312194 (+ 276us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:01.312354 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:01.312480 (+ 126us) server_negotiation.cc:299] Negotiation successful
0811 08:13:01.312575 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":110,"thread_start_us":71,"threads_started":1}
I20260811 08:13:01.313969 28623 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 08:13:01.322328 363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:01.315325 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51091 (local address 127.27.243.254:45407)
0811 08:13:01.315385 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:01.315387 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:01.315590 (+ 203us) server_negotiation.cc:407] Connection header received
0811 08:13:01.315642 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:01.315643 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:01.315653 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:01.315714 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:01.316276 (+ 562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:01.317066 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:01.318045 (+ 979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:01.318364 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:01.318434 (+ 70us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:01.319652 (+ 1218us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:01.319653 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:01.319654 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:01.319661 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:01.321172 (+ 1511us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:01.321590 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:01.321591 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:01.321591 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:01.321650 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:01.321851 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:01.321852 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:01.321852 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:01.321977 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:01.322075 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:01.322174 (+ 99us) server_negotiation.cc:299] Negotiation successful
0811 08:13:01.322236 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260811 08:13:01.326622 372 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:13:01.327129 372 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:13:01.331456 372 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c836046c77434cc6976d6d7d3aab4c2e: Generated new TSK 0
I20260811 08:13:01.331666 372 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 08:13:01.333731 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 32703
W20260811 08:13:01.352121 32677 connection.cc:535] client connection to 127.27.243.254:45407 recv error: Network error: failed to read from TLS socket (remote: 127.27.243.254:45407): Connection reset by peer (error 104)
2026-08-11T08:13:01Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (1460 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786435717191469-28623-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:13:01 dist-test-slave-7lbf krb5kdc[413](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:13:01 dist-test-slave-7lbf krb5kdc[413](info): set up 2 sockets
Aug 11 08:13:01 dist-test-slave-7lbf krb5kdc[413](info): commencing operation
krb5kdc: starting...
W20260811 08:13:02.500644 28623 mini_kdc.cc:121] Time spent starting KDC: real 1.135s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786435717191469-28623-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786435717191469-28623-0/krb5kdc/test-user.keytab.
Aug 11 08:13:02 dist-test-slave-7lbf krb5kdc[413](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435982, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:13:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:13:02Z Disabled control of system clock
WARNING: no policy specified for kudu/127.27.243.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.243.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.243.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab.
Entry for principal kudu/127.27.243.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab.
I20260811 08:13:02.618553 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786435717191469-28623-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786435717191469-28623-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786435717191469-28623-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.243.254:34665
--webserver_interface=127.27.243.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab
--principal=kudu/127.27.243.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:34143
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.243.254:34665
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:13:02.699481 435 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:13:02.699681 435 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:13:02.699712 435 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:13:02.700825 435 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:13:02.700866 435 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:13:02.700886 435 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:13:02.700901 435 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:13:02.700917 435 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:13:02.702397 435 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:34143
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786435717191469-28623-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786435717191469-28623-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.243.254:34665
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab
--principal=kudu/127.27.243.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.243.254:34665
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.243.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.435
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786435717191469-28623-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:13:02.702636 435 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:13:02.702839 435 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:13:02.707516 447 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:13:02.707506 444 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:13:02.707506 452 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:13:02.707624 435 server_base.cc:1034] running on GCE node
I20260811 08:13:02.708001 435 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:13:02.708273 435 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:13:02.709434 435 hybrid_clock.cc:648] HybridClock initialized: now 1786435982709418 us; error 30 us; skew 500 ppm
Aug 11 08:13:02 dist-test-slave-7lbf krb5kdc[413](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435982, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:13:02.711987 435 init.cc:377] Logged in from keytab as kudu/127.27.243.254@KRBTEST.COM (short username kudu)
I20260811 08:13:02.712426 435 webserver.cc:460] Webserver started at http://127.27.243.254:34391/ using document root <none> and password file <none>
I20260811 08:13:02.712639 435 fs_manager.cc:359] Metadata directory not provided
I20260811 08:13:02.712687 435 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:13:02.712813 435 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:13:02.713945 435 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786435717191469-28623-0/minicluster-data/master-0/data/instance:
uuid: "99a891ff4b034c81af29095ef7494235"
format_stamp: "Formatted at 2026-08-11 08:13:02 on dist-test-slave-7lbf"
server_key: "ab639b3001be35a61c153228f29c2129"
server_key_iv: "d1652d99b7ec18b6c4bb1c2e07187e8b"
server_key_version: "encryptionkey@0"
I20260811 08:13:02.714272 435 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786435717191469-28623-0/minicluster-data/master-0/wal/instance:
uuid: "99a891ff4b034c81af29095ef7494235"
format_stamp: "Formatted at 2026-08-11 08:13:02 on dist-test-slave-7lbf"
server_key: "ab639b3001be35a61c153228f29c2129"
server_key_iv: "d1652d99b7ec18b6c4bb1c2e07187e8b"
server_key_version: "encryptionkey@0"
I20260811 08:13:02.715515 435 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 08:13:02.716202 465 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:02.716356 435 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 08:13:02.716454 435 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786435717191469-28623-0/minicluster-data/master-0/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786435717191469-28623-0/minicluster-data/master-0/wal
uuid: "99a891ff4b034c81af29095ef7494235"
format_stamp: "Formatted at 2026-08-11 08:13:02 on dist-test-slave-7lbf"
server_key: "ab639b3001be35a61c153228f29c2129"
server_key_iv: "d1652d99b7ec18b6c4bb1c2e07187e8b"
server_key_version: "encryptionkey@0"
I20260811 08:13:02.716516 435 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786435717191469-28623-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786435717191469-28623-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786435717191469-28623-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:13:02.741541 435 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:13:02.743654 435 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:13:02.743791 435 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:13:02.748134 435 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.254:34665
I20260811 08:13:02.748190 554 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.254:34665 every 8 connection(s)
I20260811 08:13:02.748521 435 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
I20260811 08:13:02.749439 555 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:13:02.751777 555 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 99a891ff4b034c81af29095ef7494235: Bootstrap starting.
I20260811 08:13:02.752369 555 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 99a891ff4b034c81af29095ef7494235: Neither blocks nor log segments found. Creating new log.
I20260811 08:13:02.752636 555 log.cc:824] T 00000000000000000000000000000000 P 99a891ff4b034c81af29095ef7494235: Log is configured to *not* fsync() on all Append() calls
I20260811 08:13:02.753314 555 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 99a891ff4b034c81af29095ef7494235: No bootstrap required, opened a new log
I20260811 08:13:02.753655 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 435
I20260811 08:13:02.753753 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786435717191469-28623-0/minicluster-data/master-0/wal/instance
I20260811 08:13:02.753922 28623 external_mini_cluster.cc:1428] Setting key 8149b11a2b941f8c363f1802d8b60b03
I20260811 08:13:02.755555 555 raft_consensus.cc:348] T 00000000000000000000000000000000 P 99a891ff4b034c81af29095ef7494235 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "99a891ff4b034c81af29095ef7494235" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 34665 } }
I20260811 08:13:02.755710 555 raft_consensus.cc:374] T 00000000000000000000000000000000 P 99a891ff4b034c81af29095ef7494235 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:13:02.755744 555 raft_consensus.cc:729] T 00000000000000000000000000000000 P 99a891ff4b034c81af29095ef7494235 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99a891ff4b034c81af29095ef7494235, State: Initialized, Role: FOLLOWER
I20260811 08:13:02.755905 555 consensus_queue.cc:260] T 00000000000000000000000000000000 P 99a891ff4b034c81af29095ef7494235 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "99a891ff4b034c81af29095ef7494235" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 34665 } }
I20260811 08:13:02.755975 555 raft_consensus.cc:388] T 00000000000000000000000000000000 P 99a891ff4b034c81af29095ef7494235 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:13:02.756004 555 raft_consensus.cc:482] T 00000000000000000000000000000000 P 99a891ff4b034c81af29095ef7494235 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:13:02.756050 555 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 99a891ff4b034c81af29095ef7494235 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:13:02.756593 555 raft_consensus.cc:504] T 00000000000000000000000000000000 P 99a891ff4b034c81af29095ef7494235 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "99a891ff4b034c81af29095ef7494235" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 34665 } }
I20260811 08:13:02.756690 555 leader_election.cc:302] T 00000000000000000000000000000000 P 99a891ff4b034c81af29095ef7494235 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 99a891ff4b034c81af29095ef7494235; no voters:
I20260811 08:13:02.756856 555 leader_election.cc:288] T 00000000000000000000000000000000 P 99a891ff4b034c81af29095ef7494235 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:13:02.756896 562 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 99a891ff4b034c81af29095ef7494235 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:13:02.757045 562 raft_consensus.cc:686] T 00000000000000000000000000000000 P 99a891ff4b034c81af29095ef7494235 [term 1 LEADER]: Becoming Leader. State: Replica: 99a891ff4b034c81af29095ef7494235, State: Running, Role: LEADER
I20260811 08:13:02.757125 555 sys_catalog.cc:564] T 00000000000000000000000000000000 P 99a891ff4b034c81af29095ef7494235 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:13:02.757198 562 consensus_queue.cc:237] T 00000000000000000000000000000000 P 99a891ff4b034c81af29095ef7494235 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "99a891ff4b034c81af29095ef7494235" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 34665 } }
I20260811 08:13:02.757570 562 sys_catalog.cc:455] T 00000000000000000000000000000000 P 99a891ff4b034c81af29095ef7494235 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 99a891ff4b034c81af29095ef7494235. Latest consensus state: current_term: 1 leader_uuid: "99a891ff4b034c81af29095ef7494235" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "99a891ff4b034c81af29095ef7494235" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 34665 } } }
I20260811 08:13:02.757627 567 sys_catalog.cc:455] T 00000000000000000000000000000000 P 99a891ff4b034c81af29095ef7494235 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "99a891ff4b034c81af29095ef7494235" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "99a891ff4b034c81af29095ef7494235" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 34665 } } }
I20260811 08:13:02.757718 562 sys_catalog.cc:458] T 00000000000000000000000000000000 P 99a891ff4b034c81af29095ef7494235 [sys.catalog]: This master's current role is: LEADER
I20260811 08:13:02.757725 567 sys_catalog.cc:458] T 00000000000000000000000000000000 P 99a891ff4b034c81af29095ef7494235 [sys.catalog]: This master's current role is: LEADER
I20260811 08:13:02.757974 576 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:13:02.758453 576 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:13:02.760059 561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:02.754396 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49429 (local address 127.27.243.254:34665)
0811 08:13:02.754560 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:02.754568 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:02.754597 (+ 29us) server_negotiation.cc:407] Connection header received
0811 08:13:02.755141 (+ 544us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:02.755148 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:02.755195 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:02.755306 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:02.755559 (+ 253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:02.756762 (+ 1203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:02.757877 (+ 1115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:02.758457 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:02.758566 (+ 109us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:02.759449 (+ 883us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:02.759453 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:02.759453 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:13:02.759612 (+ 159us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:02.759643 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:13:02.759654 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:02.759720 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:02.759824 (+ 104us) server_negotiation.cc:299] Negotiation successful
0811 08:13:02.759861 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":109,"thread_start_us":66,"threads_started":1}
I20260811 08:13:02.760411 576 catalog_manager.cc:1347] Generated new cluster ID: 41286798d3e64de09dc23ee4920f5b0a
I20260811 08:13:02.760459 576 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:13:02.761065 28623 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 08:13:02.766108 561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:02.762491 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52693 (local address 127.27.243.254:34665)
0811 08:13:02.762526 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:02.762528 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:02.762677 (+ 149us) server_negotiation.cc:407] Connection header received
0811 08:13:02.762703 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:02.762704 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:02.762714 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:02.762778 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:02.762876 (+ 98us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:02.763579 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:02.764522 (+ 943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:02.764969 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:02.765050 (+ 81us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:02.765848 (+ 798us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:02.765850 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:02.765850 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:13:02.765855 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:02.765872 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:13:02.765877 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:02.765955 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:02.766019 (+ 64us) server_negotiation.cc:299] Negotiation successful
0811 08:13:02.766031 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260811 08:13:02.769961 576 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:13:02.770443 576 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:13:02.776669 576 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 99a891ff4b034c81af29095ef7494235: Generated new TSK 0
I20260811 08:13:02.776903 576 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 08:13:02.779994 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 435
W20260811 08:13:02.801407 408 connection.cc:535] client connection to 127.27.243.254:34665 recv error: Network error: failed to read from TLS socket (remote: 127.27.243.254:34665): Connection reset by peer (error 104)
2026-08-11T08:13:02Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1449 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786435717191469-28623-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:13:02 dist-test-slave-7lbf krb5kdc[609](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:13:02 dist-test-slave-7lbf krb5kdc[609](info): set up 2 sockets
Aug 11 08:13:02 dist-test-slave-7lbf krb5kdc[609](info): commencing operation
krb5kdc: starting...
W20260811 08:13:03.953754 28623 mini_kdc.cc:121] Time spent starting KDC: real 1.139s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786435717191469-28623-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786435717191469-28623-0/krb5kdc/test-user.keytab.
Aug 11 08:13:04 dist-test-slave-7lbf krb5kdc[609](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435984, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:13:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:13:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.27.243.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.243.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.243.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab.
Entry for principal kudu/127.27.243.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab.
I20260811 08:13:04.075793 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786435717191469-28623-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786435717191469-28623-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786435717191469-28623-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.243.254:36605
--webserver_interface=127.27.243.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab
--principal=kudu/127.27.243.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:34749
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.243.254:36605
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:13:04.159035 635 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:13:04.159258 635 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:13:04.159283 635 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:13:04.160440 635 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:13:04.160486 635 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:13:04.160502 635 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:13:04.160516 635 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:13:04.160545 635 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:13:04.162079 635 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:34749
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786435717191469-28623-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786435717191469-28623-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.243.254:36605
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab
--principal=kudu/127.27.243.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.243.254:36605
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.243.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.635
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786435717191469-28623-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:13:04.162315 635 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:13:04.162530 635 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:13:04.167304 648 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:13:04.167346 645 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:13:04.167296 646 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:13:04.167564 635 server_base.cc:1034] running on GCE node
I20260811 08:13:04.167809 635 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:13:04.168068 635 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:13:04.169210 635 hybrid_clock.cc:648] HybridClock initialized: now 1786435984169193 us; error 34 us; skew 500 ppm
Aug 11 08:13:04 dist-test-slave-7lbf krb5kdc[609](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435984, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:13:04.171633 635 init.cc:377] Logged in from keytab as kudu/127.27.243.254@KRBTEST.COM (short username kudu)
I20260811 08:13:04.172025 635 webserver.cc:460] Webserver started at http://127.27.243.254:35215/ using document root <none> and password file <none>
I20260811 08:13:04.172199 635 fs_manager.cc:359] Metadata directory not provided
I20260811 08:13:04.172236 635 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:13:04.172334 635 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:13:04.173324 635 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786435717191469-28623-0/minicluster-data/master-0/data/instance:
uuid: "8ddac7b1fd6448de970fda6a3c0a9b01"
format_stamp: "Formatted at 2026-08-11 08:13:04 on dist-test-slave-7lbf"
server_key: "c26d0caae2e24c09a6abe1cb61aabad5"
server_key_iv: "e228c13bf0f6eb6830688a4d01906a7e"
server_key_version: "encryptionkey@0"
I20260811 08:13:04.173671 635 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786435717191469-28623-0/minicluster-data/master-0/wal/instance:
uuid: "8ddac7b1fd6448de970fda6a3c0a9b01"
format_stamp: "Formatted at 2026-08-11 08:13:04 on dist-test-slave-7lbf"
server_key: "c26d0caae2e24c09a6abe1cb61aabad5"
server_key_iv: "e228c13bf0f6eb6830688a4d01906a7e"
server_key_version: "encryptionkey@0"
I20260811 08:13:04.174932 635 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 08:13:04.175783 659 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:04.176267 635 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 08:13:04.176388 635 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786435717191469-28623-0/minicluster-data/master-0/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786435717191469-28623-0/minicluster-data/master-0/wal
uuid: "8ddac7b1fd6448de970fda6a3c0a9b01"
format_stamp: "Formatted at 2026-08-11 08:13:04 on dist-test-slave-7lbf"
server_key: "c26d0caae2e24c09a6abe1cb61aabad5"
server_key_iv: "e228c13bf0f6eb6830688a4d01906a7e"
server_key_version: "encryptionkey@0"
I20260811 08:13:04.176465 635 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786435717191469-28623-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786435717191469-28623-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786435717191469-28623-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:13:04.179991 635 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:13:04.182078 635 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:13:04.182181 635 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:13:04.185794 635 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.254:36605
I20260811 08:13:04.185858 754 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.254:36605 every 8 connection(s)
I20260811 08:13:04.186141 635 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
I20260811 08:13:04.187121 755 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:13:04.189400 755 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8ddac7b1fd6448de970fda6a3c0a9b01: Bootstrap starting.
I20260811 08:13:04.190011 755 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8ddac7b1fd6448de970fda6a3c0a9b01: Neither blocks nor log segments found. Creating new log.
I20260811 08:13:04.190285 755 log.cc:824] T 00000000000000000000000000000000 P 8ddac7b1fd6448de970fda6a3c0a9b01: Log is configured to *not* fsync() on all Append() calls
I20260811 08:13:04.190834 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 635
I20260811 08:13:04.190960 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786435717191469-28623-0/minicluster-data/master-0/wal/instance
I20260811 08:13:04.191170 28623 external_mini_cluster.cc:1428] Setting key e8472680c8c866238c81cbe14b8090ff
I20260811 08:13:04.191207 755 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8ddac7b1fd6448de970fda6a3c0a9b01: No bootstrap required, opened a new log
I20260811 08:13:04.193285 755 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8ddac7b1fd6448de970fda6a3c0a9b01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ddac7b1fd6448de970fda6a3c0a9b01" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 36605 } }
I20260811 08:13:04.193432 755 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8ddac7b1fd6448de970fda6a3c0a9b01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:13:04.193470 755 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8ddac7b1fd6448de970fda6a3c0a9b01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ddac7b1fd6448de970fda6a3c0a9b01, State: Initialized, Role: FOLLOWER
I20260811 08:13:04.193761 764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:04.191691 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52507 (local address 127.27.243.254:36605)
0811 08:13:04.191919 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:04.191927 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:04.191951 (+ 24us) server_negotiation.cc:407] Connection header received
0811 08:13:04.192434 (+ 483us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:04.192441 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:04.192464 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:04.192586 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:04.193243 (+ 657us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:04.193246 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:04.193247 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:13:04.193251 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:04.193288 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:13:04.193299 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:04.193356 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:04.193434 (+ 78us) server_negotiation.cc:299] Negotiation successful
0811 08:13:04.193589 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":178,"thread_start_us":111,"threads_started":1}
I20260811 08:13:04.193640 755 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8ddac7b1fd6448de970fda6a3c0a9b01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ddac7b1fd6448de970fda6a3c0a9b01" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 36605 } }
I20260811 08:13:04.194079 755 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8ddac7b1fd6448de970fda6a3c0a9b01 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:13:04.194139 755 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8ddac7b1fd6448de970fda6a3c0a9b01 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:13:04.194193 755 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8ddac7b1fd6448de970fda6a3c0a9b01 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:13:04.194761 28623 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 08:13:04.194921 755 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8ddac7b1fd6448de970fda6a3c0a9b01 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ddac7b1fd6448de970fda6a3c0a9b01" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 36605 } }
I20260811 08:13:04.195031 755 leader_election.cc:302] T 00000000000000000000000000000000 P 8ddac7b1fd6448de970fda6a3c0a9b01 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8ddac7b1fd6448de970fda6a3c0a9b01; no voters:
I20260811 08:13:04.195191 755 leader_election.cc:288] T 00000000000000000000000000000000 P 8ddac7b1fd6448de970fda6a3c0a9b01 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:13:04.195217 765 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8ddac7b1fd6448de970fda6a3c0a9b01 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:13:04.195356 765 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8ddac7b1fd6448de970fda6a3c0a9b01 [term 1 LEADER]: Becoming Leader. State: Replica: 8ddac7b1fd6448de970fda6a3c0a9b01, State: Running, Role: LEADER
I20260811 08:13:04.195451 755 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8ddac7b1fd6448de970fda6a3c0a9b01 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:13:04.195446 765 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8ddac7b1fd6448de970fda6a3c0a9b01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ddac7b1fd6448de970fda6a3c0a9b01" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 36605 } }
I20260811 08:13:04.195904 771 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8ddac7b1fd6448de970fda6a3c0a9b01 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8ddac7b1fd6448de970fda6a3c0a9b01" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ddac7b1fd6448de970fda6a3c0a9b01" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 36605 } } }
I20260811 08:13:04.196003 771 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8ddac7b1fd6448de970fda6a3c0a9b01 [sys.catalog]: This master's current role is: LEADER
I20260811 08:13:04.196178 769 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8ddac7b1fd6448de970fda6a3c0a9b01 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8ddac7b1fd6448de970fda6a3c0a9b01. Latest consensus state: current_term: 1 leader_uuid: "8ddac7b1fd6448de970fda6a3c0a9b01" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ddac7b1fd6448de970fda6a3c0a9b01" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 36605 } } }
I20260811 08:13:04.196230 783 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:13:04.196239 769 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8ddac7b1fd6448de970fda6a3c0a9b01 [sys.catalog]: This master's current role is: LEADER
I20260811 08:13:04.196801 783 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:13:04.198362 783 catalog_manager.cc:1347] Generated new cluster ID: 587f085549f14dc79ebee7e61207265c
I20260811 08:13:04.198424 783 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:13:04.202600 764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:04.196789 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45295 (local address 127.27.243.254:36605)
0811 08:13:04.196827 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:04.196828 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:04.201703 (+ 4875us) server_negotiation.cc:407] Connection header received
0811 08:13:04.201776 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:04.201777 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:04.201783 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:04.201845 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:04.202407 (+ 562us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:04.202409 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:04.202409 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:13:04.202413 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:04.202427 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:13:04.202432 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:04.202474 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:04.202523 (+ 49us) server_negotiation.cc:299] Negotiation successful
0811 08:13:04.202536 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 08:13:04.217018 783 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:13:04.217229 783 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:13:04.219970 783 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8ddac7b1fd6448de970fda6a3c0a9b01: Generated new TSK 0
I20260811 08:13:04.220180 783 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 08:13:04.228225 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 635
2026-08-11T08:13:04Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1449 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786435717191469-28623-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:13:04 dist-test-slave-7lbf krb5kdc[806](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:13:04 dist-test-slave-7lbf krb5kdc[806](info): set up 2 sockets
Aug 11 08:13:04 dist-test-slave-7lbf krb5kdc[806](info): commencing operation
krb5kdc: starting...
W20260811 08:13:05.402488 28623 mini_kdc.cc:121] Time spent starting KDC: real 1.138s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786435717191469-28623-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786435717191469-28623-0/krb5kdc/test-user.keytab.
Aug 11 08:13:05 dist-test-slave-7lbf krb5kdc[806](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435985, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:13:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:13:05Z Disabled control of system clock
WARNING: no policy specified for kudu/127.27.243.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.243.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.243.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab.
Entry for principal kudu/127.27.243.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab.
I20260811 08:13:05.521626 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786435717191469-28623-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786435717191469-28623-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786435717191469-28623-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.243.254:33215
--webserver_interface=127.27.243.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab
--principal=kudu/127.27.243.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:39651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.243.254:33215
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:13:05.601965 829 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:13:05.602159 829 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:13:05.602180 829 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:13:05.603263 829 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:13:05.603294 829 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:13:05.603307 829 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:13:05.603318 829 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:13:05.603328 829 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:13:05.604727 829 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:39651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786435717191469-28623-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786435717191469-28623-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.243.254:33215
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab
--principal=kudu/127.27.243.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.243.254:33215
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.243.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.829
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786435717191469-28623-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:13:05.604926 829 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:13:05.605096 829 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:13:05.609663 835 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:13:05.609673 840 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:13:05.609679 837 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:13:05.609840 829 server_base.cc:1034] running on GCE node
I20260811 08:13:05.610144 829 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:13:05.610404 829 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:13:05.611532 829 hybrid_clock.cc:648] HybridClock initialized: now 1786435985611522 us; error 29 us; skew 500 ppm
Aug 11 08:13:05 dist-test-slave-7lbf krb5kdc[806](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435985, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:13:05.613972 829 init.cc:377] Logged in from keytab as kudu/127.27.243.254@KRBTEST.COM (short username kudu)
I20260811 08:13:05.614379 829 webserver.cc:460] Webserver started at http://127.27.243.254:46429/ using document root <none> and password file <none>
I20260811 08:13:05.614578 829 fs_manager.cc:359] Metadata directory not provided
I20260811 08:13:05.614620 829 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:13:05.614740 829 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:13:05.615754 829 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786435717191469-28623-0/minicluster-data/master-0/data/instance:
uuid: "e069298a00d240febafbd568322b71ad"
format_stamp: "Formatted at 2026-08-11 08:13:05 on dist-test-slave-7lbf"
server_key: "c0d9263c616bf5789acfc86157fbc49d"
server_key_iv: "ab7b1b77b8d01dda632f4ee0a819c829"
server_key_version: "encryptionkey@0"
I20260811 08:13:05.616076 829 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786435717191469-28623-0/minicluster-data/master-0/wal/instance:
uuid: "e069298a00d240febafbd568322b71ad"
format_stamp: "Formatted at 2026-08-11 08:13:05 on dist-test-slave-7lbf"
server_key: "c0d9263c616bf5789acfc86157fbc49d"
server_key_iv: "ab7b1b77b8d01dda632f4ee0a819c829"
server_key_version: "encryptionkey@0"
I20260811 08:13:05.617348 829 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 08:13:05.618105 855 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:05.618257 829 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:05.618336 829 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786435717191469-28623-0/minicluster-data/master-0/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786435717191469-28623-0/minicluster-data/master-0/wal
uuid: "e069298a00d240febafbd568322b71ad"
format_stamp: "Formatted at 2026-08-11 08:13:05 on dist-test-slave-7lbf"
server_key: "c0d9263c616bf5789acfc86157fbc49d"
server_key_iv: "ab7b1b77b8d01dda632f4ee0a819c829"
server_key_version: "encryptionkey@0"
I20260811 08:13:05.618407 829 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786435717191469-28623-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786435717191469-28623-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786435717191469-28623-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:13:05.633651 829 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:13:05.635653 829 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:13:05.635771 829 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:13:05.639633 829 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.254:33215
I20260811 08:13:05.639693 938 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.254:33215 every 8 connection(s)
I20260811 08:13:05.639999 829 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
I20260811 08:13:05.640897 942 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:13:05.643249 942 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e069298a00d240febafbd568322b71ad: Bootstrap starting.
I20260811 08:13:05.643811 942 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e069298a00d240febafbd568322b71ad: Neither blocks nor log segments found. Creating new log.
I20260811 08:13:05.644071 942 log.cc:824] T 00000000000000000000000000000000 P e069298a00d240febafbd568322b71ad: Log is configured to *not* fsync() on all Append() calls
I20260811 08:13:05.644773 942 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e069298a00d240febafbd568322b71ad: No bootstrap required, opened a new log
I20260811 08:13:05.646132 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 829
I20260811 08:13:05.646243 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786435717191469-28623-0/minicluster-data/master-0/wal/instance
I20260811 08:13:05.646425 28623 external_mini_cluster.cc:1428] Setting key eaf30c164b41df52b0e5e24b7dd1eeb7
I20260811 08:13:05.646665 942 raft_consensus.cc:348] T 00000000000000000000000000000000 P e069298a00d240febafbd568322b71ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e069298a00d240febafbd568322b71ad" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 33215 } }
I20260811 08:13:05.646821 942 raft_consensus.cc:374] T 00000000000000000000000000000000 P e069298a00d240febafbd568322b71ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:13:05.646857 942 raft_consensus.cc:729] T 00000000000000000000000000000000 P e069298a00d240febafbd568322b71ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e069298a00d240febafbd568322b71ad, State: Initialized, Role: FOLLOWER
I20260811 08:13:05.647013 942 consensus_queue.cc:260] T 00000000000000000000000000000000 P e069298a00d240febafbd568322b71ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e069298a00d240febafbd568322b71ad" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 33215 } }
I20260811 08:13:05.647130 942 raft_consensus.cc:388] T 00000000000000000000000000000000 P e069298a00d240febafbd568322b71ad [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:13:05.647194 942 raft_consensus.cc:482] T 00000000000000000000000000000000 P e069298a00d240febafbd568322b71ad [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:13:05.647248 942 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e069298a00d240febafbd568322b71ad [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:13:05.648093 942 raft_consensus.cc:504] T 00000000000000000000000000000000 P e069298a00d240febafbd568322b71ad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e069298a00d240febafbd568322b71ad" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 33215 } }
I20260811 08:13:05.648192 942 leader_election.cc:302] T 00000000000000000000000000000000 P e069298a00d240febafbd568322b71ad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e069298a00d240febafbd568322b71ad; no voters:
I20260811 08:13:05.648350 942 leader_election.cc:288] T 00000000000000000000000000000000 P e069298a00d240febafbd568322b71ad [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:13:05.648393 952 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e069298a00d240febafbd568322b71ad [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:13:05.648543 952 raft_consensus.cc:686] T 00000000000000000000000000000000 P e069298a00d240febafbd568322b71ad [term 1 LEADER]: Becoming Leader. State: Replica: e069298a00d240febafbd568322b71ad, State: Running, Role: LEADER
I20260811 08:13:05.648612 942 sys_catalog.cc:564] T 00000000000000000000000000000000 P e069298a00d240febafbd568322b71ad [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:13:05.648676 952 consensus_queue.cc:237] T 00000000000000000000000000000000 P e069298a00d240febafbd568322b71ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e069298a00d240febafbd568322b71ad" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 33215 } }
I20260811 08:13:05.649066 952 sys_catalog.cc:455] T 00000000000000000000000000000000 P e069298a00d240febafbd568322b71ad [sys.catalog]: SysCatalogTable state changed. Reason: New leader e069298a00d240febafbd568322b71ad. Latest consensus state: current_term: 1 leader_uuid: "e069298a00d240febafbd568322b71ad" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e069298a00d240febafbd568322b71ad" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 33215 } } }
I20260811 08:13:05.649133 957 sys_catalog.cc:455] T 00000000000000000000000000000000 P e069298a00d240febafbd568322b71ad [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e069298a00d240febafbd568322b71ad" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e069298a00d240febafbd568322b71ad" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 33215 } } }
I20260811 08:13:05.649200 952 sys_catalog.cc:458] T 00000000000000000000000000000000 P e069298a00d240febafbd568322b71ad [sys.catalog]: This master's current role is: LEADER
I20260811 08:13:05.649307 957 sys_catalog.cc:458] T 00000000000000000000000000000000 P e069298a00d240febafbd568322b71ad [sys.catalog]: This master's current role is: LEADER
I20260811 08:13:05.649551 969 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:13:05.650110 969 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:13:05.651723 969 catalog_manager.cc:1347] Generated new cluster ID: 4bf8fe21c3ce4b579fed86a9e14c5cc8
I20260811 08:13:05.651775 969 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 08:13:05 dist-test-slave-7lbf krb5kdc[806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435985, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.243.254@KRBTEST.COM
I20260811 08:13:05.657168 949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:05.646927 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41185 (local address 127.27.243.254:33215)
0811 08:13:05.647137 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:05.647147 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:05.647184 (+ 37us) server_negotiation.cc:407] Connection header received
0811 08:13:05.647314 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:05.647321 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:05.647370 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:05.647493 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:05.648232 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:05.649550 (+ 1318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:05.650639 (+ 1089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:05.651163 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:05.651297 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:05.653846 (+ 2549us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:05.653850 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:05.653851 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:05.653864 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:05.655466 (+ 1602us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:05.655851 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:05.655854 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:05.655854 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:05.655957 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:05.656225 (+ 268us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:05.656226 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:05.656226 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:05.656475 (+ 249us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:05.656759 (+ 284us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:05.656839 (+ 80us) server_negotiation.cc:299] Negotiation successful
0811 08:13:05.656976 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":152,"thread_start_us":89,"threads_started":1}
I20260811 08:13:05.658171 28623 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 08:13:05.665246 949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:05.659468 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37233 (local address 127.27.243.254:33215)
0811 08:13:05.659502 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:05.659504 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:05.659679 (+ 175us) server_negotiation.cc:407] Connection header received
0811 08:13:05.659739 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:05.659740 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:05.659751 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:05.659816 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:05.660317 (+ 501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:05.660815 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:05.661494 (+ 679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:05.661746 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:05.661818 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:05.662882 (+ 1064us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:05.662883 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:05.662884 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:05.662890 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:05.664174 (+ 1284us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:05.664513 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:05.664514 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:05.664514 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:05.664571 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:05.664756 (+ 185us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:05.664757 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:05.664757 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:05.664872 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:05.664960 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:05.665087 (+ 127us) server_negotiation.cc:299] Negotiation successful
0811 08:13:05.665159 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":16}
I20260811 08:13:05.668249 969 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:13:05.668926 969 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:13:05.673296 969 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e069298a00d240febafbd568322b71ad: Generated new TSK 0
I20260811 08:13:05.673460 969 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 08:13:05.680596 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 829
2026-08-11T08:13:05Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (1447 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786435717191469-28623-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:13:05 dist-test-slave-7lbf krb5kdc[1003](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:13:05 dist-test-slave-7lbf krb5kdc[1003](info): set up 2 sockets
Aug 11 08:13:05 dist-test-slave-7lbf krb5kdc[1003](info): commencing operation
krb5kdc: starting...
W20260811 08:13:06.858557 28623 mini_kdc.cc:121] Time spent starting KDC: real 1.146s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786435717191469-28623-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786435717191469-28623-0/krb5kdc/test-user.keytab.
Aug 11 08:13:06 dist-test-slave-7lbf krb5kdc[1003](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435986, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:13:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:13:06Z Disabled control of system clock
WARNING: no policy specified for kudu/127.27.243.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.243.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.243.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab.
Entry for principal kudu/127.27.243.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab.
I20260811 08:13:06.973788 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786435717191469-28623-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786435717191469-28623-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786435717191469-28623-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.243.254:36715
--webserver_interface=127.27.243.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab
--principal=kudu/127.27.243.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:44535
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.243.254:36715
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:13:07.055213 1025 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:13:07.055423 1025 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:13:07.055445 1025 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:13:07.056519 1025 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:13:07.056557 1025 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:13:07.056572 1025 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:13:07.056586 1025 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:13:07.056602 1025 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:13:07.058037 1025 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:44535
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786435717191469-28623-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786435717191469-28623-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.243.254:36715
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab
--principal=kudu/127.27.243.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.243.254:36715
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.243.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1025
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786435717191469-28623-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:13:07.058259 1025 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:13:07.058437 1025 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:13:07.063138 1035 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:13:07.063257 1025 server_base.cc:1034] running on GCE node
W20260811 08:13:07.063149 1039 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:13:07.063207 1034 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:13:07.063637 1025 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:13:07.063946 1025 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:13:07.065109 1025 hybrid_clock.cc:648] HybridClock initialized: now 1786435987065094 us; error 29 us; skew 500 ppm
Aug 11 08:13:07 dist-test-slave-7lbf krb5kdc[1003](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435987, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:13:07.073675 1025 init.cc:377] Logged in from keytab as kudu/127.27.243.254@KRBTEST.COM (short username kudu)
I20260811 08:13:07.074071 1025 webserver.cc:460] Webserver started at http://127.27.243.254:35745/ using document root <none> and password file <none>
I20260811 08:13:07.074270 1025 fs_manager.cc:359] Metadata directory not provided
I20260811 08:13:07.074309 1025 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:13:07.074404 1025 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:13:07.075394 1025 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786435717191469-28623-0/minicluster-data/master-0/data/instance:
uuid: "5dff6e3dc23042bd9966b5a599c27600"
format_stamp: "Formatted at 2026-08-11 08:13:07 on dist-test-slave-7lbf"
server_key: "e4236ce234e4a6e4a810c0ffb713f52a"
server_key_iv: "e0a3d3f7d104361c6c8dbbd62cc5f86f"
server_key_version: "encryptionkey@0"
I20260811 08:13:07.075695 1025 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786435717191469-28623-0/minicluster-data/master-0/wal/instance:
uuid: "5dff6e3dc23042bd9966b5a599c27600"
format_stamp: "Formatted at 2026-08-11 08:13:07 on dist-test-slave-7lbf"
server_key: "e4236ce234e4a6e4a810c0ffb713f52a"
server_key_iv: "e0a3d3f7d104361c6c8dbbd62cc5f86f"
server_key_version: "encryptionkey@0"
I20260811 08:13:07.076913 1025 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 08:13:07.077579 1048 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:07.077731 1025 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 08:13:07.077844 1025 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786435717191469-28623-0/minicluster-data/master-0/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786435717191469-28623-0/minicluster-data/master-0/wal
uuid: "5dff6e3dc23042bd9966b5a599c27600"
format_stamp: "Formatted at 2026-08-11 08:13:07 on dist-test-slave-7lbf"
server_key: "e4236ce234e4a6e4a810c0ffb713f52a"
server_key_iv: "e0a3d3f7d104361c6c8dbbd62cc5f86f"
server_key_version: "encryptionkey@0"
I20260811 08:13:07.077921 1025 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786435717191469-28623-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786435717191469-28623-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786435717191469-28623-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:13:07.099805 1025 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:13:07.101636 1025 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:13:07.101779 1025 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:13:07.105880 1025 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.254:36715
I20260811 08:13:07.105918 1134 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.254:36715 every 8 connection(s)
I20260811 08:13:07.106261 1025 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
I20260811 08:13:07.107113 1135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:13:07.108304 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 1025
I20260811 08:13:07.108458 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786435717191469-28623-0/minicluster-data/master-0/wal/instance
I20260811 08:13:07.108637 28623 external_mini_cluster.cc:1428] Setting key ce0946c81ece8cce823aead59d39df00
I20260811 08:13:07.109768 1135 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5dff6e3dc23042bd9966b5a599c27600: Bootstrap starting.
I20260811 08:13:07.110309 1135 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5dff6e3dc23042bd9966b5a599c27600: Neither blocks nor log segments found. Creating new log.
I20260811 08:13:07.110597 1135 log.cc:824] T 00000000000000000000000000000000 P 5dff6e3dc23042bd9966b5a599c27600: Log is configured to *not* fsync() on all Append() calls
I20260811 08:13:07.111227 1135 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5dff6e3dc23042bd9966b5a599c27600: No bootstrap required, opened a new log
I20260811 08:13:07.113027 1135 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5dff6e3dc23042bd9966b5a599c27600 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5dff6e3dc23042bd9966b5a599c27600" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 36715 } }
I20260811 08:13:07.113190 1135 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5dff6e3dc23042bd9966b5a599c27600 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:13:07.113242 1135 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5dff6e3dc23042bd9966b5a599c27600 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5dff6e3dc23042bd9966b5a599c27600, State: Initialized, Role: FOLLOWER
I20260811 08:13:07.113364 1135 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5dff6e3dc23042bd9966b5a599c27600 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5dff6e3dc23042bd9966b5a599c27600" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 36715 } }
I20260811 08:13:07.113430 1135 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5dff6e3dc23042bd9966b5a599c27600 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:13:07.113461 1135 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5dff6e3dc23042bd9966b5a599c27600 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:13:07.113505 1135 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5dff6e3dc23042bd9966b5a599c27600 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:13:07.113934 1138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:07.109155 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58221 (local address 127.27.243.254:36715)
0811 08:13:07.109337 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:07.109345 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:07.109370 (+ 25us) server_negotiation.cc:407] Connection header received
0811 08:13:07.109896 (+ 526us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:07.109904 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:07.109963 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:07.110086 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:07.110330 (+ 244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:07.111340 (+ 1010us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:07.112093 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:07.112533 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:07.112629 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:07.113241 (+ 612us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:07.113246 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:07.113246 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:13:07.113441 (+ 195us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:07.113486 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:13:07.113501 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:07.113579 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:07.113648 (+ 69us) server_negotiation.cc:299] Negotiation successful
0811 08:13:07.113712 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":127,"thread_start_us":76,"threads_started":1}
I20260811 08:13:07.114138 1135 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5dff6e3dc23042bd9966b5a599c27600 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5dff6e3dc23042bd9966b5a599c27600" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 36715 } }
I20260811 08:13:07.114248 1135 leader_election.cc:302] T 00000000000000000000000000000000 P 5dff6e3dc23042bd9966b5a599c27600 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5dff6e3dc23042bd9966b5a599c27600; no voters:
I20260811 08:13:07.114404 1135 leader_election.cc:288] T 00000000000000000000000000000000 P 5dff6e3dc23042bd9966b5a599c27600 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:13:07.114420 1141 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5dff6e3dc23042bd9966b5a599c27600 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:13:07.114612 1141 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5dff6e3dc23042bd9966b5a599c27600 [term 1 LEADER]: Becoming Leader. State: Replica: 5dff6e3dc23042bd9966b5a599c27600, State: Running, Role: LEADER
I20260811 08:13:07.114691 1135 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5dff6e3dc23042bd9966b5a599c27600 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:13:07.114740 28623 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 08:13:07.114741 1141 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5dff6e3dc23042bd9966b5a599c27600 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5dff6e3dc23042bd9966b5a599c27600" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 36715 } }
I20260811 08:13:07.115044 1141 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5dff6e3dc23042bd9966b5a599c27600 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5dff6e3dc23042bd9966b5a599c27600. Latest consensus state: current_term: 1 leader_uuid: "5dff6e3dc23042bd9966b5a599c27600" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5dff6e3dc23042bd9966b5a599c27600" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 36715 } } }
I20260811 08:13:07.115175 1141 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5dff6e3dc23042bd9966b5a599c27600 [sys.catalog]: This master's current role is: LEADER
I20260811 08:13:07.115433 1151 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:13:07.116205 1151 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:13:07.116209 1144 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5dff6e3dc23042bd9966b5a599c27600 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5dff6e3dc23042bd9966b5a599c27600" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5dff6e3dc23042bd9966b5a599c27600" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 36715 } } }
I20260811 08:13:07.116420 1144 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5dff6e3dc23042bd9966b5a599c27600 [sys.catalog]: This master's current role is: LEADER
I20260811 08:13:07.117801 1151 catalog_manager.cc:1347] Generated new cluster ID: 8d9226b01c5e4fd5a6f2309a76cbdb04
I20260811 08:13:07.117861 1151 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:13:07.124807 1138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:07.116491 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50145 (local address 127.27.243.254:36715)
0811 08:13:07.116525 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:07.116526 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:07.121704 (+ 5178us) server_negotiation.cc:407] Connection header received
0811 08:13:07.121756 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:07.121757 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:07.121767 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:07.121819 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:07.121953 (+ 134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:07.122677 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:07.123657 (+ 980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:07.123936 (+ 279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:07.123987 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:07.124597 (+ 610us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:07.124598 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:07.124598 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:13:07.124602 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:07.124617 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:13:07.124621 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:07.124667 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:07.124719 (+ 52us) server_negotiation.cc:299] Negotiation successful
0811 08:13:07.124739 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260811 08:13:07.131729 1151 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:13:07.132362 1151 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:13:07.138216 1151 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5dff6e3dc23042bd9966b5a599c27600: Generated new TSK 0
I20260811 08:13:07.138365 1151 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 08:13:07.141271 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 1025
2026-08-11T08:13:07Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1460 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786435717191469-28623-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:13:07 dist-test-slave-7lbf krb5kdc[1182](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:13:07 dist-test-slave-7lbf krb5kdc[1182](info): set up 2 sockets
Aug 11 08:13:07 dist-test-slave-7lbf krb5kdc[1182](info): commencing operation
krb5kdc: starting...
W20260811 08:13:08.317646 28623 mini_kdc.cc:121] Time spent starting KDC: real 1.145s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786435717191469-28623-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786435717191469-28623-0/krb5kdc/test-user.keytab.
Aug 11 08:13:08 dist-test-slave-7lbf krb5kdc[1182](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435988, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:13:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:13:08Z Disabled control of system clock
WARNING: no policy specified for kudu/127.27.243.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.243.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.243.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab.
Entry for principal kudu/127.27.243.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab.
I20260811 08:13:08.438263 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786435717191469-28623-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786435717191469-28623-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786435717191469-28623-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.243.254:34745
--webserver_interface=127.27.243.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab
--principal=kudu/127.27.243.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:44563
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.243.254:34745
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:13:08.518337 1214 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:13:08.518528 1214 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:13:08.518558 1214 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:13:08.519670 1214 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:13:08.519709 1214 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:13:08.519728 1214 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:13:08.519745 1214 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:13:08.519761 1214 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:13:08.521181 1214 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:44563
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786435717191469-28623-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786435717191469-28623-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.243.254:34745
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab
--principal=kudu/127.27.243.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.243.254:34745
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.243.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1214
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786435717191469-28623-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:13:08.521420 1214 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:13:08.521628 1214 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:13:08.526186 1220 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:13:08.526235 1221 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:13:08.526253 1224 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:13:08.526407 1214 server_base.cc:1034] running on GCE node
I20260811 08:13:08.526664 1214 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:13:08.526955 1214 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:13:08.528097 1214 hybrid_clock.cc:648] HybridClock initialized: now 1786435988528080 us; error 35 us; skew 500 ppm
Aug 11 08:13:08 dist-test-slave-7lbf krb5kdc[1182](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435988, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:13:08.530584 1214 init.cc:377] Logged in from keytab as kudu/127.27.243.254@KRBTEST.COM (short username kudu)
I20260811 08:13:08.530964 1214 webserver.cc:460] Webserver started at http://127.27.243.254:37457/ using document root <none> and password file <none>
I20260811 08:13:08.531152 1214 fs_manager.cc:359] Metadata directory not provided
I20260811 08:13:08.531190 1214 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:13:08.531277 1214 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:13:08.532258 1214 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786435717191469-28623-0/minicluster-data/master-0/data/instance:
uuid: "b96acd8e516c41f29ddd6a67ff163356"
format_stamp: "Formatted at 2026-08-11 08:13:08 on dist-test-slave-7lbf"
server_key: "4e6a52ef7256b06394427159d37d7b3a"
server_key_iv: "e3b6debc3d3e5b9c8ff062ac92d11448"
server_key_version: "encryptionkey@0"
I20260811 08:13:08.532562 1214 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786435717191469-28623-0/minicluster-data/master-0/wal/instance:
uuid: "b96acd8e516c41f29ddd6a67ff163356"
format_stamp: "Formatted at 2026-08-11 08:13:08 on dist-test-slave-7lbf"
server_key: "4e6a52ef7256b06394427159d37d7b3a"
server_key_iv: "e3b6debc3d3e5b9c8ff062ac92d11448"
server_key_version: "encryptionkey@0"
I20260811 08:13:08.533778 1214 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 08:13:08.534476 1234 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:08.534669 1214 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 08:13:08.534766 1214 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786435717191469-28623-0/minicluster-data/master-0/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786435717191469-28623-0/minicluster-data/master-0/wal
uuid: "b96acd8e516c41f29ddd6a67ff163356"
format_stamp: "Formatted at 2026-08-11 08:13:08 on dist-test-slave-7lbf"
server_key: "4e6a52ef7256b06394427159d37d7b3a"
server_key_iv: "e3b6debc3d3e5b9c8ff062ac92d11448"
server_key_version: "encryptionkey@0"
I20260811 08:13:08.534838 1214 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786435717191469-28623-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786435717191469-28623-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786435717191469-28623-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:13:08.538007 1214 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:13:08.539760 1214 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:13:08.539888 1214 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:13:08.543637 1214 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.254:34745
I20260811 08:13:08.543670 1318 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.254:34745 every 8 connection(s)
I20260811 08:13:08.543964 1214 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
I20260811 08:13:08.544931 1319 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:13:08.547430 1319 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b96acd8e516c41f29ddd6a67ff163356: Bootstrap starting.
I20260811 08:13:08.547993 1319 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b96acd8e516c41f29ddd6a67ff163356: Neither blocks nor log segments found. Creating new log.
I20260811 08:13:08.548280 1319 log.cc:824] T 00000000000000000000000000000000 P b96acd8e516c41f29ddd6a67ff163356: Log is configured to *not* fsync() on all Append() calls
I20260811 08:13:08.548997 1319 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b96acd8e516c41f29ddd6a67ff163356: No bootstrap required, opened a new log
I20260811 08:13:08.550704 1319 raft_consensus.cc:348] T 00000000000000000000000000000000 P b96acd8e516c41f29ddd6a67ff163356 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b96acd8e516c41f29ddd6a67ff163356" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 34745 } }
I20260811 08:13:08.550848 1319 raft_consensus.cc:374] T 00000000000000000000000000000000 P b96acd8e516c41f29ddd6a67ff163356 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:13:08.550882 1319 raft_consensus.cc:729] T 00000000000000000000000000000000 P b96acd8e516c41f29ddd6a67ff163356 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b96acd8e516c41f29ddd6a67ff163356, State: Initialized, Role: FOLLOWER
I20260811 08:13:08.551016 1319 consensus_queue.cc:260] T 00000000000000000000000000000000 P b96acd8e516c41f29ddd6a67ff163356 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b96acd8e516c41f29ddd6a67ff163356" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 34745 } }
I20260811 08:13:08.551149 1319 raft_consensus.cc:388] T 00000000000000000000000000000000 P b96acd8e516c41f29ddd6a67ff163356 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:13:08.551198 1319 raft_consensus.cc:482] T 00000000000000000000000000000000 P b96acd8e516c41f29ddd6a67ff163356 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:13:08.551235 1319 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b96acd8e516c41f29ddd6a67ff163356 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:13:08.552080 1319 raft_consensus.cc:504] T 00000000000000000000000000000000 P b96acd8e516c41f29ddd6a67ff163356 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b96acd8e516c41f29ddd6a67ff163356" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 34745 } }
I20260811 08:13:08.552174 1319 leader_election.cc:302] T 00000000000000000000000000000000 P b96acd8e516c41f29ddd6a67ff163356 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b96acd8e516c41f29ddd6a67ff163356; no voters:
I20260811 08:13:08.552354 1319 leader_election.cc:288] T 00000000000000000000000000000000 P b96acd8e516c41f29ddd6a67ff163356 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:13:08.552448 1329 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b96acd8e516c41f29ddd6a67ff163356 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:13:08.552618 1329 raft_consensus.cc:686] T 00000000000000000000000000000000 P b96acd8e516c41f29ddd6a67ff163356 [term 1 LEADER]: Becoming Leader. State: Replica: b96acd8e516c41f29ddd6a67ff163356, State: Running, Role: LEADER
I20260811 08:13:08.552677 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 1214
I20260811 08:13:08.552696 1319 sys_catalog.cc:564] T 00000000000000000000000000000000 P b96acd8e516c41f29ddd6a67ff163356 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:13:08.552810 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786435717191469-28623-0/minicluster-data/master-0/wal/instance
I20260811 08:13:08.552754 1329 consensus_queue.cc:237] T 00000000000000000000000000000000 P b96acd8e516c41f29ddd6a67ff163356 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b96acd8e516c41f29ddd6a67ff163356" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 34745 } }
I20260811 08:13:08.553013 28623 external_mini_cluster.cc:1428] Setting key 644078c5587c9a49be685b73f9575110
I20260811 08:13:08.553200 1329 sys_catalog.cc:455] T 00000000000000000000000000000000 P b96acd8e516c41f29ddd6a67ff163356 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b96acd8e516c41f29ddd6a67ff163356. Latest consensus state: current_term: 1 leader_uuid: "b96acd8e516c41f29ddd6a67ff163356" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b96acd8e516c41f29ddd6a67ff163356" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 34745 } } }
I20260811 08:13:08.553279 1329 sys_catalog.cc:458] T 00000000000000000000000000000000 P b96acd8e516c41f29ddd6a67ff163356 [sys.catalog]: This master's current role is: LEADER
I20260811 08:13:08.553597 1330 sys_catalog.cc:455] T 00000000000000000000000000000000 P b96acd8e516c41f29ddd6a67ff163356 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b96acd8e516c41f29ddd6a67ff163356" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b96acd8e516c41f29ddd6a67ff163356" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 34745 } } }
I20260811 08:13:08.553681 1330 sys_catalog.cc:458] T 00000000000000000000000000000000 P b96acd8e516c41f29ddd6a67ff163356 [sys.catalog]: This master's current role is: LEADER
I20260811 08:13:08.553913 1343 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:13:08.554491 1343 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:13:08.555598 1344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:08.553840 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35849 (local address 127.27.243.254:34745)
0811 08:13:08.554023 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:08.554034 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:08.554088 (+ 54us) server_negotiation.cc:407] Connection header received
0811 08:13:08.554215 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:08.554223 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:08.554255 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:08.554727 (+ 472us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:08.555137 (+ 410us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:08.555140 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:08.555140 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:13:08.555143 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:08.555178 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:13:08.555189 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:08.555251 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:08.555362 (+ 111us) server_negotiation.cc:299] Negotiation successful
0811 08:13:08.555408 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":127,"thread_start_us":95,"threads_started":1}
I20260811 08:13:08.556631 28623 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 08:13:08.558785 1343 catalog_manager.cc:1347] Generated new cluster ID: ea42615ca666470091ed9a5d7321d2f0
I20260811 08:13:08.558841 1343 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:13:08.559217 1344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:08.557967 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38351 (local address 127.27.243.254:34745)
0811 08:13:08.558009 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:08.558011 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:08.558146 (+ 135us) server_negotiation.cc:407] Connection header received
0811 08:13:08.558261 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:08.558262 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:08.558268 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:08.558342 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:08.558915 (+ 573us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:08.558916 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:08.558917 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:13:08.558922 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:08.558938 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:13:08.558942 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:08.558993 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:08.559141 (+ 148us) server_negotiation.cc:299] Negotiation successful
0811 08:13:08.559154 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 08:13:08.567076 1343 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:13:08.567227 1343 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:13:08.573441 1343 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b96acd8e516c41f29ddd6a67ff163356: Generated new TSK 0
I20260811 08:13:08.573633 1343 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 08:13:08.575850 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 1214
2026-08-11T08:13:08Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1430 ms)
[----------] 18 tests from AuthTokenIssuingTest (26134 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435717191469-28623-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:13:08 dist-test-slave-7lbf krb5kdc[1377](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:13:08 dist-test-slave-7lbf krb5kdc[1377](info): set up 2 sockets
Aug 11 08:13:08 dist-test-slave-7lbf krb5kdc[1377](info): commencing operation
krb5kdc: starting...
W20260811 08:13:09.744683 28623 mini_kdc.cc:121] Time spent starting KDC: real 1.142s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435717191469-28623-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435717191469-28623-0/krb5kdc/test-user.keytab.
Aug 11 08:13:09 dist-test-slave-7lbf krb5kdc[1377](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435989, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:13:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:13:09Z Disabled control of system clock
WARNING: no policy specified for kudu/127.27.243.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.243.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.243.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab.
Entry for principal kudu/127.27.243.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab.
I20260811 08:13:09.859830 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435717191469-28623-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435717191469-28623-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435717191469-28623-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.243.254:37095
--webserver_interface=127.27.243.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab
--principal=kudu/127.27.243.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:44015
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.243.254:37095,127.27.243.253:42661,127.27.243.252:46595
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:13:09.941401 1398 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 08:13:09.941658 1398 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:13:09.941686 1398 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:13:09.941715 1398 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:13:09.942858 1398 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:13:09.942903 1398 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:13:09.942926 1398 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:13:09.942945 1398 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:13:09.942963 1398 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:13:09.944514 1398 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:44015
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435717191469-28623-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435717191469-28623-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.243.254:37095,127.27.243.253:42661,127.27.243.252:46595
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab
--principal=kudu/127.27.243.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.243.254:37095
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.243.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1398
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435717191469-28623-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:13:09.944768 1398 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:13:09.944988 1398 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:13:09.949651 1412 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:13:09.949693 1410 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:13:09.949651 1407 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:13:09.949676 1398 server_base.cc:1034] running on GCE node
I20260811 08:13:09.950160 1398 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:13:09.950471 1398 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:13:09.951638 1398 hybrid_clock.cc:648] HybridClock initialized: now 1786435989951611 us; error 33 us; skew 500 ppm
Aug 11 08:13:09 dist-test-slave-7lbf krb5kdc[1377](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435989, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:13:09.954066 1398 init.cc:377] Logged in from keytab as kudu/127.27.243.254@KRBTEST.COM (short username kudu)
I20260811 08:13:09.954465 1398 webserver.cc:460] Webserver started at http://127.27.243.254:44521/ using document root <none> and password file <none>
I20260811 08:13:09.954651 1398 fs_manager.cc:359] Metadata directory not provided
I20260811 08:13:09.954692 1398 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:13:09.954809 1398 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:13:09.955818 1398 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435717191469-28623-0/minicluster-data/master-0/data/instance:
uuid: "95fb299690f140d7bba90ae234b378a3"
format_stamp: "Formatted at 2026-08-11 08:13:09 on dist-test-slave-7lbf"
server_key: "a824e5510bbb31f536d79c2990baa59d"
server_key_iv: "6b596bb588618743f2f12124a5f0b033"
server_key_version: "encryptionkey@0"
I20260811 08:13:09.956130 1398 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435717191469-28623-0/minicluster-data/master-0/wal/instance:
uuid: "95fb299690f140d7bba90ae234b378a3"
format_stamp: "Formatted at 2026-08-11 08:13:09 on dist-test-slave-7lbf"
server_key: "a824e5510bbb31f536d79c2990baa59d"
server_key_iv: "6b596bb588618743f2f12124a5f0b033"
server_key_version: "encryptionkey@0"
I20260811 08:13:09.957453 1398 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 08:13:09.958221 1424 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:09.958479 1398 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:13:09.958578 1398 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435717191469-28623-0/minicluster-data/master-0/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435717191469-28623-0/minicluster-data/master-0/wal
uuid: "95fb299690f140d7bba90ae234b378a3"
format_stamp: "Formatted at 2026-08-11 08:13:09 on dist-test-slave-7lbf"
server_key: "a824e5510bbb31f536d79c2990baa59d"
server_key_iv: "6b596bb588618743f2f12124a5f0b033"
server_key_version: "encryptionkey@0"
I20260811 08:13:09.958654 1398 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435717191469-28623-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435717191469-28623-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435717191469-28623-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:13:09.969903 1398 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:13:09.972343 1398 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:13:09.972481 1398 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:13:09.976336 1398 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.254:37095
I20260811 08:13:09.976388 1531 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.254:37095 every 8 connection(s)
I20260811 08:13:09.976707 1398 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
I20260811 08:13:09.977639 1533 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:13:09.979141 1533 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.243.254" port: 37095 } has no permanent_uuid. Determining permanent_uuid...
I20260811 08:13:09.984304 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 1398
I20260811 08:13:09.984447 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435717191469-28623-0/minicluster-data/master-0/wal/instance
I20260811 08:13:09.984632 28623 external_mini_cluster.cc:1428] Setting key 820ecf7b21911bdf1cfdb603ba908fb7
Aug 11 08:13:09 dist-test-slave-7lbf krb5kdc[1377](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435989, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.254@KRBTEST.COM for kudu/127.27.243.254@KRBTEST.COM
I20260811 08:13:09.988421 1535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:09.979757 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:37095 (local address 127.0.0.1:44398)
0811 08:13:09.979958 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:09.979992 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:09.980439 (+ 447us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:09.980740 (+ 301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:09.980742 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:09.981019 (+ 277us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:13:09.981183 (+ 164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:09.981187 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:09.982269 (+ 1082us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:09.982270 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:09.982936 (+ 666us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:09.982938 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:09.983414 (+ 476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:09.983414 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:09.983467 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:09.983908 (+ 441us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:13:09.983916 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:13:09.985422 (+ 1506us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:13:09.987079 (+ 1657us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:09.987085 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:09.987087 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:09.987273 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:09.987480 (+ 207us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:09.987481 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:09.987481 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:09.987566 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:09.987888 (+ 322us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:13:09.987893 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:13:09.987957 (+ 64us) client_negotiation.cc:769] Sending connection context
0811 08:13:09.988037 (+ 80us) client_negotiation.cc:240] Negotiation successful
0811 08:13:09.988251 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":163,"mutex_wait_us":82,"thread_start_us":125,"threads_started":1}
I20260811 08:13:09.988430 1536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:09.979797 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44398 (local address 127.27.243.254:37095)
0811 08:13:09.980565 (+ 768us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:09.980568 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:09.980578 (+ 10us) server_negotiation.cc:407] Connection header received
0811 08:13:09.980636 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:09.980637 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:09.980651 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:09.980710 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:09.981277 (+ 567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:09.982179 (+ 902us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:09.983023 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:09.983346 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:09.983432 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:09.985499 (+ 2067us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:09.985507 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:09.985507 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:09.985538 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:09.987002 (+ 1464us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:09.987346 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:09.987349 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:09.987349 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:09.987422 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:09.987618 (+ 196us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:09.987619 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:09.987619 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:09.987826 (+ 207us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:09.987894 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:09.988075 (+ 181us) server_negotiation.cc:299] Negotiation successful
0811 08:13:09.988178 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":748,"thread_start_us":95,"threads_started":1}
I20260811 08:13:09.989284 1533 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.243.253" port: 42661 } has no permanent_uuid. Determining permanent_uuid...
I20260811 08:13:09.989651 1535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:09.989540 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.253:42661 (local address 127.0.0.1:39848)
0811 08:13:09.989577 (+ 37us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:09.989625 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.253:42661: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":19}
W20260811 08:13:09.989787 1425 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.27.243.253:42661: connect: Connection refused (error 111)
I20260811 08:13:09.990192 1535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:09.990095 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.253:42661 (local address 127.0.0.1:39858)
0811 08:13:09.990139 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:09.990170 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.253:42661: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260811 08:13:09.990293 1533 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.27.243.253:42661: Network error: Client connection negotiation failed: client connection to 127.27.243.253:42661: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.27.243.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.243.253@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.243.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.253.keytab.
Entry for principal kudu/127.27.243.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.253.keytab.
I20260811 08:13:10.008723 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435717191469-28623-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435717191469-28623-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435717191469-28623-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435717191469-28623-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.243.253:42661
--webserver_interface=127.27.243.253
--webserver_port=0
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.253.keytab
--principal=kudu/127.27.243.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:44015
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.243.254:37095,127.27.243.253:42661,127.27.243.252:46595
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 08:13:10.039521 1533 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.243.253" port: 42661 } attempt: 1
I20260811 08:13:10.040046 1535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:10.039897 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.253:42661 (local address 127.0.0.1:39864)
0811 08:13:10.039961 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:10.040009 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.253:42661: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260811 08:13:10.040369 1535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:10.040277 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.253:42661 (local address 127.0.0.1:39874)
0811 08:13:10.040315 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:10.040349 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.253:42661: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260811 08:13:10.040482 1533 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.27.243.253:42661: Network error: Client connection negotiation failed: client connection to 127.27.243.253:42661: connect: Connection refused (error 111)
W20260811 08:13:10.091209 1542 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 08:13:10.091401 1542 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:13:10.091418 1542 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:13:10.091434 1542 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:13:10.092533 1542 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:13:10.092574 1542 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:13:10.092586 1542 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:13:10.092597 1542 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:13:10.092608 1542 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:13:10.094110 1542 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:44015
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435717191469-28623-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435717191469-28623-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.27.243.254:37095,127.27.243.253:42661,127.27.243.252:46595
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.253.keytab
--principal=kudu/127.27.243.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.243.253:42661
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435717191469-28623-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.27.243.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1542
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435717191469-28623-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:13:10.094319 1542 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:13:10.094512 1542 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 08:13:10.099280 1542 server_base.cc:1034] running on GCE node
W20260811 08:13:10.099261 1551 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:13:10.099254 1550 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:13:10.099229 1553 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:13:10.099587 1542 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:13:10.099958 1542 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:13:10.101130 1542 hybrid_clock.cc:648] HybridClock initialized: now 1786435990101114 us; error 32 us; skew 500 ppm
Aug 11 08:13:10 dist-test-slave-7lbf krb5kdc[1377](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435990, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:13:10.103762 1542 init.cc:377] Logged in from keytab as kudu/127.27.243.253@KRBTEST.COM (short username kudu)
I20260811 08:13:10.104300 1542 webserver.cc:460] Webserver started at http://127.27.243.253:36131/ using document root <none> and password file <none>
I20260811 08:13:10.104565 1542 fs_manager.cc:359] Metadata directory not provided
I20260811 08:13:10.104631 1542 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:13:10.104768 1542 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:13:10.105974 1542 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435717191469-28623-0/minicluster-data/master-1/data/instance:
uuid: "432f3ead9e8f4f7ead5c12ae6b8dc3de"
format_stamp: "Formatted at 2026-08-11 08:13:10 on dist-test-slave-7lbf"
server_key: "87e7d718fb3cc2ab35ab4809c3bbdc77"
server_key_iv: "c83d9af0dd842f706dfdecd8c3ed88bd"
server_key_version: "encryptionkey@0"
I20260811 08:13:10.106317 1542 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435717191469-28623-0/minicluster-data/master-1/wal/instance:
uuid: "432f3ead9e8f4f7ead5c12ae6b8dc3de"
format_stamp: "Formatted at 2026-08-11 08:13:10 on dist-test-slave-7lbf"
server_key: "87e7d718fb3cc2ab35ab4809c3bbdc77"
server_key_iv: "c83d9af0dd842f706dfdecd8c3ed88bd"
server_key_version: "encryptionkey@0"
I20260811 08:13:10.107585 1542 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260811 08:13:10.108325 1565 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:10.108500 1542 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:10.108587 1542 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435717191469-28623-0/minicluster-data/master-1/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435717191469-28623-0/minicluster-data/master-1/wal
uuid: "432f3ead9e8f4f7ead5c12ae6b8dc3de"
format_stamp: "Formatted at 2026-08-11 08:13:10 on dist-test-slave-7lbf"
server_key: "87e7d718fb3cc2ab35ab4809c3bbdc77"
server_key_iv: "c83d9af0dd842f706dfdecd8c3ed88bd"
server_key_version: "encryptionkey@0"
I20260811 08:13:10.108649 1542 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435717191469-28623-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435717191469-28623-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435717191469-28623-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:13:10.108630 1533 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.243.253" port: 42661 } attempt: 2
I20260811 08:13:10.109051 1535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:10.108906 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.253:42661 (local address 127.0.0.1:39876)
0811 08:13:10.108972 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:10.109014 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.253:42661: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260811 08:13:10.109396 1535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:10.109289 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.253:42661 (local address 127.0.0.1:39892)
0811 08:13:10.109335 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:10.109371 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.253:42661: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260811 08:13:10.109488 1533 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.27.243.253:42661: Network error: Client connection negotiation failed: client connection to 127.27.243.253:42661: connect: Connection refused (error 111)
I20260811 08:13:10.119616 1542 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:13:10.121487 1542 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:13:10.121631 1542 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:13:10.125381 1542 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.253:42661
I20260811 08:13:10.125443 1646 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.253:42661 every 8 connection(s)
I20260811 08:13:10.125787 1542 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435717191469-28623-0/minicluster-data/master-1/data/info.pb
I20260811 08:13:10.126628 1648 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:13:10.128221 1648 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.243.254" port: 37095 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 08:13:10 dist-test-slave-7lbf krb5kdc[1377](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435990, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.253@KRBTEST.COM for kudu/127.27.243.254@KRBTEST.COM
I20260811 08:13:10.134194 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 1542
I20260811 08:13:10.134295 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435717191469-28623-0/minicluster-data/master-1/wal/instance
I20260811 08:13:10.134459 28623 external_mini_cluster.cc:1428] Setting key adcdfd32d116e8811f816223e991f65d
I20260811 08:13:10.136976 1536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:10.128911 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44408 (local address 127.27.243.254:37095)
0811 08:13:10.128981 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:10.128983 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:10.129124 (+ 141us) server_negotiation.cc:407] Connection header received
0811 08:13:10.129621 (+ 497us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:10.129622 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:10.129634 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:10.129674 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:10.130244 (+ 570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:10.130734 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:10.131753 (+ 1019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:10.131970 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:10.132025 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:10.134160 (+ 2135us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:10.134162 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:10.134162 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:10.134171 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:10.135630 (+ 1459us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:10.136035 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:10.136037 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:10.136037 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:10.136105 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:10.136337 (+ 232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:10.136338 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:10.136339 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:10.136463 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:10.136524 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:10.136789 (+ 265us) server_negotiation.cc:299] Negotiation successful
0811 08:13:10.136881 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 08:13:10.137181 1653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:10.128869 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:37095 (local address 127.0.0.1:44408)
0811 08:13:10.129011 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:10.129047 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:10.129505 (+ 458us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:10.129742 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:10.129746 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:10.129990 (+ 244us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:13:10.130179 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:10.130183 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:10.130848 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:10.130849 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:10.131661 (+ 812us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:10.131664 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:10.132042 (+ 378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:10.132043 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:10.132144 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:10.132614 (+ 470us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:13:10.132622 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:13:10.134054 (+ 1432us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:13:10.135717 (+ 1663us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:10.135725 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:10.135727 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:10.135960 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:10.136165 (+ 205us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:10.136166 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:10.136167 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:10.136274 (+ 107us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:10.136523 (+ 249us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:13:10.136531 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:13:10.136665 (+ 134us) client_negotiation.cc:769] Sending connection context
0811 08:13:10.136761 (+ 96us) client_negotiation.cc:240] Negotiation successful
0811 08:13:10.136923 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":69,"threads_started":1}
I20260811 08:13:10.137758 1648 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.243.253" port: 42661 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 08:13:10 dist-test-slave-7lbf krb5kdc[1377](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435990, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.253@KRBTEST.COM for kudu/127.27.243.253@KRBTEST.COM
WARNING: no policy specified for kudu/127.27.243.252@KRBTEST.COM; defaulting to no policy
I20260811 08:13:10.144861 1653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:10.138032 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.253:42661 (local address 127.0.0.1:39906)
0811 08:13:10.138080 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:10.138092 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:10.138137 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:10.138377 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:10.138378 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:10.138533 (+ 155us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:13:10.138591 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:10.138593 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:10.139483 (+ 890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:10.139484 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:10.140229 (+ 745us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:10.140232 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:10.140704 (+ 472us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:10.140705 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:10.140778 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:10.141113 (+ 335us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:13:10.141118 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:13:10.142430 (+ 1312us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:13:10.144020 (+ 1590us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:10.144021 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:10.144022 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:10.144168 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:10.144336 (+ 168us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:10.144337 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:10.144337 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:10.144409 (+ 72us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:10.144607 (+ 198us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:13:10.144608 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:13:10.144639 (+ 31us) client_negotiation.cc:769] Sending connection context
0811 08:13:10.144680 (+ 41us) client_negotiation.cc:240] Negotiation successful
0811 08:13:10.144773 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29}
I20260811 08:13:10.144995 1656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:10.138076 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39906 (local address 127.27.243.253:42661)
0811 08:13:10.138216 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:10.138220 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:10.138239 (+ 19us) server_negotiation.cc:407] Connection header received
0811 08:13:10.138263 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:10.138265 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:10.138285 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:10.138351 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:10.138673 (+ 322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:10.139390 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:10.140320 (+ 930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:10.140624 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:10.140684 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:10.142511 (+ 1827us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:10.142518 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:10.142518 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:10.142524 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:10.143952 (+ 1428us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:10.144228 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:10.144230 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:10.144230 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:10.144279 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:10.144449 (+ 170us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:10.144449 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:10.144450 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:10.144567 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:10.144619 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:10.144709 (+ 90us) server_negotiation.cc:299] Negotiation successful
0811 08:13:10.144914 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":61,"server-negotiator.queue_time_us":108,"thread_start_us":72,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.243.252@KRBTEST.COM" created.
I20260811 08:13:10.145540 1648 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.243.252" port: 46595 } has no permanent_uuid. Determining permanent_uuid...
I20260811 08:13:10.146741 1653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:10.145740 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.252:46595 (local address 127.0.0.1:35350)
0811 08:13:10.146664 (+ 924us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:10.146716 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.252:46595: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":907}
W20260811 08:13:10.146932 1566 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.27.243.252:46595: connect: Connection refused (error 111)
I20260811 08:13:10.147765 1653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:10.147675 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.252:46595 (local address 127.0.0.1:35356)
0811 08:13:10.147718 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:10.147744 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.252:46595: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260811 08:13:10.147894 1648 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.27.243.252:46595: Network error: Client connection negotiation failed: client connection to 127.27.243.252:46595: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.243.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.252.keytab.
Entry for principal kudu/127.27.243.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.252.keytab.
I20260811 08:13:10.159802 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435717191469-28623-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435717191469-28623-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435717191469-28623-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435717191469-28623-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.243.252:46595
--webserver_interface=127.27.243.252
--webserver_port=0
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.252.keytab
--principal=kudu/127.27.243.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:44015
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.243.254:37095,127.27.243.253:42661,127.27.243.252:46595
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 08:13:10.197111 1648 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.243.252" port: 46595 } attempt: 1
I20260811 08:13:10.197669 1653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:10.197536 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.252:46595 (local address 127.0.0.1:35366)
0811 08:13:10.197592 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:10.197636 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.252:46595: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
I20260811 08:13:10.197995 1653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:10.197913 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.252:46595 (local address 127.0.0.1:35376)
0811 08:13:10.197948 (+ 35us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:10.197973 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.252:46595: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":22}
W20260811 08:13:10.198073 1648 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.27.243.252:46595: Network error: Client connection negotiation failed: client connection to 127.27.243.252:46595: connect: Connection refused (error 111)
I20260811 08:13:10.200659 1533 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.243.253" port: 42661 } attempt: 3
Aug 11 08:13:10 dist-test-slave-7lbf krb5kdc[1377](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435989, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.254@KRBTEST.COM for kudu/127.27.243.253@KRBTEST.COM
I20260811 08:13:10.207535 1656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:10.201053 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39918 (local address 127.27.243.253:42661)
0811 08:13:10.201097 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:10.201099 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:10.201113 (+ 14us) server_negotiation.cc:407] Connection header received
0811 08:13:10.201200 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:10.201201 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:10.201214 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:10.201269 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:10.201635 (+ 366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:10.202133 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:10.202885 (+ 752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:10.203111 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:10.203170 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:10.205045 (+ 1875us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:10.205047 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:10.205047 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:10.205055 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:10.206453 (+ 1398us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:10.206796 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:10.206797 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:10.206798 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:10.206855 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:10.207032 (+ 177us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:10.207034 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:10.207034 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:10.207151 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:10.207214 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:10.207368 (+ 154us) server_negotiation.cc:299] Negotiation successful
0811 08:13:10.207440 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 08:13:10.207535 1535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:10.201011 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.253:42661 (local address 127.0.0.1:39918)
0811 08:13:10.201071 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:10.201083 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:10.201131 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:10.201277 (+ 146us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:10.201278 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:10.201454 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:13:10.201552 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:10.201556 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:10.202215 (+ 659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:10.202216 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:10.202792 (+ 576us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:10.202794 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:10.203176 (+ 382us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:10.203177 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:10.203260 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:10.203712 (+ 452us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:13:10.203718 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:13:10.204947 (+ 1229us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:13:10.206538 (+ 1591us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:10.206539 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:10.206540 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:10.206721 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:10.206911 (+ 190us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:10.206912 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:10.206912 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:10.206975 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:10.207212 (+ 237us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:13:10.207213 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:13:10.207264 (+ 51us) client_negotiation.cc:769] Sending connection context
0811 08:13:10.207326 (+ 62us) client_negotiation.cc:240] Negotiation successful
0811 08:13:10.207430 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40}
I20260811 08:13:10.208047 1533 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.243.252" port: 46595 } has no permanent_uuid. Determining permanent_uuid...
I20260811 08:13:10.208393 1535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:10.208291 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.252:46595 (local address 127.0.0.1:35382)
0811 08:13:10.208333 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:10.208362 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.252:46595: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
I20260811 08:13:10.208721 1535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:10.208636 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.252:46595 (local address 127.0.0.1:35390)
0811 08:13:10.208672 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:10.208697 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.252:46595: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
W20260811 08:13:10.208853 1533 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.27.243.252:46595: Network error: Client connection negotiation failed: client connection to 127.27.243.252:46595: connect: Connection refused (error 111)
I20260811 08:13:10.240024 1533 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.243.252" port: 46595 } attempt: 1
I20260811 08:13:10.240540 1535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:10.240385 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.252:46595 (local address 127.0.0.1:35406)
0811 08:13:10.240461 (+ 76us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:10.240506 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.252:46595: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260811 08:13:10.240931 1535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:10.240842 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.252:46595 (local address 127.0.0.1:35410)
0811 08:13:10.240881 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:10.240909 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.252:46595: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260811 08:13:10.241065 1533 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.27.243.252:46595: Network error: Client connection negotiation failed: client connection to 127.27.243.252:46595: connect: Connection refused (error 111)
W20260811 08:13:10.242259 1665 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 08:13:10.242436 1665 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:13:10.242461 1665 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:13:10.242493 1665 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:13:10.243604 1665 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:13:10.243640 1665 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:13:10.243652 1665 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:13:10.243675 1665 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:13:10.243697 1665 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:13:10.245146 1665 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:44015
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435717191469-28623-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435717191469-28623-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.27.243.254:37095,127.27.243.253:42661,127.27.243.252:46595
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.252.keytab
--principal=kudu/127.27.243.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.243.252:46595
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435717191469-28623-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.27.243.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1665
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435717191469-28623-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:13:10.245369 1665 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:13:10.245604 1665 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:13:10.250097 1677 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:13:10.250072 1672 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:13:10.250139 1665 server_base.cc:1034] running on GCE node
W20260811 08:13:10.250108 1671 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:13:10.250568 1665 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:13:10.250820 1665 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:13:10.251962 1665 hybrid_clock.cc:648] HybridClock initialized: now 1786435990251949 us; error 27 us; skew 500 ppm
Aug 11 08:13:10 dist-test-slave-7lbf krb5kdc[1377](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435990, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:13:10.254354 1665 init.cc:377] Logged in from keytab as kudu/127.27.243.252@KRBTEST.COM (short username kudu)
I20260811 08:13:10.254745 1665 webserver.cc:460] Webserver started at http://127.27.243.252:33963/ using document root <none> and password file <none>
I20260811 08:13:10.254946 1665 fs_manager.cc:359] Metadata directory not provided
I20260811 08:13:10.254992 1665 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:13:10.255112 1665 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:13:10.256090 1665 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435717191469-28623-0/minicluster-data/master-2/data/instance:
uuid: "6110d1d296b94df098466b3de568f11a"
format_stamp: "Formatted at 2026-08-11 08:13:10 on dist-test-slave-7lbf"
server_key: "41a044467ece03fc1e72386ff349d709"
server_key_iv: "d0eb50e8026e8d6da8e4ad43405f37c6"
server_key_version: "encryptionkey@0"
I20260811 08:13:10.256412 1665 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435717191469-28623-0/minicluster-data/master-2/wal/instance:
uuid: "6110d1d296b94df098466b3de568f11a"
format_stamp: "Formatted at 2026-08-11 08:13:10 on dist-test-slave-7lbf"
server_key: "41a044467ece03fc1e72386ff349d709"
server_key_iv: "d0eb50e8026e8d6da8e4ad43405f37c6"
server_key_version: "encryptionkey@0"
I20260811 08:13:10.257643 1665 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 08:13:10.258292 1688 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:10.258445 1665 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:10.258524 1665 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435717191469-28623-0/minicluster-data/master-2/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435717191469-28623-0/minicluster-data/master-2/wal
uuid: "6110d1d296b94df098466b3de568f11a"
format_stamp: "Formatted at 2026-08-11 08:13:10 on dist-test-slave-7lbf"
server_key: "41a044467ece03fc1e72386ff349d709"
server_key_iv: "d0eb50e8026e8d6da8e4ad43405f37c6"
server_key_version: "encryptionkey@0"
I20260811 08:13:10.258589 1665 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435717191469-28623-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435717191469-28623-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435717191469-28623-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:13:10.266196 1648 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.243.252" port: 46595 } attempt: 2
I20260811 08:13:10.266556 1653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:10.266426 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.252:46595 (local address 127.0.0.1:35418)
0811 08:13:10.266482 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:10.266521 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.252:46595: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260811 08:13:10.266832 1653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:10.266761 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.252:46595 (local address 127.0.0.1:35428)
0811 08:13:10.266798 (+ 37us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:10.266818 (+ 20us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.252:46595: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":22}
W20260811 08:13:10.266927 1648 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.27.243.252:46595: Network error: Client connection negotiation failed: client connection to 127.27.243.252:46595: connect: Connection refused (error 111)
I20260811 08:13:10.272621 1665 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:13:10.274597 1665 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:13:10.274703 1665 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:13:10.278281 1665 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.252:46595
I20260811 08:13:10.278322 1776 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.252:46595 every 8 connection(s)
I20260811 08:13:10.278620 1665 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435717191469-28623-0/minicluster-data/master-2/data/info.pb
I20260811 08:13:10.279464 1778 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:13:10.280920 1778 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.243.254" port: 37095 } has no permanent_uuid. Determining permanent_uuid...
I20260811 08:13:10.284708 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 1665
I20260811 08:13:10.284858 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435717191469-28623-0/minicluster-data/master-2/wal/instance
I20260811 08:13:10.285048 28623 external_mini_cluster.cc:1428] Setting key 6b8a6e6c54e429d634581245d963fd23
Aug 11 08:13:10 dist-test-slave-7lbf krb5kdc[1377](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435990, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.252@KRBTEST.COM for kudu/127.27.243.254@KRBTEST.COM
I20260811 08:13:10.289383 1536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:10.281602 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44412 (local address 127.27.243.254:37095)
0811 08:13:10.281656 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:10.281658 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:10.281851 (+ 193us) server_negotiation.cc:407] Connection header received
0811 08:13:10.282316 (+ 465us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:10.282317 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:10.282330 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:10.282382 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:10.282960 (+ 578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:10.283429 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:10.284340 (+ 911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:10.284548 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:10.284602 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:10.286740 (+ 2138us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:10.286742 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:10.286742 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:10.286750 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:10.287971 (+ 1221us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:10.288361 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:10.288362 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:10.288362 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:10.288429 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:10.288747 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:10.288747 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:10.288748 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:10.288883 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:10.288951 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:10.289247 (+ 296us) server_negotiation.cc:299] Negotiation successful
0811 08:13:10.289314 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260811 08:13:10.289652 1781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:10.281567 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:37095 (local address 127.0.0.1:44412)
0811 08:13:10.281733 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:10.281767 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:10.282224 (+ 457us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:10.282459 (+ 235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:10.282463 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:10.282689 (+ 226us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:13:10.282875 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:10.282879 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:10.283508 (+ 629us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:10.283509 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:10.284261 (+ 752us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:10.284263 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:10.284615 (+ 352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:10.284616 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:10.284734 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:10.285202 (+ 468us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:13:10.285212 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:13:10.286659 (+ 1447us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:13:10.288045 (+ 1386us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:10.288052 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:10.288055 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:10.288278 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:10.288510 (+ 232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:10.288511 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:10.288511 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:10.288667 (+ 156us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:10.288951 (+ 284us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:13:10.288958 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:13:10.289103 (+ 145us) client_negotiation.cc:769] Sending connection context
0811 08:13:10.289232 (+ 129us) client_negotiation.cc:240] Negotiation successful
0811 08:13:10.289396 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":88,"threads_started":1}
I20260811 08:13:10.290242 1778 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.243.253" port: 42661 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 08:13:10 dist-test-slave-7lbf krb5kdc[1377](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435989, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.243.252@KRBTEST.COM
Aug 11 08:13:10 dist-test-slave-7lbf krb5kdc[1377](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435990, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.252@KRBTEST.COM for kudu/127.27.243.253@KRBTEST.COM
I20260811 08:13:10.294203 1782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:10.285414 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35444 (local address 127.27.243.252:46595)
0811 08:13:10.285573 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:10.285578 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:10.285696 (+ 118us) server_negotiation.cc:407] Connection header received
0811 08:13:10.285752 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:10.285755 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:10.285776 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:10.285843 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:10.286434 (+ 591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:10.287295 (+ 861us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:10.288072 (+ 777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:10.288393 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:10.288463 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:10.291286 (+ 2823us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:10.291293 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:10.291293 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:10.291299 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:10.292915 (+ 1616us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:10.293369 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:10.293379 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:10.293380 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:10.293441 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:10.293651 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:10.293651 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:10.293652 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:10.293791 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:10.293914 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:10.294028 (+ 114us) server_negotiation.cc:299] Negotiation successful
0811 08:13:10.294099 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129,"thread_start_us":74,"threads_started":1}
I20260811 08:13:10.296976 1781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:10.290504 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.253:42661 (local address 127.0.0.1:39922)
0811 08:13:10.290556 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:10.290568 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:10.290607 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:10.290754 (+ 147us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:10.290755 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:10.290899 (+ 144us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:13:10.290959 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:10.290960 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:10.291705 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:10.291706 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:10.292425 (+ 719us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:10.292429 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:10.292771 (+ 342us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:10.292772 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:10.292847 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:10.293124 (+ 277us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:13:10.293127 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:13:10.294334 (+ 1207us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:13:10.295967 (+ 1633us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:10.295968 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:10.295968 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:10.296165 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:10.296432 (+ 267us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:10.296433 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:10.296433 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:10.296491 (+ 58us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:10.296706 (+ 215us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:13:10.296707 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:13:10.296748 (+ 41us) client_negotiation.cc:769] Sending connection context
0811 08:13:10.296808 (+ 60us) client_negotiation.cc:240] Negotiation successful
0811 08:13:10.296893 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36}
I20260811 08:13:10.297001 1656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:10.290605 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39922 (local address 127.27.243.253:42661)
0811 08:13:10.290651 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:10.290653 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:10.290661 (+ 8us) server_negotiation.cc:407] Connection header received
0811 08:13:10.290685 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:10.290687 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:10.290696 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:10.290753 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:10.291042 (+ 289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:10.291645 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:10.292509 (+ 864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:10.292704 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:10.292752 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:10.294414 (+ 1662us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:10.294416 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:10.294416 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:10.294423 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:10.295892 (+ 1469us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:10.296268 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:10.296269 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:10.296270 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:10.296328 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:10.296549 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:10.296550 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:10.296550 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:10.296652 (+ 102us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:10.296708 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:10.296840 (+ 132us) server_negotiation.cc:299] Negotiation successful
0811 08:13:10.296919 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 08:13:10.297554 1778 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.243.252" port: 46595 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 08:13:10 dist-test-slave-7lbf krb5kdc[1377](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435989, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.243.254@KRBTEST.COM
Aug 11 08:13:10 dist-test-slave-7lbf krb5kdc[1377](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435990, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.252@KRBTEST.COM for kudu/127.27.243.252@KRBTEST.COM
I20260811 08:13:10.302423 1536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:10.294929 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44420 (local address 127.27.243.254:37095)
0811 08:13:10.294968 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:10.294970 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:10.295165 (+ 195us) server_negotiation.cc:407] Connection header received
0811 08:13:10.295216 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:10.295217 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:10.295228 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:10.295302 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:10.295713 (+ 411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:10.296267 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:10.296880 (+ 613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:10.297110 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:10.297169 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:10.299314 (+ 2145us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:10.299316 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:10.299316 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:10.299322 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:10.300790 (+ 1468us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:10.301074 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:10.301075 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:10.301075 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:10.301127 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:10.301334 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:10.301335 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:10.301336 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:10.301474 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:10.302200 (+ 726us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:10.302242 (+ 42us) server_negotiation.cc:299] Negotiation successful
0811 08:13:10.302330 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 08:13:10.303615 1781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:10.297772 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.252:46595 (local address 127.0.0.1:35458)
0811 08:13:10.297833 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:10.297852 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:10.297892 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:10.298007 (+ 115us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:10.298008 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:10.298136 (+ 128us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:13:10.298169 (+ 33us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:10.298171 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:10.298717 (+ 546us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:10.298718 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:10.299215 (+ 497us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:10.299217 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:10.299558 (+ 341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:10.299559 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:10.299605 (+ 46us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:10.299871 (+ 266us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:13:10.299874 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:13:10.300977 (+ 1103us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:13:10.302590 (+ 1613us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:10.302591 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:10.302591 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:10.302774 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:10.303030 (+ 256us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:10.303030 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:10.303030 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:10.303077 (+ 47us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:10.303354 (+ 277us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:13:10.303355 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:13:10.303402 (+ 47us) client_negotiation.cc:769] Sending connection context
0811 08:13:10.303476 (+ 74us) client_negotiation.cc:240] Negotiation successful
0811 08:13:10.303558 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":49}
I20260811 08:13:10.303870 1782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:10.297801 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35458 (local address 127.27.243.252:46595)
0811 08:13:10.297850 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:10.297851 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:10.297880 (+ 29us) server_negotiation.cc:407] Connection header received
0811 08:13:10.297952 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:10.297952 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:10.297960 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:10.298002 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:10.298225 (+ 223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:10.298651 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:10.299283 (+ 632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:10.299498 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:10.299554 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:10.301047 (+ 1493us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:10.301048 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:10.301048 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:10.301054 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:10.302519 (+ 1465us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:10.302917 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:10.302918 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:10.302918 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:10.302965 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:10.303128 (+ 163us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:10.303129 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:10.303130 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:10.303260 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:10.303330 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:10.303511 (+ 181us) server_negotiation.cc:299] Negotiation successful
0811 08:13:10.303612 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":27,"server-negotiator.queue_time_us":30}
I20260811 08:13:10.305298 1778 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6110d1d296b94df098466b3de568f11a: Bootstrap starting.
I20260811 08:13:10.306371 1778 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6110d1d296b94df098466b3de568f11a: Neither blocks nor log segments found. Creating new log.
I20260811 08:13:10.306687 1778 log.cc:824] T 00000000000000000000000000000000 P 6110d1d296b94df098466b3de568f11a: Log is configured to *not* fsync() on all Append() calls
Aug 11 08:13:10 dist-test-slave-7lbf krb5kdc[1377](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435989, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.243.253@KRBTEST.COM
I20260811 08:13:10.307461 1778 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6110d1d296b94df098466b3de568f11a: No bootstrap required, opened a new log
I20260811 08:13:10.308923 1778 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6110d1d296b94df098466b3de568f11a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95fb299690f140d7bba90ae234b378a3" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 37095 } } peers { permanent_uuid: "432f3ead9e8f4f7ead5c12ae6b8dc3de" member_type: VOTER last_known_addr { host: "127.27.243.253" port: 42661 } } peers { permanent_uuid: "6110d1d296b94df098466b3de568f11a" member_type: VOTER last_known_addr { host: "127.27.243.252" port: 46595 } }
I20260811 08:13:10.309051 1778 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6110d1d296b94df098466b3de568f11a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6110d1d296b94df098466b3de568f11a, State: Initialized, Role: FOLLOWER
I20260811 08:13:10.309130 1778 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6110d1d296b94df098466b3de568f11a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95fb299690f140d7bba90ae234b378a3" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 37095 } } peers { permanent_uuid: "432f3ead9e8f4f7ead5c12ae6b8dc3de" member_type: VOTER last_known_addr { host: "127.27.243.253" port: 42661 } } peers { permanent_uuid: "6110d1d296b94df098466b3de568f11a" member_type: VOTER last_known_addr { host: "127.27.243.252" port: 46595 } }
I20260811 08:13:10.309456 1778 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6110d1d296b94df098466b3de568f11a [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:13:10.309423 1788 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6110d1d296b94df098466b3de568f11a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95fb299690f140d7bba90ae234b378a3" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 37095 } } peers { permanent_uuid: "432f3ead9e8f4f7ead5c12ae6b8dc3de" member_type: VOTER last_known_addr { host: "127.27.243.253" port: 42661 } } peers { permanent_uuid: "6110d1d296b94df098466b3de568f11a" member_type: VOTER last_known_addr { host: "127.27.243.252" port: 46595 } } }
I20260811 08:13:10.309608 1788 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6110d1d296b94df098466b3de568f11a [sys.catalog]: This master's current role is: FOLLOWER
I20260811 08:13:10.310230 1656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:10.303047 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39930 (local address 127.27.243.253:42661)
0811 08:13:10.303086 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:10.303088 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:10.303106 (+ 18us) server_negotiation.cc:407] Connection header received
0811 08:13:10.303126 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:10.303126 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:10.303136 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:10.303173 (+ 37us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:10.303715 (+ 542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:10.304328 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:10.305151 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:10.305379 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:10.305442 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:10.307745 (+ 2303us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:10.307746 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:10.307747 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:10.307753 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:10.309001 (+ 1248us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:10.309378 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:10.309379 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:10.309379 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:10.309437 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:10.309684 (+ 247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:10.309685 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:10.309685 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:10.309811 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:10.309970 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:10.310061 (+ 91us) server_negotiation.cc:299] Negotiation successful
0811 08:13:10.310141 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
W20260811 08:13:10.311359 1811 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 6110d1d296b94df098466b3de568f11a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 08:13:10.311414 1811 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 08:13:10.311626 28623 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 08:13:10.312531 1490 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "95fb299690f140d7bba90ae234b378a3"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44420
I20260811 08:13:10.311661 1665 master_runner.cc:186] Error getting master registration for 127.27.243.254:37095: OK, instance_id { permanent_uuid: "95fb299690f140d7bba90ae234b378a3" instance_seqno: 1786435989975294 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 08:13:10.314594 1665 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 08:13:10.316212 1533 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.243.252" port: 46595 } attempt: 2
Aug 11 08:13:10 dist-test-slave-7lbf krb5kdc[1377](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435989, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.254@KRBTEST.COM for kudu/127.27.243.252@KRBTEST.COM
I20260811 08:13:10.323644 1782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:10.316493 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35464 (local address 127.27.243.252:46595)
0811 08:13:10.316559 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:10.316561 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:10.316598 (+ 37us) server_negotiation.cc:407] Connection header received
0811 08:13:10.316673 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:10.316674 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:10.316682 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:10.316733 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:10.317025 (+ 292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:10.317764 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:10.318688 (+ 924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:10.318989 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:10.319040 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:10.321050 (+ 2010us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:10.321051 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:10.321051 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:10.321058 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:10.322545 (+ 1487us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:10.322922 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:10.322923 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:10.322924 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:10.322975 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:10.323139 (+ 164us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:10.323140 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:10.323140 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:10.323285 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:10.323352 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:10.323487 (+ 135us) server_negotiation.cc:299] Negotiation successful
0811 08:13:10.323558 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260811 08:13:10.323652 1535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:10.316426 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.252:46595 (local address 127.0.0.1:35464)
0811 08:13:10.316547 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:10.316559 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:10.316616 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:10.316738 (+ 122us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:10.316739 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:10.316910 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:13:10.316953 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:10.316955 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:10.317835 (+ 880us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:10.317837 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:10.318609 (+ 772us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:10.318612 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:10.319052 (+ 440us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:10.319053 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:10.319113 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:10.319519 (+ 406us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:13:10.319524 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:13:10.320960 (+ 1436us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:13:10.322625 (+ 1665us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:10.322627 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:10.322627 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:10.322850 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:10.323026 (+ 176us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:10.323026 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:10.323027 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:10.323084 (+ 57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:10.323346 (+ 262us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:13:10.323347 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:13:10.323393 (+ 46us) client_negotiation.cc:769] Sending connection context
0811 08:13:10.323462 (+ 69us) client_negotiation.cc:240] Negotiation successful
0811 08:13:10.323554 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":101}
I20260811 08:13:10.325395 1533 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 95fb299690f140d7bba90ae234b378a3: Bootstrap starting.
I20260811 08:13:10.326128 1533 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 95fb299690f140d7bba90ae234b378a3: Neither blocks nor log segments found. Creating new log.
I20260811 08:13:10.326438 1533 log.cc:824] T 00000000000000000000000000000000 P 95fb299690f140d7bba90ae234b378a3: Log is configured to *not* fsync() on all Append() calls
I20260811 08:13:10.327246 1533 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 95fb299690f140d7bba90ae234b378a3: No bootstrap required, opened a new log
I20260811 08:13:10.328534 1533 raft_consensus.cc:348] T 00000000000000000000000000000000 P 95fb299690f140d7bba90ae234b378a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95fb299690f140d7bba90ae234b378a3" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 37095 } } peers { permanent_uuid: "432f3ead9e8f4f7ead5c12ae6b8dc3de" member_type: VOTER last_known_addr { host: "127.27.243.253" port: 42661 } } peers { permanent_uuid: "6110d1d296b94df098466b3de568f11a" member_type: VOTER last_known_addr { host: "127.27.243.252" port: 46595 } }
I20260811 08:13:10.328666 1533 raft_consensus.cc:729] T 00000000000000000000000000000000 P 95fb299690f140d7bba90ae234b378a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95fb299690f140d7bba90ae234b378a3, State: Initialized, Role: FOLLOWER
I20260811 08:13:10.328744 1533 consensus_queue.cc:260] T 00000000000000000000000000000000 P 95fb299690f140d7bba90ae234b378a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95fb299690f140d7bba90ae234b378a3" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 37095 } } peers { permanent_uuid: "432f3ead9e8f4f7ead5c12ae6b8dc3de" member_type: VOTER last_known_addr { host: "127.27.243.253" port: 42661 } } peers { permanent_uuid: "6110d1d296b94df098466b3de568f11a" member_type: VOTER last_known_addr { host: "127.27.243.252" port: 46595 } }
I20260811 08:13:10.329035 1533 sys_catalog.cc:564] T 00000000000000000000000000000000 P 95fb299690f140d7bba90ae234b378a3 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:13:10.329089 1490 raft_consensus.cc:482] T 00000000000000000000000000000000 P 95fb299690f140d7bba90ae234b378a3 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 08:13:10.329133 1490 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 95fb299690f140d7bba90ae234b378a3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:13:10.329914 1490 raft_consensus.cc:504] T 00000000000000000000000000000000 P 95fb299690f140d7bba90ae234b378a3 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95fb299690f140d7bba90ae234b378a3" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 37095 } } peers { permanent_uuid: "432f3ead9e8f4f7ead5c12ae6b8dc3de" member_type: VOTER last_known_addr { host: "127.27.243.253" port: 42661 } } peers { permanent_uuid: "6110d1d296b94df098466b3de568f11a" member_type: VOTER last_known_addr { host: "127.27.243.252" port: 46595 } }
I20260811 08:13:10.330142 1490 leader_election.cc:288] T 00000000000000000000000000000000 P 95fb299690f140d7bba90ae234b378a3 [CANDIDATE]: Term 1 election: Requested vote from peers 432f3ead9e8f4f7ead5c12ae6b8dc3de (127.27.243.253:42661), 6110d1d296b94df098466b3de568f11a (127.27.243.252:46595)
I20260811 08:13:10.330734 1731 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "95fb299690f140d7bba90ae234b378a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "6110d1d296b94df098466b3de568f11a"
I20260811 08:13:10.330868 1731 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6110d1d296b94df098466b3de568f11a [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:13:10.331707 1731 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 6110d1d296b94df098466b3de568f11a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95fb299690f140d7bba90ae234b378a3 in term 1.
I20260811 08:13:10.331997 1425 leader_election.cc:302] T 00000000000000000000000000000000 P 95fb299690f140d7bba90ae234b378a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6110d1d296b94df098466b3de568f11a, 95fb299690f140d7bba90ae234b378a3; no voters:
W20260811 08:13:10.332329 1833 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 95fb299690f140d7bba90ae234b378a3: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 08:13:10.332428 1833 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 08:13:10.329020 1816 sys_catalog.cc:455] T 00000000000000000000000000000000 P 95fb299690f140d7bba90ae234b378a3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95fb299690f140d7bba90ae234b378a3" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 37095 } } peers { permanent_uuid: "432f3ead9e8f4f7ead5c12ae6b8dc3de" member_type: VOTER last_known_addr { host: "127.27.243.253" port: 42661 } } peers { permanent_uuid: "6110d1d296b94df098466b3de568f11a" member_type: VOTER last_known_addr { host: "127.27.243.252" port: 46595 } } }
I20260811 08:13:10.333144 1816 sys_catalog.cc:458] T 00000000000000000000000000000000 P 95fb299690f140d7bba90ae234b378a3 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 08:13:10.333235 1816 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 95fb299690f140d7bba90ae234b378a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:13:10.333318 1816 raft_consensus.cc:686] T 00000000000000000000000000000000 P 95fb299690f140d7bba90ae234b378a3 [term 1 LEADER]: Becoming Leader. State: Replica: 95fb299690f140d7bba90ae234b378a3, State: Running, Role: LEADER
I20260811 08:13:10.333432 1816 consensus_queue.cc:237] T 00000000000000000000000000000000 P 95fb299690f140d7bba90ae234b378a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95fb299690f140d7bba90ae234b378a3" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 37095 } } peers { permanent_uuid: "432f3ead9e8f4f7ead5c12ae6b8dc3de" member_type: VOTER last_known_addr { host: "127.27.243.253" port: 42661 } } peers { permanent_uuid: "6110d1d296b94df098466b3de568f11a" member_type: VOTER last_known_addr { host: "127.27.243.252" port: 46595 } }
I20260811 08:13:10.331574 1398 master_runner.cc:186] Error getting master registration for 127.27.243.253:42661: OK, instance_id { permanent_uuid: "432f3ead9e8f4f7ead5c12ae6b8dc3de" instance_seqno: 1786435990124331 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 08:13:10.333806 1398 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 08:13:10.334043 1816 sys_catalog.cc:455] T 00000000000000000000000000000000 P 95fb299690f140d7bba90ae234b378a3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 95fb299690f140d7bba90ae234b378a3. Latest consensus state: current_term: 1 leader_uuid: "95fb299690f140d7bba90ae234b378a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95fb299690f140d7bba90ae234b378a3" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 37095 } } peers { permanent_uuid: "432f3ead9e8f4f7ead5c12ae6b8dc3de" member_type: VOTER last_known_addr { host: "127.27.243.253" port: 42661 } } peers { permanent_uuid: "6110d1d296b94df098466b3de568f11a" member_type: VOTER last_known_addr { host: "127.27.243.252" port: 46595 } } }
I20260811 08:13:10.334187 1816 sys_catalog.cc:458] T 00000000000000000000000000000000 P 95fb299690f140d7bba90ae234b378a3 [sys.catalog]: This master's current role is: LEADER
I20260811 08:13:10.334733 1848 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:13:10.334908 1848 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:13:10.336323 1731 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 6110d1d296b94df098466b3de568f11a [term 1 FOLLOWER]: Refusing update from remote peer 95fb299690f140d7bba90ae234b378a3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:13:10.336642 1836 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 95fb299690f140d7bba90ae234b378a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6110d1d296b94df098466b3de568f11a" member_type: VOTER last_known_addr { host: "127.27.243.252" port: 46595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:13:10.338112 1788 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6110d1d296b94df098466b3de568f11a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 95fb299690f140d7bba90ae234b378a3. Latest consensus state: current_term: 1 leader_uuid: "95fb299690f140d7bba90ae234b378a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95fb299690f140d7bba90ae234b378a3" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 37095 } } peers { permanent_uuid: "432f3ead9e8f4f7ead5c12ae6b8dc3de" member_type: VOTER last_known_addr { host: "127.27.243.253" port: 42661 } } peers { permanent_uuid: "6110d1d296b94df098466b3de568f11a" member_type: VOTER last_known_addr { host: "127.27.243.252" port: 46595 } } }
I20260811 08:13:10.338202 1788 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6110d1d296b94df098466b3de568f11a [sys.catalog]: This master's current role is: FOLLOWER
I20260811 08:13:10.347983 1536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:10.334548 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44428 (local address 127.27.243.254:37095)
0811 08:13:10.334598 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:10.334600 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:10.336900 (+ 2300us) server_negotiation.cc:407] Connection header received
0811 08:13:10.337062 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:10.337063 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:10.337075 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:10.337102 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:10.338920 (+ 1818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:10.339627 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:10.340621 (+ 994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:10.340918 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:10.340957 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:10.342510 (+ 1553us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:10.342511 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:10.342512 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:10.342518 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:10.344049 (+ 1531us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:10.346322 (+ 2273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:10.346323 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:10.346324 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:10.346388 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:10.346975 (+ 587us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:10.346976 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:10.346977 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:10.347109 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:10.347211 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:10.347810 (+ 599us) server_negotiation.cc:299] Negotiation successful
0811 08:13:10.347891 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 08:13:10.350201 1656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:10.335619 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39936 (local address 127.27.243.253:42661)
0811 08:13:10.335654 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:10.335656 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:10.337822 (+ 2166us) server_negotiation.cc:407] Connection header received
0811 08:13:10.337966 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:10.337967 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:10.337989 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:10.338019 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:10.339168 (+ 1149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:10.339845 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:10.341291 (+ 1446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:10.341692 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:10.341734 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:10.346296 (+ 4562us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:10.346297 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:10.346298 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:10.346324 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:10.347981 (+ 1657us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:10.348737 (+ 756us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:10.348739 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:10.348739 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:10.348803 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:10.349081 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:10.349082 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:10.349083 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:10.349222 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:10.349293 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:10.350028 (+ 735us) server_negotiation.cc:299] Negotiation successful
0811 08:13:10.350108 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260811 08:13:10.353468 1836 sys_catalog.cc:455] T 00000000000000000000000000000000 P 95fb299690f140d7bba90ae234b378a3 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "95fb299690f140d7bba90ae234b378a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95fb299690f140d7bba90ae234b378a3" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 37095 } } peers { permanent_uuid: "432f3ead9e8f4f7ead5c12ae6b8dc3de" member_type: VOTER last_known_addr { host: "127.27.243.253" port: 42661 } } peers { permanent_uuid: "6110d1d296b94df098466b3de568f11a" member_type: VOTER last_known_addr { host: "127.27.243.252" port: 46595 } } }
I20260811 08:13:10.353577 1836 sys_catalog.cc:458] T 00000000000000000000000000000000 P 95fb299690f140d7bba90ae234b378a3 [sys.catalog]: This master's current role is: LEADER
I20260811 08:13:10.354103 1788 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6110d1d296b94df098466b3de568f11a [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "95fb299690f140d7bba90ae234b378a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95fb299690f140d7bba90ae234b378a3" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 37095 } } peers { permanent_uuid: "432f3ead9e8f4f7ead5c12ae6b8dc3de" member_type: VOTER last_known_addr { host: "127.27.243.253" port: 42661 } } peers { permanent_uuid: "6110d1d296b94df098466b3de568f11a" member_type: VOTER last_known_addr { host: "127.27.243.252" port: 46595 } } }
I20260811 08:13:10.354184 1788 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6110d1d296b94df098466b3de568f11a [sys.catalog]: This master's current role is: FOLLOWER
I20260811 08:13:10.354368 1850 mvcc.cc:205] Tried to move back new op lower bound from 7317241816414781440 to 7317241816406888448. Current Snapshot: MvccSnapshot[applied={T|T < 7317241816414781440}]
I20260811 08:13:10.354467 1853 mvcc.cc:205] Tried to move back new op lower bound from 7317241816414781440 to 7317241816406888448. Current Snapshot: MvccSnapshot[applied={T|T < 7317241816414781440}]
I20260811 08:13:10.356034 1782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:10.335963 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35478 (local address 127.27.243.252:46595)
0811 08:13:10.335997 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:10.335999 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:10.342627 (+ 6628us) server_negotiation.cc:407] Connection header received
0811 08:13:10.342935 (+ 308us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:10.342937 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:10.342959 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:10.342988 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:10.348129 (+ 5141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:10.348807 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:10.350588 (+ 1781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:10.350919 (+ 331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:10.350959 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:10.352516 (+ 1557us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:10.352517 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:10.352517 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:10.352525 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:10.354288 (+ 1763us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:10.354908 (+ 620us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:10.354909 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:10.354909 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:10.354966 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:10.355368 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:10.355369 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:10.355370 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:10.355494 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:10.355571 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:10.355886 (+ 315us) server_negotiation.cc:299] Negotiation successful
0811 08:13:10.355955 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 08:13:10.356117 1848 catalog_manager.cc:1347] Generated new cluster ID: f6ba72802f6b4d6d9a3878e58abd9880
I20260811 08:13:10.356165 1848 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:13:10.358067 1648 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.243.252" port: 46595 } attempt: 3
Aug 11 08:13:10 dist-test-slave-7lbf krb5kdc[1377](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435990, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.253@KRBTEST.COM for kudu/127.27.243.252@KRBTEST.COM
I20260811 08:13:10.366057 1848 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:13:10.366698 1848 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:13:10.367762 1653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:10.358268 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.252:46595 (local address 127.0.0.1:35488)
0811 08:13:10.358354 (+ 86us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:10.358362 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:10.358393 (+ 31us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:10.358670 (+ 277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:10.358671 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:10.358812 (+ 141us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:13:10.358848 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:10.358850 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:10.359665 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:10.359666 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:10.360391 (+ 725us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:10.360394 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:10.360937 (+ 543us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:10.360938 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:10.361004 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:10.361416 (+ 412us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:13:10.361420 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:13:10.362872 (+ 1452us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:13:10.365625 (+ 2753us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:10.365626 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:10.365627 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:10.365852 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:10.367019 (+ 1167us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:10.367019 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:10.367020 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:10.367085 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:10.367483 (+ 398us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:13:10.367484 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:13:10.367539 (+ 55us) client_negotiation.cc:769] Sending connection context
0811 08:13:10.367589 (+ 50us) client_negotiation.cc:240] Negotiation successful
0811 08:13:10.367671 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":70}
I20260811 08:13:10.368430 1782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:10.358458 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35488 (local address 127.27.243.252:46595)
0811 08:13:10.358556 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:10.358557 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:10.358563 (+ 6us) server_negotiation.cc:407] Connection header received
0811 08:13:10.358594 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:10.358595 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:10.358602 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:10.358638 (+ 36us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:10.358924 (+ 286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:10.359599 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:10.360491 (+ 892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:10.360832 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:10.360878 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:10.362968 (+ 2090us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:10.362969 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:10.362969 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:10.362976 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:10.365492 (+ 2516us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:10.366821 (+ 1329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:10.366823 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:10.366823 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:10.366911 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:10.367150 (+ 239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:10.367151 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:10.367151 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:10.367357 (+ 206us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:10.367448 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:10.368143 (+ 695us) server_negotiation.cc:299] Negotiation successful
0811 08:13:10.368269 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260811 08:13:10.369755 1848 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 95fb299690f140d7bba90ae234b378a3: Generated new TSK 0
I20260811 08:13:10.369913 1848 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 08:13:10.370354 1648 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 432f3ead9e8f4f7ead5c12ae6b8dc3de: Bootstrap starting.
I20260811 08:13:10.370913 1648 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 432f3ead9e8f4f7ead5c12ae6b8dc3de: Neither blocks nor log segments found. Creating new log.
I20260811 08:13:10.371124 1648 log.cc:824] T 00000000000000000000000000000000 P 432f3ead9e8f4f7ead5c12ae6b8dc3de: Log is configured to *not* fsync() on all Append() calls
I20260811 08:13:10.371888 1648 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 432f3ead9e8f4f7ead5c12ae6b8dc3de: No bootstrap required, opened a new log
I20260811 08:13:10.373870 1648 raft_consensus.cc:348] T 00000000000000000000000000000000 P 432f3ead9e8f4f7ead5c12ae6b8dc3de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95fb299690f140d7bba90ae234b378a3" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 37095 } } peers { permanent_uuid: "432f3ead9e8f4f7ead5c12ae6b8dc3de" member_type: VOTER last_known_addr { host: "127.27.243.253" port: 42661 } } peers { permanent_uuid: "6110d1d296b94df098466b3de568f11a" member_type: VOTER last_known_addr { host: "127.27.243.252" port: 46595 } }
I20260811 08:13:10.374010 1648 raft_consensus.cc:729] T 00000000000000000000000000000000 P 432f3ead9e8f4f7ead5c12ae6b8dc3de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 432f3ead9e8f4f7ead5c12ae6b8dc3de, State: Initialized, Role: FOLLOWER
I20260811 08:13:10.374092 1648 consensus_queue.cc:260] T 00000000000000000000000000000000 P 432f3ead9e8f4f7ead5c12ae6b8dc3de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95fb299690f140d7bba90ae234b378a3" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 37095 } } peers { permanent_uuid: "432f3ead9e8f4f7ead5c12ae6b8dc3de" member_type: VOTER last_known_addr { host: "127.27.243.253" port: 42661 } } peers { permanent_uuid: "6110d1d296b94df098466b3de568f11a" member_type: VOTER last_known_addr { host: "127.27.243.252" port: 46595 } }
I20260811 08:13:10.374859 1612 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "95fb299690f140d7bba90ae234b378a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "432f3ead9e8f4f7ead5c12ae6b8dc3de"
I20260811 08:13:10.374944 1612 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 432f3ead9e8f4f7ead5c12ae6b8dc3de [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:13:10.375650 1612 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 432f3ead9e8f4f7ead5c12ae6b8dc3de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95fb299690f140d7bba90ae234b378a3 in term 1.
I20260811 08:13:10.375895 1610 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 432f3ead9e8f4f7ead5c12ae6b8dc3de [term 1 FOLLOWER]: Refusing update from remote peer 95fb299690f140d7bba90ae234b378a3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:13:10.374799 1648 sys_catalog.cc:564] T 00000000000000000000000000000000 P 432f3ead9e8f4f7ead5c12ae6b8dc3de [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:13:10.376147 1816 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 95fb299690f140d7bba90ae234b378a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "432f3ead9e8f4f7ead5c12ae6b8dc3de" member_type: VOTER last_known_addr { host: "127.27.243.253" port: 42661 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:13:10.378988 1883 sys_catalog.cc:455] T 00000000000000000000000000000000 P 432f3ead9e8f4f7ead5c12ae6b8dc3de [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "95fb299690f140d7bba90ae234b378a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95fb299690f140d7bba90ae234b378a3" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 37095 } } peers { permanent_uuid: "432f3ead9e8f4f7ead5c12ae6b8dc3de" member_type: VOTER last_known_addr { host: "127.27.243.253" port: 42661 } } peers { permanent_uuid: "6110d1d296b94df098466b3de568f11a" member_type: VOTER last_known_addr { host: "127.27.243.252" port: 46595 } } }
I20260811 08:13:10.379608 1883 sys_catalog.cc:458] T 00000000000000000000000000000000 P 432f3ead9e8f4f7ead5c12ae6b8dc3de [sys.catalog]: This master's current role is: FOLLOWER
I20260811 08:13:10.379669 1883 sys_catalog.cc:455] T 00000000000000000000000000000000 P 432f3ead9e8f4f7ead5c12ae6b8dc3de [sys.catalog]: SysCatalogTable state changed. Reason: New leader 95fb299690f140d7bba90ae234b378a3. Latest consensus state: current_term: 1 leader_uuid: "95fb299690f140d7bba90ae234b378a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95fb299690f140d7bba90ae234b378a3" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 37095 } } peers { permanent_uuid: "432f3ead9e8f4f7ead5c12ae6b8dc3de" member_type: VOTER last_known_addr { host: "127.27.243.253" port: 42661 } } peers { permanent_uuid: "6110d1d296b94df098466b3de568f11a" member_type: VOTER last_known_addr { host: "127.27.243.252" port: 46595 } } }
I20260811 08:13:10.379706 1883 sys_catalog.cc:458] T 00000000000000000000000000000000 P 432f3ead9e8f4f7ead5c12ae6b8dc3de [sys.catalog]: This master's current role is: FOLLOWER
I20260811 08:13:10.379729 1883 sys_catalog.cc:455] T 00000000000000000000000000000000 P 432f3ead9e8f4f7ead5c12ae6b8dc3de [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "95fb299690f140d7bba90ae234b378a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95fb299690f140d7bba90ae234b378a3" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 37095 } } peers { permanent_uuid: "432f3ead9e8f4f7ead5c12ae6b8dc3de" member_type: VOTER last_known_addr { host: "127.27.243.253" port: 42661 } } peers { permanent_uuid: "6110d1d296b94df098466b3de568f11a" member_type: VOTER last_known_addr { host: "127.27.243.252" port: 46595 } } }
I20260811 08:13:10.379756 1883 sys_catalog.cc:458] T 00000000000000000000000000000000 P 432f3ead9e8f4f7ead5c12ae6b8dc3de [sys.catalog]: This master's current role is: FOLLOWER
W20260811 08:13:10.380223 1882 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 432f3ead9e8f4f7ead5c12ae6b8dc3de: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 08:13:10.380261 1882 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 08:13:10.384599 1884 mvcc.cc:205] Tried to move back new op lower bound from 7317241816549773312 to 7317241816406888448. Current Snapshot: MvccSnapshot[applied={T|T < 7317241816414781440}]
W20260811 08:13:10.398245 1536 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:13:10.396589 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44440 (local address 127.27.243.254:37095)
0811 08:13:10.396634 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:10.396636 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:10.397576 (+ 940us) server_negotiation.cc:407] Connection header received
0811 08:13:10.397686 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:10.397688 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:10.397699 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:10.397729 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:10.398165 (+ 436us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44440: BlockingRecv error: recv got EOF from 127.0.0.1:44440 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
W20260811 08:13:10.399066 1656 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:13:10.397016 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39950 (local address 127.27.243.253:42661)
0811 08:13:10.397053 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:10.397055 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:10.398584 (+ 1529us) server_negotiation.cc:407] Connection header received
0811 08:13:10.398678 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:10.398679 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:10.398690 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:10.398717 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:10.399007 (+ 290us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39950: BlockingRecv error: recv got EOF from 127.0.0.1:39950 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260811 08:13:10.399837 1782 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:13:10.397302 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35504 (local address 127.27.243.252:46595)
0811 08:13:10.397347 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:10.397349 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:10.399349 (+ 2000us) server_negotiation.cc:407] Connection header received
0811 08:13:10.399472 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:10.399473 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:10.399483 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:10.399510 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:10.399780 (+ 270us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35504: BlockingRecv error: recv got EOF from 127.0.0.1:35504 (error 108)
Metrics: {"server-negotiator.queue_time_us":29}
W20260811 08:13:10.402217 1656 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:13:10.401112 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39962 (local address 127.27.243.253:42661)
0811 08:13:10.401143 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:10.401145 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:10.401723 (+ 578us) server_negotiation.cc:407] Connection header received
0811 08:13:10.401842 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:10.401843 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:10.401860 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:10.401887 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:10.402173 (+ 286us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39962: BlockingRecv error: recv got EOF from 127.0.0.1:39962 (error 108)
Metrics: {"server-negotiator.queue_time_us":15}
W20260811 08:13:10.405190 1656 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:13:10.404533 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39978 (local address 127.27.243.253:42661)
0811 08:13:10.404564 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:10.404566 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:10.404758 (+ 192us) server_negotiation.cc:407] Connection header received
0811 08:13:10.404843 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:10.404844 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:10.404853 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:10.404879 (+ 26us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:10.405151 (+ 272us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39978: BlockingRecv error: recv got EOF from 127.0.0.1:39978 (error 108)
Metrics: {"server-negotiator.queue_time_us":15}
W20260811 08:13:10.410063 1656 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:13:10.409337 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39992 (local address 127.27.243.253:42661)
0811 08:13:10.409367 (+ 30us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:10.409369 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:10.409605 (+ 236us) server_negotiation.cc:407] Connection header received
0811 08:13:10.409692 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:10.409693 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:10.409703 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:10.409731 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:10.410022 (+ 291us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39992: BlockingRecv error: recv got EOF from 127.0.0.1:39992 (error 108)
Metrics: {"server-negotiator.queue_time_us":15}
W20260811 08:13:10.416002 1656 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:13:10.415284 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39994 (local address 127.27.243.253:42661)
0811 08:13:10.415329 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:10.415331 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:10.415538 (+ 207us) server_negotiation.cc:407] Connection header received
0811 08:13:10.415627 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:10.415627 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:10.415637 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:10.415664 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:10.415959 (+ 295us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39994: BlockingRecv error: recv got EOF from 127.0.0.1:39994 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260811 08:13:10.426218 1656 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:13:10.425269 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40004 (local address 127.27.243.253:42661)
0811 08:13:10.425307 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:10.425309 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:10.425665 (+ 356us) server_negotiation.cc:407] Connection header received
0811 08:13:10.425766 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:10.425767 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:10.425778 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:10.425807 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:10.426157 (+ 350us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40004: BlockingRecv error: recv got EOF from 127.0.0.1:40004 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260811 08:13:10.444399 1656 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:13:10.443536 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40020 (local address 127.27.243.253:42661)
0811 08:13:10.443576 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:10.443579 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:10.443826 (+ 247us) server_negotiation.cc:407] Connection header received
0811 08:13:10.443925 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:10.443927 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:10.443938 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:10.443966 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:10.444341 (+ 375us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40020: BlockingRecv error: recv got EOF from 127.0.0.1:40020 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260811 08:13:10.479003 1656 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:13:10.477986 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40032 (local address 127.27.243.253:42661)
0811 08:13:10.478030 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:10.478032 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:10.478394 (+ 362us) server_negotiation.cc:407] Connection header received
0811 08:13:10.478507 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:10.478508 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:10.478521 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:10.478551 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:10.478943 (+ 392us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40032: BlockingRecv error: recv got EOF from 127.0.0.1:40032 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260811 08:13:10.545095 1656 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:13:10.544382 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40048 (local address 127.27.243.253:42661)
0811 08:13:10.544443 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:10.544445 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:10.544556 (+ 111us) server_negotiation.cc:407] Connection header received
0811 08:13:10.544595 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:10.544596 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:10.544609 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:10.544676 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:10.545037 (+ 361us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40048: BlockingRecv error: recv got EOF from 127.0.0.1:40048 (error 108)
Metrics: {"server-negotiator.queue_time_us":28}
W20260811 08:13:10.674808 1656 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:13:10.674177 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40062 (local address 127.27.243.253:42661)
0811 08:13:10.674251 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:10.674254 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:10.674313 (+ 59us) server_negotiation.cc:407] Connection header received
0811 08:13:10.674390 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:10.674391 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:10.674402 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:10.674453 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:10.674742 (+ 289us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40062: BlockingRecv error: recv got EOF from 127.0.0.1:40062 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 08:13:10.846660 1816 sys_catalog.cc:455] T 00000000000000000000000000000000 P 95fb299690f140d7bba90ae234b378a3 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "95fb299690f140d7bba90ae234b378a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95fb299690f140d7bba90ae234b378a3" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 37095 } } peers { permanent_uuid: "432f3ead9e8f4f7ead5c12ae6b8dc3de" member_type: VOTER last_known_addr { host: "127.27.243.253" port: 42661 } } peers { permanent_uuid: "6110d1d296b94df098466b3de568f11a" member_type: VOTER last_known_addr { host: "127.27.243.252" port: 46595 } } }
I20260811 08:13:10.846844 1816 sys_catalog.cc:458] T 00000000000000000000000000000000 P 95fb299690f140d7bba90ae234b378a3 [sys.catalog]: This master's current role is: LEADER
W20260811 08:13:10.932741 1656 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:13:10.932143 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40074 (local address 127.27.243.253:42661)
0811 08:13:10.932217 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:10.932219 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:10.932231 (+ 12us) server_negotiation.cc:407] Connection header received
0811 08:13:10.932281 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:10.932282 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:10.932295 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:10.932359 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:10.932693 (+ 334us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40074: BlockingRecv error: recv got EOF from 127.0.0.1:40074 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 08:13:11.311873 1811 catalog_manager.cc:1259] Loaded cluster ID: f6ba72802f6b4d6d9a3878e58abd9880
I20260811 08:13:11.311949 1811 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 6110d1d296b94df098466b3de568f11a: loading cluster ID for follower catalog manager: success
I20260811 08:13:11.312800 1811 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 6110d1d296b94df098466b3de568f11a: acquiring CA information for follower catalog manager: success
I20260811 08:13:11.313100 1811 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 6110d1d296b94df098466b3de568f11a: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 08:13:11.380707 1882 catalog_manager.cc:1259] Loaded cluster ID: f6ba72802f6b4d6d9a3878e58abd9880
I20260811 08:13:11.380789 1882 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 432f3ead9e8f4f7ead5c12ae6b8dc3de: loading cluster ID for follower catalog manager: success
I20260811 08:13:11.381620 1882 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 432f3ead9e8f4f7ead5c12ae6b8dc3de: acquiring CA information for follower catalog manager: success
I20260811 08:13:11.381959 1882 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 432f3ead9e8f4f7ead5c12ae6b8dc3de: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 08:13:11.448386 2002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:11.446005 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40084 (local address 127.27.243.253:42661)
0811 08:13:11.446112 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:11.446114 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:11.446124 (+ 10us) server_negotiation.cc:407] Connection header received
0811 08:13:11.446184 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:11.446185 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:11.446239 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:11.446314 (+ 75us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:13:11.446438 (+ 124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:11.446961 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:11.447667 (+ 706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:11.447889 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:11.447938 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:11.448080 (+ 142us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:13:11.448204 (+ 124us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:13:11.448264 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:11.448280 (+ 16us) server_negotiation.cc:299] Negotiation successful
0811 08:13:11.448299 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88,"thread_start_us":57,"threads_started":1}
I20260811 08:13:11.452522 2012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:11.450189 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35508 (local address 127.27.243.252:46595)
0811 08:13:11.450303 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:11.450305 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:11.450313 (+ 8us) server_negotiation.cc:407] Connection header received
0811 08:13:11.450355 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:11.450356 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:11.450409 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:11.450478 (+ 69us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:13:11.450591 (+ 113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:11.451075 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:11.451773 (+ 698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:11.452013 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:11.452069 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:11.452222 (+ 153us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:13:11.452328 (+ 106us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:13:11.452401 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:11.452422 (+ 21us) server_negotiation.cc:299] Negotiation successful
0811 08:13:11.452441 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93,"thread_start_us":52,"threads_started":1}
I20260811 08:13:11.456748 2002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:11.454071 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40088 (local address 127.27.243.253:42661)
0811 08:13:11.454109 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:11.454111 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:11.454328 (+ 217us) server_negotiation.cc:407] Connection header received
0811 08:13:11.454357 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:11.454359 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:11.454368 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:11.454415 (+ 47us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:13:11.454557 (+ 142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:11.455080 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:11.455953 (+ 873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:11.456293 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:11.456345 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:11.456508 (+ 163us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:13:11.456542 (+ 34us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:13:11.456593 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:11.456656 (+ 63us) server_negotiation.cc:299] Negotiation successful
0811 08:13:11.456679 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 08:13:11.457050 2012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:11.454298 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35516 (local address 127.27.243.252:46595)
0811 08:13:11.454353 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:11.454355 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:11.454381 (+ 26us) server_negotiation.cc:407] Connection header received
0811 08:13:11.454467 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:11.454468 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:11.454480 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:11.454532 (+ 52us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:13:11.454679 (+ 147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:11.455403 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:11.456345 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:11.456578 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:11.456631 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:11.456797 (+ 166us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:13:11.456826 (+ 29us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:13:11.456854 (+ 28us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:11.456961 (+ 107us) server_negotiation.cc:299] Negotiation successful
0811 08:13:11.456985 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 08:13:11.457334 2024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:11.454104 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44442 (local address 127.27.243.254:37095)
0811 08:13:11.454211 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:11.454213 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:11.454345 (+ 132us) server_negotiation.cc:407] Connection header received
0811 08:13:11.454463 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:11.454464 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:11.454510 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:11.454588 (+ 78us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:13:11.454741 (+ 153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:11.455484 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:11.456326 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:11.456600 (+ 274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:11.456638 (+ 38us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:11.456875 (+ 237us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:13:11.456967 (+ 92us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:13:11.457022 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:11.457228 (+ 206us) server_negotiation.cc:299] Negotiation successful
0811 08:13:11.457255 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85,"thread_start_us":52,"threads_started":1}
I20260811 08:13:11.458894 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 1398
I20260811 08:13:11.473043 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 1542
I20260811 08:13:11.488052 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 1665
2026-08-11T08:13:11Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (2910 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435717191469-28623-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:13:11 dist-test-slave-7lbf krb5kdc[2035](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:13:11 dist-test-slave-7lbf krb5kdc[2035](info): set up 2 sockets
Aug 11 08:13:11 dist-test-slave-7lbf krb5kdc[2035](info): commencing operation
krb5kdc: starting...
W20260811 08:13:12.664710 28623 mini_kdc.cc:121] Time spent starting KDC: real 1.151s user 0.006s sys 0.000s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435717191469-28623-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435717191469-28623-0/krb5kdc/test-user.keytab.
Aug 11 08:13:12 dist-test-slave-7lbf krb5kdc[2035](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435992, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:13:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:13:12Z Disabled control of system clock
WARNING: no policy specified for kudu/127.27.243.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.243.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.243.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab.
Entry for principal kudu/127.27.243.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab.
I20260811 08:13:12.779841 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435717191469-28623-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435717191469-28623-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435717191469-28623-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.243.254:33529
--webserver_interface=127.27.243.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab
--principal=kudu/127.27.243.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:46863
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.243.254:33529,127.27.243.253:38941,127.27.243.252:44337
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:13:12.864485 2057 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 08:13:12.864687 2057 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:13:12.864710 2057 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:13:12.864735 2057 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:13:12.865863 2057 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:13:12.865900 2057 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:13:12.865919 2057 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:13:12.865934 2057 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:13:12.865949 2057 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:13:12.867437 2057 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:46863
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435717191469-28623-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435717191469-28623-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.243.254:33529,127.27.243.253:38941,127.27.243.252:44337
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.254.keytab
--principal=kudu/127.27.243.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.243.254:33529
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.243.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2057
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435717191469-28623-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:13:12.867672 2057 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:13:12.867874 2057 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:13:12.872714 2069 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:13:12.872691 2070 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:13:12.872691 2073 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:13:12.872932 2057 server_base.cc:1034] running on GCE node
I20260811 08:13:12.873134 2057 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:13:12.873380 2057 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:13:12.874514 2057 hybrid_clock.cc:648] HybridClock initialized: now 1786435992874500 us; error 31 us; skew 500 ppm
Aug 11 08:13:12 dist-test-slave-7lbf krb5kdc[2035](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435992, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:13:12.879696 2057 init.cc:377] Logged in from keytab as kudu/127.27.243.254@KRBTEST.COM (short username kudu)
I20260811 08:13:12.880121 2057 webserver.cc:460] Webserver started at http://127.27.243.254:43979/ using document root <none> and password file <none>
I20260811 08:13:12.880318 2057 fs_manager.cc:359] Metadata directory not provided
I20260811 08:13:12.880358 2057 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:13:12.880450 2057 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:13:12.881471 2057 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435717191469-28623-0/minicluster-data/master-0/data/instance:
uuid: "7100e05eb647416ca653a043c0a41651"
format_stamp: "Formatted at 2026-08-11 08:13:12 on dist-test-slave-7lbf"
server_key: "8b67efd73166ea6c95e2f1ee99c9a3f8"
server_key_iv: "5ce6af1f717d4045e5c2f45b85c0a252"
server_key_version: "encryptionkey@0"
I20260811 08:13:12.881819 2057 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435717191469-28623-0/minicluster-data/master-0/wal/instance:
uuid: "7100e05eb647416ca653a043c0a41651"
format_stamp: "Formatted at 2026-08-11 08:13:12 on dist-test-slave-7lbf"
server_key: "8b67efd73166ea6c95e2f1ee99c9a3f8"
server_key_iv: "5ce6af1f717d4045e5c2f45b85c0a252"
server_key_version: "encryptionkey@0"
I20260811 08:13:12.883030 2057 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:13:12.883705 2086 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:12.883850 2057 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 08:13:12.883944 2057 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435717191469-28623-0/minicluster-data/master-0/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435717191469-28623-0/minicluster-data/master-0/wal
uuid: "7100e05eb647416ca653a043c0a41651"
format_stamp: "Formatted at 2026-08-11 08:13:12 on dist-test-slave-7lbf"
server_key: "8b67efd73166ea6c95e2f1ee99c9a3f8"
server_key_iv: "5ce6af1f717d4045e5c2f45b85c0a252"
server_key_version: "encryptionkey@0"
I20260811 08:13:12.884012 2057 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435717191469-28623-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435717191469-28623-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435717191469-28623-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:13:12.894074 2057 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:13:12.895793 2057 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:13:12.895911 2057 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:13:12.899711 2057 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.254:33529
I20260811 08:13:12.899755 2168 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.254:33529 every 8 connection(s)
I20260811 08:13:12.900084 2057 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435717191469-28623-0/minicluster-data/master-0/data/info.pb
I20260811 08:13:12.900954 2170 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:13:12.902554 2170 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.243.254" port: 33529 } has no permanent_uuid. Determining permanent_uuid...
I20260811 08:13:12.904579 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 2057
I20260811 08:13:12.904685 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435717191469-28623-0/minicluster-data/master-0/wal/instance
I20260811 08:13:12.904896 28623 external_mini_cluster.cc:1428] Setting key a14dc5fd1b4cc046bfc8dbc4b3e389d2
Aug 11 08:13:12 dist-test-slave-7lbf krb5kdc[2035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435992, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.254@KRBTEST.COM for kudu/127.27.243.254@KRBTEST.COM
I20260811 08:13:12.912825 2176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:12.903357 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58858 (local address 127.27.243.254:33529)
0811 08:13:12.904150 (+ 793us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:12.904153 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:12.904164 (+ 11us) server_negotiation.cc:407] Connection header received
0811 08:13:12.904223 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:12.904224 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:12.904239 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:12.904297 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:12.905023 (+ 726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:12.906186 (+ 1163us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:12.907058 (+ 872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:12.907512 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:12.907623 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:12.909592 (+ 1969us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:12.909601 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:12.909602 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:12.909610 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:12.911309 (+ 1699us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:12.911692 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:12.911695 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:12.911696 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:12.911803 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:12.912016 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:12.912017 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:12.912017 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:12.912296 (+ 279us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:12.912400 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:12.912579 (+ 179us) server_negotiation.cc:299] Negotiation successful
0811 08:13:12.912723 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":39,"server-negotiator.queue_time_us":771,"thread_start_us":69,"threads_started":1}
I20260811 08:13:12.912833 2174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:12.903298 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:33529 (local address 127.0.0.1:58858)
0811 08:13:12.903464 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:12.903501 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:12.904000 (+ 499us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:12.904332 (+ 332us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:12.904334 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:12.904680 (+ 346us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:13:12.904910 (+ 230us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:12.904917 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:12.906284 (+ 1367us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:12.906286 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:12.906978 (+ 692us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:12.906980 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:12.907603 (+ 623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:12.907604 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:12.907664 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:12.908123 (+ 459us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:13:12.908132 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:13:12.909474 (+ 1342us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:13:12.911405 (+ 1931us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:12.911412 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:12.911413 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:12.911603 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:12.911871 (+ 268us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:12.911872 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:12.911872 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:12.911955 (+ 83us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:12.912383 (+ 428us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:13:12.912388 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:13:12.912445 (+ 57us) client_negotiation.cc:769] Sending connection context
0811 08:13:12.912518 (+ 73us) client_negotiation.cc:240] Negotiation successful
0811 08:13:12.912640 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":83,"threads_started":1}
WARNING: no policy specified for kudu/127.27.243.253@KRBTEST.COM; defaulting to no policy
I20260811 08:13:12.913830 2170 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.243.253" port: 38941 } has no permanent_uuid. Determining permanent_uuid...
I20260811 08:13:12.914145 2174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:12.914036 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.253:38941 (local address 127.0.0.1:50846)
0811 08:13:12.914079 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:12.914125 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.253:38941: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
W20260811 08:13:12.914294 2093 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.27.243.253:38941: connect: Connection refused (error 111)
I20260811 08:13:12.914680 2174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:12.914597 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.253:38941 (local address 127.0.0.1:50856)
0811 08:13:12.914638 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:12.914663 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.253:38941: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260811 08:13:12.914768 2170 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.27.243.253:38941: Network error: Client connection negotiation failed: client connection to 127.27.243.253:38941: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.243.253@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.243.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.253.keytab.
Entry for principal kudu/127.27.243.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.253.keytab.
I20260811 08:13:12.929747 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435717191469-28623-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435717191469-28623-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435717191469-28623-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435717191469-28623-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.243.253:38941
--webserver_interface=127.27.243.253
--webserver_port=0
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.253.keytab
--principal=kudu/127.27.243.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:46863
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.243.254:33529,127.27.243.253:38941,127.27.243.252:44337
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 08:13:12.963980 2170 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.243.253" port: 38941 } attempt: 1
I20260811 08:13:12.964452 2174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:12.964314 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.253:38941 (local address 127.0.0.1:50870)
0811 08:13:12.964386 (+ 72us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:12.964418 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.253:38941: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260811 08:13:12.964816 2174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:12.964731 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.253:38941 (local address 127.0.0.1:50878)
0811 08:13:12.964773 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:12.964796 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.253:38941: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260811 08:13:12.964942 2170 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.27.243.253:38941: Network error: Client connection negotiation failed: client connection to 127.27.243.253:38941: connect: Connection refused (error 111)
W20260811 08:13:13.010470 2184 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 08:13:13.010696 2184 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:13:13.010711 2184 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:13:13.010730 2184 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:13:13.011857 2184 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:13:13.011895 2184 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:13:13.011909 2184 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:13:13.011920 2184 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:13:13.011945 2184 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:13:13.013381 2184 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:46863
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435717191469-28623-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435717191469-28623-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.27.243.254:33529,127.27.243.253:38941,127.27.243.252:44337
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.253.keytab
--principal=kudu/127.27.243.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.243.253:38941
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435717191469-28623-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.27.243.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2184
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435717191469-28623-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:13:13.013630 2184 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:13:13.013833 2184 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:13:13.018414 2192 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:13:13.018570 2184 server_base.cc:1034] running on GCE node
W20260811 08:13:13.018428 2196 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:13:13.018428 2194 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:13:13.018895 2184 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:13:13.019184 2184 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:13:13.020332 2184 hybrid_clock.cc:648] HybridClock initialized: now 1786435993020323 us; error 30 us; skew 500 ppm
Aug 11 08:13:13 dist-test-slave-7lbf krb5kdc[2035](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435993, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:13:13.022890 2184 init.cc:377] Logged in from keytab as kudu/127.27.243.253@KRBTEST.COM (short username kudu)
I20260811 08:13:13.023295 2184 webserver.cc:460] Webserver started at http://127.27.243.253:35489/ using document root <none> and password file <none>
I20260811 08:13:13.023514 2184 fs_manager.cc:359] Metadata directory not provided
I20260811 08:13:13.023561 2184 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:13:13.023689 2184 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:13:13.024786 2184 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435717191469-28623-0/minicluster-data/master-1/data/instance:
uuid: "4454c00976854696b8c2478a02ca85b3"
format_stamp: "Formatted at 2026-08-11 08:13:13 on dist-test-slave-7lbf"
server_key: "d7f600a3e001e96468075d42021fd5c3"
server_key_iv: "a772952f1bd62faf9fc581f0689c50d3"
server_key_version: "encryptionkey@0"
I20260811 08:13:13.025131 2184 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435717191469-28623-0/minicluster-data/master-1/wal/instance:
uuid: "4454c00976854696b8c2478a02ca85b3"
format_stamp: "Formatted at 2026-08-11 08:13:13 on dist-test-slave-7lbf"
server_key: "d7f600a3e001e96468075d42021fd5c3"
server_key_iv: "a772952f1bd62faf9fc581f0689c50d3"
server_key_version: "encryptionkey@0"
I20260811 08:13:13.026458 2184 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 08:13:13.027145 2206 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:13.027292 2184 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 08:13:13.027374 2184 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435717191469-28623-0/minicluster-data/master-1/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435717191469-28623-0/minicluster-data/master-1/wal
uuid: "4454c00976854696b8c2478a02ca85b3"
format_stamp: "Formatted at 2026-08-11 08:13:13 on dist-test-slave-7lbf"
server_key: "d7f600a3e001e96468075d42021fd5c3"
server_key_iv: "a772952f1bd62faf9fc581f0689c50d3"
server_key_version: "encryptionkey@0"
I20260811 08:13:13.027436 2184 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435717191469-28623-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435717191469-28623-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435717191469-28623-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:13:13.033126 2170 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.243.253" port: 38941 } attempt: 2
I20260811 08:13:13.033557 2174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:13.033397 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.253:38941 (local address 127.0.0.1:50886)
0811 08:13:13.033458 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:13.033503 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.253:38941: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260811 08:13:13.033900 2174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:13.033820 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.253:38941 (local address 127.0.0.1:50890)
0811 08:13:13.033859 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:13.033884 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.253:38941: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260811 08:13:13.033987 2170 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.27.243.253:38941: Network error: Client connection negotiation failed: client connection to 127.27.243.253:38941: connect: Connection refused (error 111)
I20260811 08:13:13.043738 2184 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:13:13.045645 2184 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:13:13.045766 2184 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:13:13.049541 2184 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.253:38941
I20260811 08:13:13.049605 2290 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.253:38941 every 8 connection(s)
I20260811 08:13:13.049933 2184 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435717191469-28623-0/minicluster-data/master-1/data/info.pb
I20260811 08:13:13.050791 2292 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:13:13.052376 2292 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.243.254" port: 33529 } has no permanent_uuid. Determining permanent_uuid...
I20260811 08:13:13.054453 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 2184
I20260811 08:13:13.054549 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435717191469-28623-0/minicluster-data/master-1/wal/instance
I20260811 08:13:13.054733 28623 external_mini_cluster.cc:1428] Setting key fddc2a89ca2bc34e422d77682835ffe9
Aug 11 08:13:13 dist-test-slave-7lbf krb5kdc[2035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435993, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.253@KRBTEST.COM for kudu/127.27.243.254@KRBTEST.COM
I20260811 08:13:13.061482 2176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:13.053054 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58862 (local address 127.27.243.254:33529)
0811 08:13:13.053113 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:13.053116 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:13.053292 (+ 176us) server_negotiation.cc:407] Connection header received
0811 08:13:13.053832 (+ 540us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:13.053834 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:13.053850 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:13.053900 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:13.054495 (+ 595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:13.055061 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:13.056027 (+ 966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:13.056315 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:13.056375 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:13.058518 (+ 2143us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:13.058520 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:13.058520 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:13.058527 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:13.059946 (+ 1419us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:13.060485 (+ 539us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:13.060487 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:13.060487 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:13.060545 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:13.060815 (+ 270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:13.060815 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:13.060816 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:13.060969 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:13.061017 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:13.061353 (+ 336us) server_negotiation.cc:299] Negotiation successful
0811 08:13:13.061417 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 08:13:13.061760 2294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:13.053015 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:33529 (local address 127.0.0.1:58862)
0811 08:13:13.053179 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:13.053214 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:13.053728 (+ 514us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:13.053967 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:13.053970 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:13.054204 (+ 234us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:13:13.054403 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:13.054407 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:13.055153 (+ 746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:13.055154 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:13.055937 (+ 783us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:13.055940 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:13.056416 (+ 476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:13.056417 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:13.056530 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:13.057002 (+ 472us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:13:13.057010 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:13:13.058411 (+ 1401us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:13:13.060027 (+ 1616us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:13.060036 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:13.060038 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:13.060403 (+ 365us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:13.060606 (+ 203us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:13.060607 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:13.060608 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:13.060747 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:13.061028 (+ 281us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:13:13.061035 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:13:13.061209 (+ 174us) client_negotiation.cc:769] Sending connection context
0811 08:13:13.061343 (+ 134us) client_negotiation.cc:240] Negotiation successful
0811 08:13:13.061533 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":80,"threads_started":1}
I20260811 08:13:13.062345 2292 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.243.253" port: 38941 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.27.243.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.243.252@KRBTEST.COM" created.
Aug 11 08:13:13 dist-test-slave-7lbf krb5kdc[2035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435993, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.253@KRBTEST.COM for kudu/127.27.243.253@KRBTEST.COM
I20260811 08:13:13.069617 2294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:13.062578 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.253:38941 (local address 127.0.0.1:50904)
0811 08:13:13.062627 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:13.062639 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:13.062684 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:13.062943 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:13.062944 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:13.063077 (+ 133us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:13:13.063144 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:13.063146 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:13.064016 (+ 870us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:13.064017 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:13.064596 (+ 579us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:13.064598 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:13.065051 (+ 453us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:13.065051 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:13.065101 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:13.065414 (+ 313us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:13:13.065418 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:13:13.066686 (+ 1268us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:13:13.068443 (+ 1757us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:13.068444 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:13.068445 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:13.068607 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:13.068839 (+ 232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:13.068841 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:13.068841 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:13.068912 (+ 71us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:13.069270 (+ 358us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:13:13.069271 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:13:13.069336 (+ 65us) client_negotiation.cc:769] Sending connection context
0811 08:13:13.069408 (+ 72us) client_negotiation.cc:240] Negotiation successful
0811 08:13:13.069506 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
I20260811 08:13:13.069799 2298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:13.062635 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50904 (local address 127.27.243.253:38941)
0811 08:13:13.062766 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:13.062770 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:13.062789 (+ 19us) server_negotiation.cc:407] Connection header received
0811 08:13:13.062808 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:13.062810 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:13.062820 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:13.062915 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:13.063215 (+ 300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:13.063945 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:13.064666 (+ 721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:13.064995 (+ 329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:13.065046 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:13.066759 (+ 1713us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:13.066768 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:13.066768 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:13.066774 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:13.068349 (+ 1575us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:13.068684 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:13.068687 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:13.068688 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:13.068751 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:13.069030 (+ 279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:13.069031 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:13.069032 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:13.069189 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:13.069261 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:13.069439 (+ 178us) server_negotiation.cc:299] Negotiation successful
0811 08:13:13.069589 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":51,"server-negotiator.queue_time_us":103,"thread_start_us":66,"threads_started":1}
I20260811 08:13:13.070432 2292 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.243.252" port: 44337 } has no permanent_uuid. Determining permanent_uuid...
I20260811 08:13:13.070785 2294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:13.070663 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.252:44337 (local address 127.0.0.1:48272)
0811 08:13:13.070708 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:13.070763 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.252:44337: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260811 08:13:13.070930 2207 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.27.243.252:44337: connect: Connection refused (error 111)
I20260811 08:13:13.071364 2294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:13.071255 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.252:44337 (local address 127.0.0.1:48276)
0811 08:13:13.071310 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:13.071342 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.252:44337: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260811 08:13:13.071478 2292 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.27.243.252:44337: Network error: Client connection negotiation failed: client connection to 127.27.243.252:44337: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.243.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.252.keytab.
Entry for principal kudu/127.27.243.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.252.keytab.
I20260811 08:13:13.081914 28623 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0_GQGb/build/release/bin/kudu
/tmp/dist-test-task0_GQGb/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435717191469-28623-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435717191469-28623-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435717191469-28623-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435717191469-28623-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.243.252:44337
--webserver_interface=127.27.243.252
--webserver_port=0
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.252.keytab
--principal=kudu/127.27.243.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.243.212:46863
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.243.254:33529,127.27.243.253:38941,127.27.243.252:44337
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435717191469-28623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435717191469-28623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435717191469-28623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 08:13:13.120700 2292 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.243.252" port: 44337 } attempt: 1
I20260811 08:13:13.121184 2294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:13.121065 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.252:44337 (local address 127.0.0.1:48278)
0811 08:13:13.121119 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:13.121153 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.252:44337: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260811 08:13:13.121579 2294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:13.121461 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.252:44337 (local address 127.0.0.1:48280)
0811 08:13:13.121503 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:13.121552 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.252:44337: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260811 08:13:13.121675 2292 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.27.243.252:44337: Network error: Client connection negotiation failed: client connection to 127.27.243.252:44337: connect: Connection refused (error 111)
I20260811 08:13:13.125137 2170 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.243.253" port: 38941 } attempt: 3
Aug 11 08:13:13 dist-test-slave-7lbf krb5kdc[2035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435992, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.254@KRBTEST.COM for kudu/127.27.243.253@KRBTEST.COM
I20260811 08:13:13.132133 2174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:13.125479 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.253:38941 (local address 127.0.0.1:50918)
0811 08:13:13.125555 (+ 76us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:13.125566 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:13.125621 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:13.125782 (+ 161us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:13.125783 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:13.125946 (+ 163us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:13:13.126024 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:13.126025 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:13.126742 (+ 717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:13.126744 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:13.127299 (+ 555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:13.127302 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:13.127684 (+ 382us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:13.127685 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:13.127762 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:13.128209 (+ 447us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:13:13.128213 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:13:13.129467 (+ 1254us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:13:13.131196 (+ 1729us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:13.131198 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:13.131198 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:13.131374 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:13.131551 (+ 177us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:13.131552 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:13.131553 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:13.131609 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:13.131824 (+ 215us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:13:13.131825 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:13:13.131872 (+ 47us) client_negotiation.cc:769] Sending connection context
0811 08:13:13.131933 (+ 61us) client_negotiation.cc:240] Negotiation successful
0811 08:13:13.132037 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":54}
I20260811 08:13:13.132130 2298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:13.125586 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50918 (local address 127.27.243.253:38941)
0811 08:13:13.125642 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:13.125644 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:13.125654 (+ 10us) server_negotiation.cc:407] Connection header received
0811 08:13:13.125684 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:13.125685 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:13.125697 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:13.125762 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:13.126123 (+ 361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:13.126653 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:13.127384 (+ 731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:13.127613 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:13.127679 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:13.129633 (+ 1954us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:13.129634 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:13.129635 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:13.129643 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:13.131116 (+ 1473us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:13.131441 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:13.131442 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:13.131443 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:13.131496 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:13.131657 (+ 161us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:13.131658 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:13.131659 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:13.131768 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:13.131831 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:13.131959 (+ 128us) server_negotiation.cc:299] Negotiation successful
0811 08:13:13.132037 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260811 08:13:13.132597 2170 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.243.252" port: 44337 } has no permanent_uuid. Determining permanent_uuid...
I20260811 08:13:13.132903 2174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:13.132824 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.252:44337 (local address 127.0.0.1:48292)
0811 08:13:13.132857 (+ 33us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:13.132885 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.252:44337: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":18}
I20260811 08:13:13.133224 2174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:13.133138 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.252:44337 (local address 127.0.0.1:48294)
0811 08:13:13.133177 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:13.133200 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.252:44337: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260811 08:13:13.133304 2170 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.27.243.252:44337: Network error: Client connection negotiation failed: client connection to 127.27.243.252:44337: connect: Connection refused (error 111)
I20260811 08:13:13.164438 2170 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.243.252" port: 44337 } attempt: 1
I20260811 08:13:13.164870 2174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:13.164752 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.252:44337 (local address 127.0.0.1:48298)
0811 08:13:13.164803 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:13.164835 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.252:44337: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
I20260811 08:13:13.165189 2174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:13.165109 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.252:44337 (local address 127.0.0.1:48308)
0811 08:13:13.165148 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:13.165172 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.252:44337: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
W20260811 08:13:13.165288 2170 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.27.243.252:44337: Network error: Client connection negotiation failed: client connection to 127.27.243.252:44337: connect: Connection refused (error 111)
W20260811 08:13:13.165234 2301 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 08:13:13.165481 2301 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:13:13.165529 2301 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:13:13.165566 2301 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:13:13.166744 2301 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:13:13.166785 2301 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:13:13.166803 2301 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:13:13.166819 2301 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:13:13.166849 2301 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:13:13.168358 2301 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.243.212:46863
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435717191469-28623-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435717191469-28623-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.27.243.254:33529,127.27.243.253:38941,127.27.243.252:44337
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435717191469-28623-0/krb5kdc/kudu_127.27.243.252.keytab
--principal=kudu/127.27.243.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.243.252:44337
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435717191469-28623-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.27.243.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2301
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435717191469-28623-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:13:13.168612 2301 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:13:13.168829 2301 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:13:13.173497 2310 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:13:13.173556 2307 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:13:13.173556 2308 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:13:13.173769 2301 server_base.cc:1034] running on GCE node
I20260811 08:13:13.174022 2301 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:13:13.174288 2301 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:13:13.175429 2301 hybrid_clock.cc:648] HybridClock initialized: now 1786435993175410 us; error 34 us; skew 500 ppm
Aug 11 08:13:13 dist-test-slave-7lbf krb5kdc[2035](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435993, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:13:13.177871 2301 init.cc:377] Logged in from keytab as kudu/127.27.243.252@KRBTEST.COM (short username kudu)
I20260811 08:13:13.178319 2301 webserver.cc:460] Webserver started at http://127.27.243.252:40021/ using document root <none> and password file <none>
I20260811 08:13:13.178535 2301 fs_manager.cc:359] Metadata directory not provided
I20260811 08:13:13.178577 2301 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:13:13.178671 2301 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:13:13.179719 2301 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435717191469-28623-0/minicluster-data/master-2/data/instance:
uuid: "84864c47e9a14ae0a7ab592950e66d0d"
format_stamp: "Formatted at 2026-08-11 08:13:13 on dist-test-slave-7lbf"
server_key: "8f40b6bd5de26e29aef5de1e5c81091e"
server_key_iv: "5a5b8b7f0374aa63bba85ea08a6eb9cd"
server_key_version: "encryptionkey@0"
I20260811 08:13:13.180028 2301 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435717191469-28623-0/minicluster-data/master-2/wal/instance:
uuid: "84864c47e9a14ae0a7ab592950e66d0d"
format_stamp: "Formatted at 2026-08-11 08:13:13 on dist-test-slave-7lbf"
server_key: "8f40b6bd5de26e29aef5de1e5c81091e"
server_key_iv: "5a5b8b7f0374aa63bba85ea08a6eb9cd"
server_key_version: "encryptionkey@0"
I20260811 08:13:13.181213 2301 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 08:13:13.181921 2321 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:13.182103 2301 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:13.182197 2301 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435717191469-28623-0/minicluster-data/master-2/data,/tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435717191469-28623-0/minicluster-data/master-2/wal
uuid: "84864c47e9a14ae0a7ab592950e66d0d"
format_stamp: "Formatted at 2026-08-11 08:13:13 on dist-test-slave-7lbf"
server_key: "8f40b6bd5de26e29aef5de1e5c81091e"
server_key_iv: "5a5b8b7f0374aa63bba85ea08a6eb9cd"
server_key_version: "encryptionkey@0"
I20260811 08:13:13.182258 2301 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435717191469-28623-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435717191469-28623-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435717191469-28623-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:13:13.189316 2301 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:13:13.189802 2292 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.243.252" port: 44337 } attempt: 2
I20260811 08:13:13.190150 2294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:13.190038 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.252:44337 (local address 127.0.0.1:48314)
0811 08:13:13.190089 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:13.190122 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.252:44337: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260811 08:13:13.190452 2294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:13.190368 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.252:44337 (local address 127.0.0.1:48320)
0811 08:13:13.190406 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:13.190430 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.243.252:44337: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
W20260811 08:13:13.190549 2292 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.27.243.252:44337: Network error: Client connection negotiation failed: client connection to 127.27.243.252:44337: connect: Connection refused (error 111)
I20260811 08:13:13.191538 2301 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:13:13.191660 2301 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:13:13.195506 2301 rpc_server.cc:307] RPC server started. Bound to: 127.27.243.252:44337
I20260811 08:13:13.195537 2406 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.243.252:44337 every 8 connection(s)
I20260811 08:13:13.195911 2301 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435717191469-28623-0/minicluster-data/master-2/data/info.pb
I20260811 08:13:13.196808 2407 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:13:13.197216 28623 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0_GQGb/build/release/bin/kudu as pid 2301
I20260811 08:13:13.197342 28623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0_GQGb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435717191469-28623-0/minicluster-data/master-2/wal/instance
I20260811 08:13:13.197589 28623 external_mini_cluster.cc:1428] Setting key a56a9c9777c8440384dff43476ab2334
I20260811 08:13:13.198918 2407 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.243.254" port: 33529 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 08:13:13 dist-test-slave-7lbf krb5kdc[2035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435993, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.252@KRBTEST.COM for kudu/127.27.243.254@KRBTEST.COM
Aug 11 08:13:13 dist-test-slave-7lbf krb5kdc[2035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435992, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.243.252@KRBTEST.COM
I20260811 08:13:13.207917 2176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:13.199596 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58868 (local address 127.27.243.254:33529)
0811 08:13:13.199640 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:13.199641 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:13.199814 (+ 173us) server_negotiation.cc:407] Connection header received
0811 08:13:13.199926 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:13.199926 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:13.199938 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:13.199979 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:13.200535 (+ 556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:13.201026 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:13.201961 (+ 935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:13.202149 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:13.202211 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:13.204878 (+ 2667us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:13.204879 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:13.204879 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:13.204886 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:13.206455 (+ 1569us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:13.206957 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:13.206958 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:13.206959 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:13.207022 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:13.207284 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:13.207285 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:13.207285 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:13.207415 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:13.207471 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:13.207740 (+ 269us) server_negotiation.cc:299] Negotiation successful
0811 08:13:13.207824 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 08:13:13.208159 2412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:13.199534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.254:33529 (local address 127.0.0.1:58868)
0811 08:13:13.199703 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:13.199735 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:13.199810 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:13.199998 (+ 188us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:13.200000 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:13.200336 (+ 336us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:13:13.200451 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:13.200457 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:13.201106 (+ 649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:13.201107 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:13.201888 (+ 781us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:13.201890 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:13.202227 (+ 337us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:13.202228 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:13.202299 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:13.202787 (+ 488us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:13:13.202797 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:13:13.204760 (+ 1963us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:13:13.206550 (+ 1790us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:13.206558 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:13.206560 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:13.206862 (+ 302us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:13.207096 (+ 234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:13.207097 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:13.207097 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:13.207229 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:13.207478 (+ 249us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:13:13.207485 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:13:13.207619 (+ 134us) client_negotiation.cc:769] Sending connection context
0811 08:13:13.207708 (+ 89us) client_negotiation.cc:240] Negotiation successful
0811 08:13:13.207947 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":82,"threads_started":1}
I20260811 08:13:13.208693 2407 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.243.253" port: 38941 } has no permanent_uuid. Determining permanent_uuid...
I20260811 08:13:13.209172 2410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:13.198103 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48332 (local address 127.27.243.252:44337)
0811 08:13:13.198295 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:13.198305 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:13.198348 (+ 43us) server_negotiation.cc:407] Connection header received
0811 08:13:13.198849 (+ 501us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:13.198858 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:13.198919 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:13.199069 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:13.199787 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:13.200897 (+ 1110us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:13.201692 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:13.202098 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:13.202172 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:13.204852 (+ 2680us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:13.204860 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:13.204860 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:13.204884 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:13.208065 (+ 3181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:13.208439 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:13.208441 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:13.208442 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:13.208488 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:13.208674 (+ 186us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:13.208675 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:13.208676 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:13.208808 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:13.208951 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:13.208997 (+ 46us) server_negotiation.cc:299] Negotiation successful
0811 08:13:13.209076 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":145,"thread_start_us":56,"threads_started":1}
Aug 11 08:13:13 dist-test-slave-7lbf krb5kdc[2035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435993, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.252@KRBTEST.COM for kudu/127.27.243.253@KRBTEST.COM
Aug 11 08:13:13 dist-test-slave-7lbf krb5kdc[2035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435992, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.243.254@KRBTEST.COM
I20260811 08:13:13.215260 2412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:13.208950 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.253:38941 (local address 127.0.0.1:50926)
0811 08:13:13.209050 (+ 100us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:13.209060 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:13.209095 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:13.209248 (+ 153us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:13.209249 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:13.209384 (+ 135us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:13:13.209447 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:13.209449 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:13.210287 (+ 838us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:13.210287 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:13.210766 (+ 479us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:13.210767 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:13.211121 (+ 354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:13.211122 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:13.211187 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:13.211530 (+ 343us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:13:13.211534 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:13:13.212664 (+ 1130us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:13:13.214254 (+ 1590us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:13.214255 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:13.214255 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:13.214427 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:13.214625 (+ 198us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:13.214626 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:13.214627 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:13.214681 (+ 54us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:13.214968 (+ 287us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:13:13.214969 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:13:13.215011 (+ 42us) client_negotiation.cc:769] Sending connection context
0811 08:13:13.215077 (+ 66us) client_negotiation.cc:240] Negotiation successful
0811 08:13:13.215165 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":84}
I20260811 08:13:13.215277 2298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:13.209078 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50926 (local address 127.27.243.253:38941)
0811 08:13:13.209128 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:13.209129 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:13.209137 (+ 8us) server_negotiation.cc:407] Connection header received
0811 08:13:13.209163 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:13.209164 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:13.209174 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:13.209230 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:13.209542 (+ 312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:13.210215 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:13.210846 (+ 631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:13.211062 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:13.211119 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:13.212770 (+ 1651us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:13.212771 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:13.212771 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:13.212778 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:13.214183 (+ 1405us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:13.214496 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:13.214497 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:13.214498 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:13.214554 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:13.214743 (+ 189us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:13.214744 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:13.214744 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:13.214899 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:13.214961 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:13.215113 (+ 152us) server_negotiation.cc:299] Negotiation successful
0811 08:13:13.215190 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 08:13:13.215632 2407 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.243.252" port: 44337 } has no permanent_uuid. Determining permanent_uuid...
I20260811 08:13:13.217237 2176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:13.209940 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58878 (local address 127.27.243.254:33529)
0811 08:13:13.209972 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:13.209973 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:13.209982 (+ 9us) server_negotiation.cc:407] Connection header received
0811 08:13:13.210023 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:13.210024 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:13.210031 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:13.210072 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:13.210548 (+ 476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:13.210999 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:13.211747 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:13.211942 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:13.211994 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:13.214408 (+ 2414us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:13.214410 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:13.214410 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:13.214417 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:13.215817 (+ 1400us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:13.216178 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:13.216180 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:13.216180 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:13.216240 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:13.216416 (+ 176us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:13.216417 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:13.216417 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:13.216507 (+ 90us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:13.217030 (+ 523us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:13.217069 (+ 39us) server_negotiation.cc:299] Negotiation successful
0811 08:13:13.217147 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
Aug 11 08:13:13 dist-test-slave-7lbf krb5kdc[2035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435993, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.252@KRBTEST.COM for kudu/127.27.243.252@KRBTEST.COM
Aug 11 08:13:13 dist-test-slave-7lbf krb5kdc[2035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435992, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.243.253@KRBTEST.COM
I20260811 08:13:13.221947 2412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:13.215857 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.252:44337 (local address 127.0.0.1:48342)
0811 08:13:13.215894 (+ 37us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:13.215903 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:13.215936 (+ 33us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:13.216050 (+ 114us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:13.216050 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:13.216154 (+ 104us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:13:13.216185 (+ 31us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:13.216186 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:13.216966 (+ 780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:13.216967 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:13.217671 (+ 704us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:13.217674 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:13.218193 (+ 519us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:13.218194 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:13.218234 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:13.218546 (+ 312us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:13:13.218551 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:13:13.219674 (+ 1123us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:13:13.221056 (+ 1382us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:13.221056 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:13.221057 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:13.221201 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:13.221352 (+ 151us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:13.221353 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:13.221353 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:13.221403 (+ 50us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:13.221660 (+ 257us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:13:13.221661 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:13:13.221699 (+ 38us) client_negotiation.cc:769] Sending connection context
0811 08:13:13.221751 (+ 52us) client_negotiation.cc:240] Negotiation successful
0811 08:13:13.221830 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":23}
I20260811 08:13:13.222016 2410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:13.215911 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48342 (local address 127.27.243.252:44337)
0811 08:13:13.215947 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:13.215948 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:13.215955 (+ 7us) server_negotiation.cc:407] Connection header received
0811 08:13:13.215973 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:13.215974 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:13.215983 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:13.216048 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:13.216249 (+ 201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:13.216908 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:13.217760 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:13.218126 (+ 366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:13.218196 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:13.219742 (+ 1546us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:13.219743 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:13.219744 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:13.219750 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:13.220986 (+ 1236us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:13.221255 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:13.221256 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:13.221256 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:13.221300 (+ 44us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:13.221450 (+ 150us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:13.221451 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:13.221451 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:13.221582 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:13.221641 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:13.221789 (+ 148us) server_negotiation.cc:299] Negotiation successful
0811 08:13:13.221884 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":25,"server-negotiator.queue_time_us":19}
I20260811 08:13:13.223693 2407 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 84864c47e9a14ae0a7ab592950e66d0d: Bootstrap starting.
I20260811 08:13:13.224305 2298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:13.217855 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50930 (local address 127.27.243.253:38941)
0811 08:13:13.217896 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:13.217898 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:13.217905 (+ 7us) server_negotiation.cc:407] Connection header received
0811 08:13:13.217958 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:13.217959 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:13.217967 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:13.218007 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:13.218496 (+ 489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:13.218975 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:13.219635 (+ 660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:13.219816 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:13.219877 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:13.221929 (+ 2052us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:13.221931 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:13.221931 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:13.221938 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:13.223252 (+ 1314us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:13.223635 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:13.223636 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:13.223636 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:13.223692 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:13.223878 (+ 186us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:13.223879 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:13.223879 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:13.223983 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:13.224112 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:13.224184 (+ 72us) server_negotiation.cc:299] Negotiation successful
0811 08:13:13.224245 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 08:13:13.224654 2407 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 84864c47e9a14ae0a7ab592950e66d0d: Neither blocks nor log segments found. Creating new log.
I20260811 08:13:13.224895 2407 log.cc:824] T 00000000000000000000000000000000 P 84864c47e9a14ae0a7ab592950e66d0d: Log is configured to *not* fsync() on all Append() calls
I20260811 08:13:13.225729 2407 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 84864c47e9a14ae0a7ab592950e66d0d: No bootstrap required, opened a new log
I20260811 08:13:13.227159 2407 raft_consensus.cc:348] T 00000000000000000000000000000000 P 84864c47e9a14ae0a7ab592950e66d0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7100e05eb647416ca653a043c0a41651" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 33529 } } peers { permanent_uuid: "4454c00976854696b8c2478a02ca85b3" member_type: VOTER last_known_addr { host: "127.27.243.253" port: 38941 } } peers { permanent_uuid: "84864c47e9a14ae0a7ab592950e66d0d" member_type: VOTER last_known_addr { host: "127.27.243.252" port: 44337 } }
I20260811 08:13:13.227285 2407 raft_consensus.cc:729] T 00000000000000000000000000000000 P 84864c47e9a14ae0a7ab592950e66d0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84864c47e9a14ae0a7ab592950e66d0d, State: Initialized, Role: FOLLOWER
I20260811 08:13:13.227349 2407 consensus_queue.cc:260] T 00000000000000000000000000000000 P 84864c47e9a14ae0a7ab592950e66d0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7100e05eb647416ca653a043c0a41651" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 33529 } } peers { permanent_uuid: "4454c00976854696b8c2478a02ca85b3" member_type: VOTER last_known_addr { host: "127.27.243.253" port: 38941 } } peers { permanent_uuid: "84864c47e9a14ae0a7ab592950e66d0d" member_type: VOTER last_known_addr { host: "127.27.243.252" port: 44337 } }
I20260811 08:13:13.227686 2407 sys_catalog.cc:564] T 00000000000000000000000000000000 P 84864c47e9a14ae0a7ab592950e66d0d [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:13:13.227640 2418 sys_catalog.cc:455] T 00000000000000000000000000000000 P 84864c47e9a14ae0a7ab592950e66d0d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7100e05eb647416ca653a043c0a41651" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 33529 } } peers { permanent_uuid: "4454c00976854696b8c2478a02ca85b3" member_type: VOTER last_known_addr { host: "127.27.243.253" port: 38941 } } peers { permanent_uuid: "84864c47e9a14ae0a7ab592950e66d0d" member_type: VOTER last_known_addr { host: "127.27.243.252" port: 44337 } } }
I20260811 08:13:13.227746 2418 sys_catalog.cc:458] T 00000000000000000000000000000000 P 84864c47e9a14ae0a7ab592950e66d0d [sys.catalog]: This master's current role is: FOLLOWER
W20260811 08:13:13.229343 2444 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 84864c47e9a14ae0a7ab592950e66d0d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 08:13:13.229403 2444 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 08:13:13.229781 28623 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 08:13:13.230715 2128 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "7100e05eb647416ca653a043c0a41651"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58878
I20260811 08:13:13.230485 2301 master_runner.cc:186] Error getting master registration for 127.27.243.254:33529: OK, instance_id { permanent_uuid: "7100e05eb647416ca653a043c0a41651" instance_seqno: 1786435992898679 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 08:13:13.233495 2301 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 08:13:13.240447 2170 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.243.252" port: 44337 } attempt: 2
Aug 11 08:13:13 dist-test-slave-7lbf krb5kdc[2035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435992, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.254@KRBTEST.COM for kudu/127.27.243.252@KRBTEST.COM
I20260811 08:13:13.246747 2410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:13.240845 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48350 (local address 127.27.243.252:44337)
0811 08:13:13.240907 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:13.240909 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:13.240920 (+ 11us) server_negotiation.cc:407] Connection header received
0811 08:13:13.240943 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:13.240944 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:13.240954 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:13.241000 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:13.241287 (+ 287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:13.241799 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:13.242457 (+ 658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:13.242638 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:13.242692 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:13.244415 (+ 1723us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:13.244416 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:13.244416 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:13.244425 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:13.245747 (+ 1322us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:13.246041 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:13.246042 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:13.246042 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:13.246090 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:13.246246 (+ 156us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:13.246247 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:13.246247 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:13.246384 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:13.246442 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:13.246579 (+ 137us) server_negotiation.cc:299] Negotiation successful
0811 08:13:13.246648 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 08:13:13.246747 2174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:13.240772 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.252:44337 (local address 127.0.0.1:48350)
0811 08:13:13.240828 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:13.240840 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:13.240887 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:13.241002 (+ 115us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:13.241003 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:13.241177 (+ 174us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:13:13.241219 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:13.241221 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:13.241878 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:13.241879 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:13.242387 (+ 508us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:13.242389 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:13.242696 (+ 307us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:13.242697 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:13.242751 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:13.243143 (+ 392us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:13:13.243149 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:13:13.244337 (+ 1188us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:13:13.245819 (+ 1482us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:13.245820 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:13.245820 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:13.245981 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:13.246142 (+ 161us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:13.246143 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:13.246144 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:13.246199 (+ 55us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:13.246446 (+ 247us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:13:13.246447 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:13:13.246492 (+ 45us) client_negotiation.cc:769] Sending connection context
0811 08:13:13.246551 (+ 59us) client_negotiation.cc:240] Negotiation successful
0811 08:13:13.246648 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
I20260811 08:13:13.248049 2170 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7100e05eb647416ca653a043c0a41651: Bootstrap starting.
I20260811 08:13:13.248631 2170 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7100e05eb647416ca653a043c0a41651: Neither blocks nor log segments found. Creating new log.
I20260811 08:13:13.248858 2170 log.cc:824] T 00000000000000000000000000000000 P 7100e05eb647416ca653a043c0a41651: Log is configured to *not* fsync() on all Append() calls
I20260811 08:13:13.249560 2170 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7100e05eb647416ca653a043c0a41651: No bootstrap required, opened a new log
I20260811 08:13:13.250557 2170 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7100e05eb647416ca653a043c0a41651 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7100e05eb647416ca653a043c0a41651" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 33529 } } peers { permanent_uuid: "4454c00976854696b8c2478a02ca85b3" member_type: VOTER last_known_addr { host: "127.27.243.253" port: 38941 } } peers { permanent_uuid: "84864c47e9a14ae0a7ab592950e66d0d" member_type: VOTER last_known_addr { host: "127.27.243.252" port: 44337 } }
I20260811 08:13:13.250671 2170 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7100e05eb647416ca653a043c0a41651 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7100e05eb647416ca653a043c0a41651, State: Initialized, Role: FOLLOWER
I20260811 08:13:13.250746 2170 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7100e05eb647416ca653a043c0a41651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7100e05eb647416ca653a043c0a41651" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 33529 } } peers { permanent_uuid: "4454c00976854696b8c2478a02ca85b3" member_type: VOTER last_known_addr { host: "127.27.243.253" port: 38941 } } peers { permanent_uuid: "84864c47e9a14ae0a7ab592950e66d0d" member_type: VOTER last_known_addr { host: "127.27.243.252" port: 44337 } }
I20260811 08:13:13.250988 2448 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7100e05eb647416ca653a043c0a41651 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7100e05eb647416ca653a043c0a41651" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 33529 } } peers { permanent_uuid: "4454c00976854696b8c2478a02ca85b3" member_type: VOTER last_known_addr { host: "127.27.243.253" port: 38941 } } peers { permanent_uuid: "84864c47e9a14ae0a7ab592950e66d0d" member_type: VOTER last_known_addr { host: "127.27.243.252" port: 44337 } } }
I20260811 08:13:13.251052 2170 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7100e05eb647416ca653a043c0a41651 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:13:13.251068 2448 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7100e05eb647416ca653a043c0a41651 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 08:13:13.251194 2128 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7100e05eb647416ca653a043c0a41651 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 08:13:13.251323 2128 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7100e05eb647416ca653a043c0a41651 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:13:13.252188 2128 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7100e05eb647416ca653a043c0a41651 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7100e05eb647416ca653a043c0a41651" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 33529 } } peers { permanent_uuid: "4454c00976854696b8c2478a02ca85b3" member_type: VOTER last_known_addr { host: "127.27.243.253" port: 38941 } } peers { permanent_uuid: "84864c47e9a14ae0a7ab592950e66d0d" member_type: VOTER last_known_addr { host: "127.27.243.252" port: 44337 } }
W20260811 08:13:13.253156 2469 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 7100e05eb647416ca653a043c0a41651: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 08:13:13.253208 2469 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 08:13:13.253361 2366 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7100e05eb647416ca653a043c0a41651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "84864c47e9a14ae0a7ab592950e66d0d"
I20260811 08:13:13.253491 2366 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 84864c47e9a14ae0a7ab592950e66d0d [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:13:13.254398 2366 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 84864c47e9a14ae0a7ab592950e66d0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7100e05eb647416ca653a043c0a41651 in term 1.
I20260811 08:13:13.254714 2088 leader_election.cc:302] T 00000000000000000000000000000000 P 7100e05eb647416ca653a043c0a41651 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7100e05eb647416ca653a043c0a41651, 84864c47e9a14ae0a7ab592950e66d0d; no voters:
I20260811 08:13:13.254864 2448 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7100e05eb647416ca653a043c0a41651 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:13:13.254997 2448 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7100e05eb647416ca653a043c0a41651 [term 1 LEADER]: Becoming Leader. State: Replica: 7100e05eb647416ca653a043c0a41651, State: Running, Role: LEADER
I20260811 08:13:13.255076 2448 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7100e05eb647416ca653a043c0a41651 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7100e05eb647416ca653a043c0a41651" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 33529 } } peers { permanent_uuid: "4454c00976854696b8c2478a02ca85b3" member_type: VOTER last_known_addr { host: "127.27.243.253" port: 38941 } } peers { permanent_uuid: "84864c47e9a14ae0a7ab592950e66d0d" member_type: VOTER last_known_addr { host: "127.27.243.252" port: 44337 } }
I20260811 08:13:13.255489 2448 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7100e05eb647416ca653a043c0a41651 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7100e05eb647416ca653a043c0a41651. Latest consensus state: current_term: 1 leader_uuid: "7100e05eb647416ca653a043c0a41651" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7100e05eb647416ca653a043c0a41651" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 33529 } } peers { permanent_uuid: "4454c00976854696b8c2478a02ca85b3" member_type: VOTER last_known_addr { host: "127.27.243.253" port: 38941 } } peers { permanent_uuid: "84864c47e9a14ae0a7ab592950e66d0d" member_type: VOTER last_known_addr { host: "127.27.243.252" port: 44337 } } }
I20260811 08:13:13.255571 2448 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7100e05eb647416ca653a043c0a41651 [sys.catalog]: This master's current role is: LEADER
I20260811 08:13:13.255704 2128 leader_election.cc:288] T 00000000000000000000000000000000 P 7100e05eb647416ca653a043c0a41651 [CANDIDATE]: Term 1 election: Requested vote from peers 4454c00976854696b8c2478a02ca85b3 (127.27.243.253:38941), 84864c47e9a14ae0a7ab592950e66d0d (127.27.243.252:44337)
I20260811 08:13:13.253953 2057 master_runner.cc:186] Error getting master registration for 127.27.243.253:38941: OK, instance_id { permanent_uuid: "4454c00976854696b8c2478a02ca85b3" instance_seqno: 1786435993048456 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 08:13:13.256211 2057 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 08:13:13.257192 2474 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:13:13.257428 2474 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:13:13.261093 2366 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 84864c47e9a14ae0a7ab592950e66d0d [term 1 FOLLOWER]: Refusing update from remote peer 7100e05eb647416ca653a043c0a41651: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:13:13.261593 2471 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 7100e05eb647416ca653a043c0a41651 [LEADER]: Connected to new peer: Peer: permanent_uuid: "84864c47e9a14ae0a7ab592950e66d0d" member_type: VOTER last_known_addr { host: "127.27.243.252" port: 44337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:13:13.263195 2418 sys_catalog.cc:455] T 00000000000000000000000000000000 P 84864c47e9a14ae0a7ab592950e66d0d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7100e05eb647416ca653a043c0a41651. Latest consensus state: current_term: 1 leader_uuid: "7100e05eb647416ca653a043c0a41651" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7100e05eb647416ca653a043c0a41651" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 33529 } } peers { permanent_uuid: "4454c00976854696b8c2478a02ca85b3" member_type: VOTER last_known_addr { host: "127.27.243.253" port: 38941 } } peers { permanent_uuid: "84864c47e9a14ae0a7ab592950e66d0d" member_type: VOTER last_known_addr { host: "127.27.243.252" port: 44337 } } }
I20260811 08:13:13.263305 2418 sys_catalog.cc:458] T 00000000000000000000000000000000 P 84864c47e9a14ae0a7ab592950e66d0d [sys.catalog]: This master's current role is: FOLLOWER
I20260811 08:13:13.271000 2471 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7100e05eb647416ca653a043c0a41651 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "7100e05eb647416ca653a043c0a41651" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7100e05eb647416ca653a043c0a41651" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 33529 } } peers { permanent_uuid: "4454c00976854696b8c2478a02ca85b3" member_type: VOTER last_known_addr { host: "127.27.243.253" port: 38941 } } peers { permanent_uuid: "84864c47e9a14ae0a7ab592950e66d0d" member_type: VOTER last_known_addr { host: "127.27.243.252" port: 44337 } } }
I20260811 08:13:13.271116 2471 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7100e05eb647416ca653a043c0a41651 [sys.catalog]: This master's current role is: LEADER
I20260811 08:13:13.271499 2298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:13.256819 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50936 (local address 127.27.243.253:38941)
0811 08:13:13.256869 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:13.256871 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:13.259019 (+ 2148us) server_negotiation.cc:407] Connection header received
0811 08:13:13.259124 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:13.259126 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:13.259139 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:13.259171 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:13.259969 (+ 798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:13.260728 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:13.263104 (+ 2376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:13.263409 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:13.263458 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:13.268067 (+ 4609us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:13.268068 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:13.268069 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:13.268077 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:13.269657 (+ 1580us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:13.270044 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:13.270045 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:13.270046 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:13.270104 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:13.270896 (+ 792us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:13.270897 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:13.270897 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:13.271039 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:13.271118 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:13.271319 (+ 201us) server_negotiation.cc:299] Negotiation successful
0811 08:13:13.271402 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260811 08:13:13.271647 2418 sys_catalog.cc:455] T 00000000000000000000000000000000 P 84864c47e9a14ae0a7ab592950e66d0d [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "7100e05eb647416ca653a043c0a41651" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7100e05eb647416ca653a043c0a41651" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 33529 } } peers { permanent_uuid: "4454c00976854696b8c2478a02ca85b3" member_type: VOTER last_known_addr { host: "127.27.243.253" port: 38941 } } peers { permanent_uuid: "84864c47e9a14ae0a7ab592950e66d0d" member_type: VOTER last_known_addr { host: "127.27.243.252" port: 44337 } } }
I20260811 08:13:13.271730 2418 sys_catalog.cc:458] T 00000000000000000000000000000000 P 84864c47e9a14ae0a7ab592950e66d0d [sys.catalog]: This master's current role is: FOLLOWER
I20260811 08:13:13.272270 2484 mvcc.cc:205] Tried to move back new op lower bound from 7317241828392067072 to 7317241828373524480. Current Snapshot: MvccSnapshot[applied={T|T < 7317241828392067072}]
I20260811 08:13:13.275560 2176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:13.257068 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58888 (local address 127.27.243.254:33529)
0811 08:13:13.257101 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:13.257102 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:13.262096 (+ 4994us) server_negotiation.cc:407] Connection header received
0811 08:13:13.262187 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:13.262188 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:13.262198 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:13.262226 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:13.263931 (+ 1705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:13.264661 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:13.267359 (+ 2698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:13.267674 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:13.267713 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:13.272162 (+ 4449us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:13.272163 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:13.272163 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:13.272171 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:13.274058 (+ 1887us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:13.274712 (+ 654us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:13.274713 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:13.274713 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:13.274774 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:13.274970 (+ 196us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:13.274971 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:13.274971 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:13.275098 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:13.275188 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:13.275388 (+ 200us) server_negotiation.cc:299] Negotiation successful
0811 08:13:13.275471 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260811 08:13:13.277223 2410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:13.257752 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48352 (local address 127.27.243.252:44337)
0811 08:13:13.257787 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:13.257789 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:13.263009 (+ 5220us) server_negotiation.cc:407] Connection header received
0811 08:13:13.263811 (+ 802us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:13.263812 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:13.263824 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:13.263863 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:13.265412 (+ 1549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:13.266154 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:13.267920 (+ 1766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:13.268766 (+ 846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:13.269049 (+ 283us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:13.273614 (+ 4565us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:13.273615 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:13.273615 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:13.273623 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:13.275176 (+ 1553us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:13.276096 (+ 920us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:13.276097 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:13.276097 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:13.276155 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:13.276491 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:13.276492 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:13.276493 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:13.276618 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:13.276693 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:13.277053 (+ 360us) server_negotiation.cc:299] Negotiation successful
0811 08:13:13.277133 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 08:13:13.278489 2474 catalog_manager.cc:1347] Generated new cluster ID: 7eff327dcfee4a64a12d6dc16d5468be
I20260811 08:13:13.278548 2474 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:13:13.281677 2292 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.243.252" port: 44337 } attempt: 3
Aug 11 08:13:13 dist-test-slave-7lbf krb5kdc[2035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435993, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.243.253@KRBTEST.COM for kudu/127.27.243.252@KRBTEST.COM
I20260811 08:13:13.290452 2294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:13.281914 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.243.252:44337 (local address 127.0.0.1:48366)
0811 08:13:13.281998 (+ 84us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:13.282007 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:13.282042 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:13.282369 (+ 327us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:13.282370 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:13.282532 (+ 162us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:13:13.282577 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:13.282579 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:13.283520 (+ 941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:13.283521 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:13.284358 (+ 837us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:13.284361 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:13.284933 (+ 572us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:13.284934 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:13.285010 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:13.285464 (+ 454us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:13:13.285469 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:13:13.287188 (+ 1719us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:13:13.288998 (+ 1810us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:13.289000 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:13.289000 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:13.289218 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:13.289588 (+ 370us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:13.289589 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:13.289589 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:13.289663 (+ 74us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:13.290125 (+ 462us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:13:13.290126 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:13:13.290185 (+ 59us) client_negotiation.cc:769] Sending connection context
0811 08:13:13.290241 (+ 56us) client_negotiation.cc:240] Negotiation successful
0811 08:13:13.290347 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":67}
I20260811 08:13:13.291391 2410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:13.282115 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48366 (local address 127.27.243.252:44337)
0811 08:13:13.282221 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:13.282223 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:13.282230 (+ 7us) server_negotiation.cc:407] Connection header received
0811 08:13:13.282264 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:13.282264 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:13.282273 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:13.282326 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:13.282672 (+ 346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:13.283414 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:13.284476 (+ 1062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:13.284800 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:13.284854 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:13.287292 (+ 2438us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:13.287293 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:13.287293 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:13.287300 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:13.288892 (+ 1592us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:13.289305 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:13.289306 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:13.289306 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:13.289435 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:13.289745 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:13.289746 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:13.289747 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:13.289994 (+ 247us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:13.290998 (+ 1004us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:13.291069 (+ 71us) server_negotiation.cc:299] Negotiation successful
0811 08:13:13.291203 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260811 08:13:13.293187 2292 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4454c00976854696b8c2478a02ca85b3: Bootstrap starting.
I20260811 08:13:13.294510 2292 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4454c00976854696b8c2478a02ca85b3: Neither blocks nor log segments found. Creating new log.
I20260811 08:13:13.294811 2292 log.cc:824] T 00000000000000000000000000000000 P 4454c00976854696b8c2478a02ca85b3: Log is configured to *not* fsync() on all Append() calls
I20260811 08:13:13.295853 2292 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4454c00976854696b8c2478a02ca85b3: No bootstrap required, opened a new log
I20260811 08:13:13.297895 2292 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4454c00976854696b8c2478a02ca85b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7100e05eb647416ca653a043c0a41651" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 33529 } } peers { permanent_uuid: "4454c00976854696b8c2478a02ca85b3" member_type: VOTER last_known_addr { host: "127.27.243.253" port: 38941 } } peers { permanent_uuid: "84864c47e9a14ae0a7ab592950e66d0d" member_type: VOTER last_known_addr { host: "127.27.243.252" port: 44337 } }
I20260811 08:13:13.298038 2292 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4454c00976854696b8c2478a02ca85b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4454c00976854696b8c2478a02ca85b3, State: Initialized, Role: FOLLOWER
I20260811 08:13:13.298112 2292 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4454c00976854696b8c2478a02ca85b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7100e05eb647416ca653a043c0a41651" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 33529 } } peers { permanent_uuid: "4454c00976854696b8c2478a02ca85b3" member_type: VOTER last_known_addr { host: "127.27.243.253" port: 38941 } } peers { permanent_uuid: "84864c47e9a14ae0a7ab592950e66d0d" member_type: VOTER last_known_addr { host: "127.27.243.252" port: 44337 } }
I20260811 08:13:13.298437 2292 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4454c00976854696b8c2478a02ca85b3 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:13:13.298599 2250 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7100e05eb647416ca653a043c0a41651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "4454c00976854696b8c2478a02ca85b3"
I20260811 08:13:13.298729 2250 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4454c00976854696b8c2478a02ca85b3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:13:13.299573 2250 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 4454c00976854696b8c2478a02ca85b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7100e05eb647416ca653a043c0a41651 in term 1.
I20260811 08:13:13.299926 2249 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 4454c00976854696b8c2478a02ca85b3 [term 1 FOLLOWER]: Refusing update from remote peer 7100e05eb647416ca653a043c0a41651: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:13:13.300310 2471 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 7100e05eb647416ca653a043c0a41651 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4454c00976854696b8c2478a02ca85b3" member_type: VOTER last_known_addr { host: "127.27.243.253" port: 38941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:13:13.300338 2474 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:13:13.303351 2474 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:13:13.306059 2517 mvcc.cc:205] Tried to move back new op lower bound from 7317241828525441024 to 7317241828373524480. Current Snapshot: MvccSnapshot[applied={T|T < 7317241828392067072}]
I20260811 08:13:13.306936 2515 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4454c00976854696b8c2478a02ca85b3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7100e05eb647416ca653a043c0a41651" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7100e05eb647416ca653a043c0a41651" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 33529 } } peers { permanent_uuid: "4454c00976854696b8c2478a02ca85b3" member_type: VOTER last_known_addr { host: "127.27.243.253" port: 38941 } } peers { permanent_uuid: "84864c47e9a14ae0a7ab592950e66d0d" member_type: VOTER last_known_addr { host: "127.27.243.252" port: 44337 } } }
I20260811 08:13:13.307096 2515 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4454c00976854696b8c2478a02ca85b3 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 08:13:13.307186 2515 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4454c00976854696b8c2478a02ca85b3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7100e05eb647416ca653a043c0a41651. Latest consensus state: current_term: 1 leader_uuid: "7100e05eb647416ca653a043c0a41651" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7100e05eb647416ca653a043c0a41651" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 33529 } } peers { permanent_uuid: "4454c00976854696b8c2478a02ca85b3" member_type: VOTER last_known_addr { host: "127.27.243.253" port: 38941 } } peers { permanent_uuid: "84864c47e9a14ae0a7ab592950e66d0d" member_type: VOTER last_known_addr { host: "127.27.243.252" port: 44337 } } }
I20260811 08:13:13.307292 2515 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4454c00976854696b8c2478a02ca85b3 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 08:13:13.307372 2515 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4454c00976854696b8c2478a02ca85b3 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "7100e05eb647416ca653a043c0a41651" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7100e05eb647416ca653a043c0a41651" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 33529 } } peers { permanent_uuid: "4454c00976854696b8c2478a02ca85b3" member_type: VOTER last_known_addr { host: "127.27.243.253" port: 38941 } } peers { permanent_uuid: "84864c47e9a14ae0a7ab592950e66d0d" member_type: VOTER last_known_addr { host: "127.27.243.252" port: 44337 } } }
I20260811 08:13:13.307458 2515 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4454c00976854696b8c2478a02ca85b3 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 08:13:13.308477 2471 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7100e05eb647416ca653a043c0a41651 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "7100e05eb647416ca653a043c0a41651" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7100e05eb647416ca653a043c0a41651" member_type: VOTER last_known_addr { host: "127.27.243.254" port: 33529 } } peers { permanent_uuid: "4454c00976854696b8c2478a02ca85b3" member_type: VOTER last_known_addr { host: "127.27.243.253" port: 38941 } } peers { permanent_uuid: "84864c47e9a14ae0a7ab592950e66d0d" member_type: VOTER last_known_addr { host: "127.27.243.252" port: 44337 } } }
I20260811 08:13:13.308573 2471 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7100e05eb647416ca653a043c0a41651 [sys.catalog]: This master's current role is: LEADER
I20260811 08:13:13.309942 2474 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7100e05eb647416ca653a043c0a41651: Generated new TSK 0
I20260811 08:13:13.310130 2474 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 08:13:13.311544 2514 catalog_manager.cc:1259] Loaded cluster ID: 7eff327dcfee4a64a12d6dc16d5468be
I20260811 08:13:13.311595 2514 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 4454c00976854696b8c2478a02ca85b3: loading cluster ID for follower catalog manager: success
I20260811 08:13:13.312754 2514 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 4454c00976854696b8c2478a02ca85b3: acquiring CA information for follower catalog manager: success
I20260811 08:13:13.313150 2514 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 4454c00976854696b8c2478a02ca85b3: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260811 08:13:13.336369 2298 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:13:13.334971 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50940 (local address 127.27.243.253:38941)
0811 08:13:13.335029 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:13.335031 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:13.335685 (+ 654us) server_negotiation.cc:407] Connection header received
0811 08:13:13.335785 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:13.335786 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:13.335798 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:13.335826 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:13.336281 (+ 455us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50940: BlockingRecv error: recv got EOF from 127.0.0.1:50940 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
W20260811 08:13:13.337291 2176 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:13:13.335402 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58894 (local address 127.27.243.254:33529)
0811 08:13:13.335440 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:13.335442 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:13.336794 (+ 1352us) server_negotiation.cc:407] Connection header received
0811 08:13:13.336886 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:13.336887 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:13.336898 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:13.336925 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:13.337228 (+ 303us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58894: BlockingRecv error: recv got EOF from 127.0.0.1:58894 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260811 08:13:13.338485 2410 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:13:13.337801 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48376 (local address 127.27.243.252:44337)
0811 08:13:13.337845 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:13.337847 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:13.337970 (+ 123us) server_negotiation.cc:407] Connection header received
0811 08:13:13.338058 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:13.338059 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:13.338071 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:13.338100 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:13.338425 (+ 325us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48376: BlockingRecv error: recv got EOF from 127.0.0.1:48376 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 08:13:13.343935 2298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:13.340430 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50942 (local address 127.27.243.253:38941)
0811 08:13:13.340465 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:13.340466 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:13.340655 (+ 189us) server_negotiation.cc:407] Connection header received
0811 08:13:13.340767 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:13.340768 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:13.340817 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:13.340866 (+ 49us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:13:13.341099 (+ 233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:13.341910 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:13.343004 (+ 1094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:13.343293 (+ 289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:13.343345 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:13.343567 (+ 222us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:13:13.343696 (+ 129us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:13:13.343742 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:13.343848 (+ 106us) server_negotiation.cc:299] Negotiation successful
0811 08:13:13.343867 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
W20260811 08:13:13.347240 2410 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:13:13.346511 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48388 (local address 127.27.243.252:44337)
0811 08:13:13.346548 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:13.346550 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:13.346714 (+ 164us) server_negotiation.cc:407] Connection header received
0811 08:13:13.346814 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:13.346815 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:13.346835 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:13.346864 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:13.347188 (+ 324us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48388: BlockingRecv error: recv got EOF from 127.0.0.1:48388 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 08:13:13.352941 2298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:13.349619 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50956 (local address 127.27.243.253:38941)
0811 08:13:13.349655 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:13.349657 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:13.349916 (+ 259us) server_negotiation.cc:407] Connection header received
0811 08:13:13.350013 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:13.350014 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:13.350024 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:13.350051 (+ 27us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:13:13.350210 (+ 159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:13.350955 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:13.352138 (+ 1183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:13.352429 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:13.352476 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:13.352677 (+ 201us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:13:13.352713 (+ 36us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:13:13.352741 (+ 28us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:13.352848 (+ 107us) server_negotiation.cc:299] Negotiation successful
0811 08:13:13.352870 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
W20260811 08:13:13.356448 2410 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:13:13.355677 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48394 (local address 127.27.243.252:44337)
0811 08:13:13.355716 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:13.355718 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:13.355905 (+ 187us) server_negotiation.cc:407] Connection header received
0811 08:13:13.356003 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:13.356004 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:13.356015 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:13.356044 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:13.356398 (+ 354us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48394: BlockingRecv error: recv got EOF from 127.0.0.1:48394 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 08:13:13.363289 2298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:13.359969 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50972 (local address 127.27.243.253:38941)
0811 08:13:13.360007 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:13.360008 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:13.360256 (+ 248us) server_negotiation.cc:407] Connection header received
0811 08:13:13.360367 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:13.360368 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:13.360379 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:13.360408 (+ 29us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:13:13.360575 (+ 167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:13.361274 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:13.362406 (+ 1132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:13.362780 (+ 374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:13.362828 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:13.363031 (+ 203us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:13:13.363067 (+ 36us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:13:13.363093 (+ 26us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:13.363196 (+ 103us) server_negotiation.cc:299] Negotiation successful
0811 08:13:13.363218 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
W20260811 08:13:13.366634 2410 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:13:13.365862 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48400 (local address 127.27.243.252:44337)
0811 08:13:13.365899 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:13.365901 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:13.366084 (+ 183us) server_negotiation.cc:407] Connection header received
0811 08:13:13.366183 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:13.366184 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:13.366196 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:13.366224 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:13.366583 (+ 359us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48400: BlockingRecv error: recv got EOF from 127.0.0.1:48400 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
I20260811 08:13:13.375284 2298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:13.371907 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50976 (local address 127.27.243.253:38941)
0811 08:13:13.371947 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:13.371949 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:13.372209 (+ 260us) server_negotiation.cc:407] Connection header received
0811 08:13:13.372309 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:13.372310 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:13.372333 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:13.372361 (+ 28us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:13:13.372538 (+ 177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:13.373257 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:13.374494 (+ 1237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:13.374781 (+ 287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:13.374824 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:13.375027 (+ 203us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:13:13.375064 (+ 37us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:13:13.375091 (+ 27us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:13.375192 (+ 101us) server_negotiation.cc:299] Negotiation successful
0811 08:13:13.375211 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
W20260811 08:13:13.378698 2410 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:13:13.377880 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48402 (local address 127.27.243.252:44337)
0811 08:13:13.377939 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:13.377940 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:13.378132 (+ 192us) server_negotiation.cc:407] Connection header received
0811 08:13:13.378227 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:13.378228 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:13.378240 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:13.378268 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:13.378646 (+ 378us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48402: BlockingRecv error: recv got EOF from 127.0.0.1:48402 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 08:13:13.391480 2298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:13.388149 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50990 (local address 127.27.243.253:38941)
0811 08:13:13.388195 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:13.388197 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:13.388503 (+ 306us) server_negotiation.cc:407] Connection header received
0811 08:13:13.388602 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:13.388603 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:13.388613 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:13.388638 (+ 25us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:13:13.388815 (+ 177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:13.389607 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:13.390691 (+ 1084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:13.390968 (+ 277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:13.391011 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:13.391209 (+ 198us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:13:13.391243 (+ 34us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:13:13.391268 (+ 25us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:13.391382 (+ 114us) server_negotiation.cc:299] Negotiation successful
0811 08:13:13.391404 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
W20260811 08:13:13.394886 2410 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:13:13.394073 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48418 (local address 127.27.243.252:44337)
0811 08:13:13.394117 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:13.394119 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:13.394308 (+ 189us) server_negotiation.cc:407] Connection header received
0811 08:13:13.394416 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:13.394417 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:13.394429 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:13.394458 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:13.394828 (+ 370us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48418: BlockingRecv error: recv got EOF from 127.0.0.1:48418 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 08:13:13.415786 2298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:13.412430 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50998 (local address 127.27.243.253:38941)
0811 08:13:13.412473 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:13.412475 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:13.412646 (+ 171us) server_negotiation.cc:407] Connection header received
0811 08:13:13.412710 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:13.412711 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:13.412722 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:13.412797 (+ 75us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:13:13.413005 (+ 208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:13.413787 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:13.414954 (+ 1167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:13.415233 (+ 279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:13.415300 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:13.415509 (+ 209us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:13:13.415552 (+ 43us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:13:13.415615 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:13.415675 (+ 60us) server_negotiation.cc:299] Negotiation successful
0811 08:13:13.415699 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
W20260811 08:13:13.418503 2410 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:13:13.417983 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48430 (local address 127.27.243.252:44337)
0811 08:13:13.418025 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:13.418027 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:13.418035 (+ 8us) server_negotiation.cc:407] Connection header received
0811 08:13:13.418059 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:13.418059 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:13.418070 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:13.418121 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:13.418448 (+ 327us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48430: BlockingRecv error: recv got EOF from 127.0.0.1:48430 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 08:13:13.454689 2298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:13.451931 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51010 (local address 127.27.243.253:38941)
0811 08:13:13.452024 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:13.452026 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:13.452165 (+ 139us) server_negotiation.cc:407] Connection header received
0811 08:13:13.452205 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:13.452207 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:13.452220 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:13.452303 (+ 83us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:13:13.452456 (+ 153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:13.453196 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:13.453987 (+ 791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:13.454273 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:13.454347 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:13.454459 (+ 112us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:13:13.454497 (+ 38us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:13:13.454541 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:13.454587 (+ 46us) server_negotiation.cc:299] Negotiation successful
0811 08:13:13.454607 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
W20260811 08:13:13.457024 2410 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:13:13.456439 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48446 (local address 127.27.243.252:44337)
0811 08:13:13.456498 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:13.456500 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:13.456510 (+ 10us) server_negotiation.cc:407] Connection header received
0811 08:13:13.456564 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:13.456565 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:13.456577 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:13.456622 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:13.456965 (+ 343us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48446: BlockingRecv error: recv got EOF from 127.0.0.1:48446 (error 108)
Metrics: {"server-negotiator.queue_time_us":26}
I20260811 08:13:13.524485 2298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:13.522187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51020 (local address 127.27.243.253:38941)
0811 08:13:13.522254 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:13.522256 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:13.522332 (+ 76us) server_negotiation.cc:407] Connection header received
0811 08:13:13.522399 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:13.522400 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:13.522410 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:13.522473 (+ 63us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:13:13.522580 (+ 107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:13.523078 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:13.523935 (+ 857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:13.524133 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:13.524187 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:13.524296 (+ 109us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:13:13.524324 (+ 28us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:13:13.524357 (+ 33us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:13.524406 (+ 49us) server_negotiation.cc:299] Negotiation successful
0811 08:13:13.524422 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
W20260811 08:13:13.526897 2410 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:13:13.526200 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48448 (local address 127.27.243.252:44337)
0811 08:13:13.526259 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:13.526261 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:13.526349 (+ 88us) server_negotiation.cc:407] Connection header received
0811 08:13:13.526413 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:13.526414 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:13.526427 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:13.526477 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:13.526841 (+ 364us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48448: BlockingRecv error: recv got EOF from 127.0.0.1:48448 (error 108)
Metrics: {"server-negotiator.queue_time_us":31}
I20260811 08:13:13.658252 2298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:13.656052 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51034 (local address 127.27.243.253:38941)
0811 08:13:13.656113 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:13.656115 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:13.656125 (+ 10us) server_negotiation.cc:407] Connection header received
0811 08:13:13.656182 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:13.656182 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:13.656193 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:13.656241 (+ 48us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:13:13.656370 (+ 129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:13.656843 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:13.657695 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:13.657900 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:13.657955 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:13.658060 (+ 105us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:13:13.658088 (+ 28us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:13:13.658119 (+ 31us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:13.658163 (+ 44us) server_negotiation.cc:299] Negotiation successful
0811 08:13:13.658179 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
W20260811 08:13:13.660449 2410 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:13:13.659891 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48452 (local address 127.27.243.252:44337)
0811 08:13:13.659943 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:13.659945 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:13.659972 (+ 27us) server_negotiation.cc:407] Connection header received
0811 08:13:13.660037 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:13.660038 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:13.660047 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:13.660082 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:13.660391 (+ 309us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48452: BlockingRecv error: recv got EOF from 127.0.0.1:48452 (error 108)
Metrics: {"server-negotiator.queue_time_us":26}
I20260811 08:13:13.919950 2298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:13.917721 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51048 (local address 127.27.243.253:38941)
0811 08:13:13.917790 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:13.917792 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:13.917802 (+ 10us) server_negotiation.cc:407] Connection header received
0811 08:13:13.917837 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:13.917838 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:13.917849 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:13.917896 (+ 47us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:13:13.918035 (+ 139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:13.918544 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:13.919322 (+ 778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:13.919514 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:13.919569 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:13.919714 (+ 145us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:13:13.919751 (+ 37us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:13:13.919792 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:13.919850 (+ 58us) server_negotiation.cc:299] Negotiation successful
0811 08:13:13.919870 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
W20260811 08:13:13.922298 2410 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:13:13.921693 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48456 (local address 127.27.243.252:44337)
0811 08:13:13.921757 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:13.921759 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:13.921769 (+ 10us) server_negotiation.cc:407] Connection header received
0811 08:13:13.921883 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:13.921884 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:13.921895 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:13.921943 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:13.922255 (+ 312us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48456: BlockingRecv error: recv got EOF from 127.0.0.1:48456 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
I20260811 08:13:14.229921 2444 catalog_manager.cc:1259] Loaded cluster ID: 7eff327dcfee4a64a12d6dc16d5468be
I20260811 08:13:14.230017 2444 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 84864c47e9a14ae0a7ab592950e66d0d: loading cluster ID for follower catalog manager: success
I20260811 08:13:14.230943 2444 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 84864c47e9a14ae0a7ab592950e66d0d: acquiring CA information for follower catalog manager: success
I20260811 08:13:14.231240 2444 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 84864c47e9a14ae0a7ab592950e66d0d: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 08:13:14.437577 2722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:14.435365 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51054 (local address 127.27.243.253:38941)
0811 08:13:14.435495 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:14.435497 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:14.435521 (+ 24us) server_negotiation.cc:407] Connection header received
0811 08:13:14.435594 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:14.435594 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:14.435605 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:14.435663 (+ 58us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:13:14.435765 (+ 102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:14.436289 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:14.437010 (+ 721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:14.437199 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:14.437245 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:14.437352 (+ 107us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:13:14.437381 (+ 29us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:13:14.437412 (+ 31us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:14.437452 (+ 40us) server_negotiation.cc:299] Negotiation successful
0811 08:13:14.437468 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":107,"thread_start_us":69,"threads_started":1}
I20260811 08:13:14.441289 2736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:14.439256 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48466 (local address 127.27.243.252:44337)
0811 08:13:14.439373 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:14.439375 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:14.439381 (+ 6us) server_negotiation.cc:407] Connection header received
0811 08:13:14.439403 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:14.439404 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:14.439451 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:14.439518 (+ 67us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:13:14.439596 (+ 78us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:14.440064 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:14.440695 (+ 631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:14.440871 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:14.440911 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:14.441017 (+ 106us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:13:14.441125 (+ 108us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:13:14.441175 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:14.441191 (+ 16us) server_negotiation.cc:299] Negotiation successful
0811 08:13:14.441207 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":100,"thread_start_us":72,"threads_started":1}
I20260811 08:13:14.445466 2736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:14.442981 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48476 (local address 127.27.243.252:44337)
0811 08:13:14.443022 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:14.443023 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:14.443069 (+ 46us) server_negotiation.cc:407] Connection header received
0811 08:13:14.443129 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:14.443130 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:14.443140 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:14.443191 (+ 51us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:13:14.443332 (+ 141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:14.443976 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:14.444749 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:14.445027 (+ 278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:14.445082 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:14.445240 (+ 158us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:13:14.445272 (+ 32us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:13:14.445327 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:14.445381 (+ 54us) server_negotiation.cc:299] Negotiation successful
0811 08:13:14.445403 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 08:13:14.445770 2722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:14.442809 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51064 (local address 127.27.243.253:38941)
0811 08:13:14.442961 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:14.442963 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:14.443208 (+ 245us) server_negotiation.cc:407] Connection header received
0811 08:13:14.443294 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:14.443295 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:14.443306 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:14.443331 (+ 25us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:13:14.443508 (+ 177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:14.444198 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:14.445065 (+ 867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:14.445282 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:14.445336 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:14.445504 (+ 168us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:13:14.445555 (+ 51us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:13:14.445600 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:14.445685 (+ 85us) server_negotiation.cc:299] Negotiation successful
0811 08:13:14.445708 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131}
I20260811 08:13:14.445852 2747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:14.442828 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58906 (local address 127.27.243.254:33529)
0811 08:13:14.442934 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:14.442935 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:14.442986 (+ 51us) server_negotiation.cc:407] Connection header received
0811 08:13:14.443137 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:14.443138 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:14.443190 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:14.443270 (+ 80us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:13:14.443400 (+ 130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:14.443925 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:14.444862 (+ 937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:14.445154 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:14.445208 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:14.445429 (+ 221us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:13:14.445549 (+ 120us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:13:14.445605 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:14.445750 (+ 145us) server_negotiation.cc:299] Negotiation successful
0811 08:13:14.445774 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82,"thread_start_us":59,"threads_started":1}
I20260811 08:13:14.447497 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 2057
I20260811 08:13:14.462628 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 2184
I20260811 08:13:14.471576 28623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0_GQGb/build/release/bin/kudu with pid 2301
2026-08-11T08:13:14Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (2980 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (5891 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (277280 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST